Advertise here with Carbon Ads

This site is made possible by member support. โค๏ธ

Big thanks to Arcustech for hosting the site and offering amazing tech support.

When you buy through links on kottke.org, I may earn an affiliate commission. Thanks for supporting the site!

kottke.org. home of fine hypertext products since 1998.

๐Ÿ”  ๐Ÿ’€  ๐Ÿ“ธ  ๐Ÿ˜ญ  ๐Ÿ•ณ๏ธ  ๐Ÿค   ๐ŸŽฌ  ๐Ÿฅ”

The Talking Piano

Ok, this is super freaky: this is a regular analog piano being played by a computer-controlled mechanical machine and it sounds like a person speaking. If you hadn’t seen this before, (it’s from 2009) take a listen:

Deus Cantando is the work of artist Peter Ablinger. He recorded a German school student reciting some text and then composed a tune for the mechanical player to sound like the recitation. I cannot improve upon Jason Noble’s description of the work:

This is not digital manipulation, nor a digitally programmed piano like a Disklavier. This is a normal, acoustic piano, any old piano. The mechanism performing it consists of 88 electronically controlled, mechanical “fingers,” synchronized with superhuman speed and accuracy to replicate the spectral content of a child’s voice. Watching the above-linked video, it may seem that the speech is completely intelligible, but this is partially an illusion. The visual prompt of the words on the screen are an essential cue: take them away, and it becomes much harder to understand the words. But it is still remarkable that the auditory system is able to group discrete notes from a piano into such a close approximation of a continuous human voice, and that Ablinger was able to do this so convincingly using a conventional instrument (albeit, played robotically).

This is so cool, I can’t believe I’d never seen it before. (via @roberthodgin)

Discussion  3 comments

joe b.

Mark Rober featured a similar talking piano on his site some years back. Talking pianos are a good trick.

https://m.youtube.com/watch?v=uBEL3YVzMwk

Pete Ashton

Love this. When my lifepartnerwife is watching some TV show I have zero interest in I have a habit of listening to music of the voices, spotting the patterns of tone and rhythm that repeat again and again. I've often wanted to transcribe a show into playable music.

Andy Baio

Love this effect. I did some experimenting along these lines back in 2015.

Hello! In order to leave a comment, you need to be a current kottke.org member. If you'd like to sign up for a membership to support the site and join the conversation, you can explore your options here.

Existing members can sign in here. If you're a former member, you can renew your membership.

Note: If you are a member and tried to log in, it didn't work, and now you're stuck in a neverending login loop of death, try disabling any ad blockers or extensions that you have installed on your browser...sometimes they can interfere with the Memberful links. Still having trouble? Email me!