A Robotic Machine Worn on the Arm Turns Tattoos into Music

Symbols in on paper can be realized as music, so why not turn a tattoo on your arm into a musical score?

That’s what artist Dmitry Morozov (“vtol”), Moscow-based media artist and musician, has done with “reading my body.” It does more than transform his body markings into sounds. He mounts a machine on his arm, as sensors scan the image from a stepper-motor driven path along rails. The strange robotic machine makes him a kind of cyborg photo scanner optical synth.

And the results sound like a delicate solo on a violin, playing a lullaby to baby puppies. Kidding. They sound more like some harsh cyborg Russian sound art. As we’d expect (and hope).

::vtol:: “reading my body” from ::vtol:: on Vimeo.

Here’s how it works:

The ingredients, assembled in Moscow, Kaliningrad, and Berlin (okay, I’ve been to two out of those three – guess which): Nord Modular G2 synth and Symbolic Sound Kyma X environment, OSCulator for converting OSC messages, Arduino, and Wii remote, plus custom robotics and sensors. The tattoo is designed for musical applications, and he can ‘play’ the score interactively by modulating the sensors path through the score, with additional sensors allowing him to control performance parameters.

Description:

а sound controller that uses tattoo as a music score

this is a special instrument that combines human body and robotic system into a single entity that is designed to automate creative process in an attempt to represent the artist and his instrument as a creative hybrid. The device consists of a railing with comfortable hand holders and two parallel, but offset from each other black lines’ sensors that move along the arm using a stepper motor. It is equipped with a 3-dimensional Wii remote controller that uses the OSC protocol in order to give a possibility of additional expression achieved by moving hand in space.

Here’s an example of a different performance, showing how he can transform parameters as he plays: