JeongHo Park, a self-described “algorithmic composer” and artist, is building a delightful instrument that turns images into scores with full drawing capability for making paths. Inspired by the likes of Xenakis’ UPIC, the tool gives you instantly mind-bending results, living in that netherworld between synthesizer and score.
The idea here is to first find an image — ideally something with some contrast that already looks score-like, for best results — and then trace your way across it as you synthesize sounds. So you’d upload an interesting image first (or even sketch on paper, snap that, and upload the result). There’s also now a “blank canvas” mode for just working with the drawing/tracing facility. (I snuck in that suggestion!)
Try it yourself (ideally on a desktop browser):
https://jeonghopark.de/sonicsketchjs/index.html
Here I am having some fun with it:
Don’t overlook the image post-processing, as that will profoundly impact the results — you get options for brightness, contrast, invert, and grayscale.
Previously dubbed “SketchSynth,” this tool has appeared as an installation, a video synth, and other sketches; you’ll find some on GitHub (openFrameworks, oh yeah!) —
https://github.com/jeonghopark
With dry sound on, it’s pretty raw, but these results sound terrific through effects. JeongHo has already added a nice reverb and chorus.
I appreciate this earlier version, too:
What’s UPIC? Well here’s a terrific vintage video to explain if you don’t know, and a great watch for those of you who do!
And more: