New Kinect Windows SDK Coming; Microsoft Opens Up Pre-release Developer Access [Timeline]

Whatever is going on in the new Kinect Microsoft unveiled recently, it’s doing more than its predecessor. It appears vastly more precise, smarter about telling people from objects, better at telling people from other people, and more responsive to gestures. And there’s another difference: this time, at last, Microsoft appears to be hitting the ground running. Caught flat-footed by the interest of innovative developers and artists in the original Kinect, Microsoft has only recently managed to get their SDK in a state that could rival efforts by hackers and sensor developer PrimeSense. The official Windows sensor, at least, is now …

READ MORE →

Hands Off: Apple Wants to Pull Orphion Music App Over Touch APIs

Apple’s devices have earned praise from developers for consistently supporting multiple fingers in predictable ways. But to go further with expression, one developer made use of the size of contact area on the screen. Any time a developer goes beyond “public” or official APIs, there’s a chance Apple will eventually balk. We knew this was a risk to the excellent music app Orphion when we covered it, but hoped, in fact, that if the app were successful, Apple might reconsider. Unfortunately, today we learn from developer Bastus Trump that Apple will remove the app. And that means, at the very …

READ MORE →

Control Music with Cubes Using Your Fingers: AeroMIDI 3D for Leap Motion

Cue the Tetris theme, and start playing music by navigating a field of cubes. So, you’ve seen X/Y touchpads before, many times, in hardware like the KAOSS Pad (or Lemur, or your computer trackpad). But AeroMIDI 3D does something rather different: instead of just a single X/Y area, you get an array of programmable 3D cubes floating in space, all triggered with waves of your fingers using the forthcoming Leap Motion connect. Use one finger, multiple fingers, different parameters, whatever you like, and notes and control messages are sent via MIDI to your favorite software. You get three dimensions of …

READ MORE →

Dance and Music: Convert Kinect to MIDI, Free Beta on Mac and Windows

When we first saw movements and dance converted to music in February, it must have sparked some interest. Developer Jesper Nordin tells us popular demand has prompted him to release a free (as in beer) version of his Gestrument Kinect controller. With a beta download and a Windows or Mac machine, you can translate Microsoft’s depth-sensing camera to MIDI events you can use with instruments. Previously (including mention of the iPad version of this idea, if you don’t fancy prancing about in front of a camera): Gestrument, Shaping Music with Kinect, Touch, and Acoustic Ensembles [Videos] Now, you can grab …

READ MORE →

Lawnmower Man-Style Audiovisuals, in Kinect Experiment, Plus a New Kinect

Oculus Rift + Kinect – Audio visual instrument a001 from Ethno Tekh on Vimeo. That window between science fiction and actual interfaces continues to narrow. Here, virtual hands paw at geometric orbs to produce sound, with simultaneous 3D visuals as accompaniment, in the latest artist/hacker experiment. You can thank the popular and surprisingly-accessible game engine, Unity – which recently added free deployment to mobiles, by the way. Description: This is our first Kinect-controlled, virtual reality experiment, using the greatly anticipated Oculus Rift. It’s a simple virtual reality environment built in Unity 3D with our own interactive framework. It allows us …

READ MORE →

Note from the Editor: Music for Dance, Music and Movement

“Dance music” is a term that has lately become maligned all over again. And the press is often fond of deriding the music of machines, as if drum machines and computers are sentient alien technology that climbed out of the smoldering remains of a wrecked UFO rather than the handiwork of someone’s imagination. For me, though, these two materials – movement and machines – are the reason I do what I care about this field, exploring new sounds in a way that is human and gestural, whether the music is in an experimental concert at 8p or a party in …

READ MORE →

Color and Light: Gestures Manipulate Music, RGB Lights [Ableton + Kinect]

Motion, light & sound / Kinect & Madlight from things happen on Vimeo. In a teaser video just released by Spain’s Things Happen, a silhouetted performer uses arm position to sweep through RGB colors and trigger sound cues. It’s the latest effort to integrate the immersive media environment with a performer’s body, part spectacle, part interface. The ingredients, apart from Microsoft’s ubiquitous Kinect depth camera: Motion capture + image = light + sound Software: MadMapper [using MadMapper’s Madlight feature to trigger lighting] Quartz composer Ableton live Music: Sun Glitters x Isan – Snowfall The nice thing about the inter-linked, comment-enabled …

READ MORE →

FL Studio 11: Play it with Touch and Everything and Everywhere, Live or Editing

FL Studio 11 has arrived, hot on the heels of an impressive FL Studio Mobile release. The folks at Image Line have been intensely busy, but what strikes me is that you can now play FL Studio using almost anything, on almost any device. The Mobile version works on Android and touch Windows devices, not just iOS, when most folks target only Apple. And the upgrade to FL Studio 11 is similarly flexible. There’s a clip-triggering performance mode, which already supports a range of input methods: “mouse, touch screen, typing keyboard or MIDI controller. Supports APC20/40, Launchpad, Lemur, Block, Maschine/Mikro, …

READ MORE →

From Gestures to MIDI: Geco Promises Music Applications for Leap Motion

Here we go again. Touchless hand gestures have been part of electronic musical performance ever since the Theremin first hummed to life almost 100 years ago. And those gestures embody the same challenges and promise. We have the ability as humans to think spatially, in three dimensions, and to have a tight sense of control via our muscles of gestures in space. We use gestures to communicate and to manipulate our world. Those same expectations can be disappointed in electronic systems, however, as they lack tangible physical feedback and may misinterpret our intentions. It’s easier to play with these ideas …

READ MORE →

DUO is a DIY 3D Sensor – Like Leap, But Open Source, From Gesture and Vision Veterans

Gestural input is already beginning to make Kinect look crude, offering new three-dimensional sensing approaches that combine low latency with precise gestures. That offers tremendous potential for new interfaces, and could in particular finally help solve the problem of how to intuitively work with three-dimensional interface concepts that don’t lend themselves to traditional touch and physical input. Leap Motion is already speeding toward its mid-May launch, complete with an app store ecosystem for developers wanting to push out new ideas to users. But Leap is a closed box. Apart from any philosophical objection, that means you can’t take it apart …

READ MORE →