New Kinect Gets Closer to Your Body [Videos, Links]

It’s a new world for media artists, one in which we look to the latest game console news because it impacts our art-making tools. And so it is that, along with a new Xbox, Microsoft has a new Kinect. The new Kinect uses standard infrared tracking (ideal for in-the-dark footage and accurate tracking), but also returns RGB imagery. It’s 1080p, 30-60 fps (it seems tracking is at 30 fps and video at 60, but I’m reading conflicting reports). Hands-on reports say latency is reduced. If the finished product is consistent with rumors, that could be owing to more in-hardware tracking …

READ MORE →

Responsive Kinect Dancing Goes Hip-Hop [Video, Tips]

Body mapping and dance/visual fusions are still explored only in fits and starts, compared to the extent of live music and visual performance in other media. So, it’s encouraging to see this latest experiment from dancer Christian Mio Loclair. Working with Microsoft’s Kinect, the slowly-undulating tendrils of visuals behind him create visual counterpoint for headstands and hip-hop dance techniques. Far from running up against latency, here there’s a sense of visuals that answer the moves with a slow sigh, creating a kind of living architectural space behind him. The tools: ofxOpenNI and ofxCV work with OpenFrameworks to analyze imagery from …

READ MORE →

Color and Light: Gestures Manipulate Music, RGB Lights [Ableton + Kinect]

Motion, light & sound / Kinect & Madlight from things happen on Vimeo. In a teaser video just released by Spain’s Things Happen, a silhouetted performer uses arm position to sweep through RGB colors and trigger sound cues. It’s the latest effort to integrate the immersive media environment with a performer’s body, part spectacle, part interface. The ingredients, apart from Microsoft’s ubiquitous Kinect depth camera: Motion capture + image = light + sound Software: MadMapper [using MadMapper’s Madlight feature to trigger lighting] Quartz composer Ableton live Music: Sun Glitters x Isan – Snowfall The nice thing about the inter-linked, comment-enabled …

READ MORE →

Pianist and Piano, Disconnected, in Composition for Kinect and Grand

The piano is a conventional grand, but with digital interface and camera, the composer is separated from it by air, playing without touching. It’s a Theremin interface for a keyboard instrument. Piano post-modern? Gestural post-digital? Whatever it is, in a work composer Benjamin Martinson composed for player piano, computer, and Kinect camera, the piano work holds up as musical content – compositional gesture, not just gimmicky digital hand-waving. Martinson himself looks oddly isolated and awkward, a man making rough mime gestures in unseen water, molasses, and wind. I can’t tell whether this is more about our expectations of human movement, …

READ MORE →

Gestrument, Shaping Music with Kinect, Touch, and Acoustic Ensembles [Videos]

Swiping through clouds of timbre and melody, using Gestrument is an experience of a different musical animal. Jesper Nordin and Kymatica / Jonatan Liljedahl created the iPad version, available now for ten bucks. But it’s worth looking at that side by side with Gestrument for Kinect, as the same metaphors can translate across input methods. Both employ a kind of meta-composition – instrument as conductor of musical structures, more than an object for exclusively solo expression. What’s especially nice is hearing these digital, synthesized environments meld with acoustic instruments. The solution may not convince everyone yet, but there’s clearly potential …

READ MORE →

Cubepix, Kinetic Projection Mapping On A Moving Wall of Cubes [Arduino + OF + Kinect]

Cubepix Demo Test – by Xavi’s Lab from Glassworks Barcelona on Vimeo. The next step in projection mapping: kinetic projection mapping. Moving beyond the sometimes-clinical use of projection mapping to use three-dimensional objects as a surface, the addition of the kinetic makes the surface itself part of the motion. Cubepix is a direct, lovely implementation of that notion, as an array of cubes moves in concert with the images displayed on them. This project also clearly recalls the work of Daniel Rozin, whose wooden mirrors – one most notoriously displayed in the entrance lobby of NYU’s ITP media tech program …

READ MORE →
leap

Move Over, Kinect: Early Gestural Musical Demos for Leap Motion Look Terrific

Microsoft’s Kinect has proven a compelling proof of concept for gestural control of music. But it could be just the beginning of mass-market gestural sensing technologies. The Leap Motion, like Kinect, promises to be affordable gear. Unlike the Kinect, the hardware is even more unobtrusive, and gestural control is more precise and responsive. Given the latency limitations of Kinect, that’s a huge deal for music. And better expression could inspire new musical ideas. We’ve spoken many times before about the limitations of touchless control – Theremins are spectacular but not the easiest instruments to play, and waving your hands in …

READ MORE →

Full-Body Music, Live: AV Kinect Performance, Complete with Beer Bottle [Video]

ETHNO TEKH | live at Enig’matik Vibrations [Melb,Aus] 2012 from Ethno Tekh on Vimeo. You’ve seen impressive tech demos and promo videos with Kinect, perhaps. But here’s a real, live performance with a crowd. (Best moment: an audience member walking in front of the camera. Breaking the flow like that oddly makes the show feel more real.) Ethno Tekh is a dubsteppy AV performance with a flow of beats and images. Now, we’ve heard all the criticisms of Kinect as musical controller – its fairly high latency and broad gestures mean it can’t quite compete with acoustic instruments or more …

READ MORE →

Kinect Hacking, Now in Next-Level Halloween Decorations

Kinect Ghosts from Ben Guerrette on Vimeo. Just how significant is the impact of Kinect and computer vision? Enough so that trick-or-treating kids might get to play a video game by waving their hands in front of someone’s garage. Which part of “we’re living in the future” did you not get, precisely? Ben Guerrette writes CDM: Here’s a short video of a Kinect project I put together for the Halloween Trick or Treaters. I turned my garage into a giant video game. Well, kind of. I just projected in it. It’s a simple “get the ghost” game where up to …

READ MORE →

In Black Droplets, the Monochrome LCD Transformed Into Medium

If previous generations worked in paint, now we can work in monochrome LCDs. That’s the message of a beautiful work entitled IRIS, making use of lowly LCD displays to produce a mirror made of dots. The description: IRIS is a unique media canvas with matrix of conventional information display technology – a monochrome LCD. Through the phased opening and closing of circular-segmented black Liquid Crystal, IRIS can create various patterns and control the amount (size) of passing lights. IRIS is an interactive medium for visual simplicity which uses the passage of ambient light, not emission of light itself. Interactive mirrors …

READ MORE →