Gazing Back at You: Responsive Typography and Face Tracking [Source]

Camera input is at last going from waving your arms around in front of the screen to some genuinely compelling ideas. And the more designers use the camera in fluid ways, the more expressive video may be as a means of interaction. Croatian designer Marko Dugonjić demonstrates a proof-of-concept implementation of typography that responds to your position. Using facial tracking, the text scales based on the distance of your face to the screen. The transitions are a bit jarring now, but it’s enough to suggest how this might work. http://webdesign.maratz.com/lab/responsivetypography/ There’s source code available for the head tracking on which …

READ MORE →

Transforming Books, Photos in Even More Disney Research

Disney Research is apparently releasing all their latest inventions at once. The most dazzling, atop the air-interaction-feedback project we saw earlier this week, uses captured light field data to transform ordinary photography into the basis of three-dimensional scenes. Say wha?: This paper describes a method for scene reconstruction of complex, detailed environments from 3D light fields. Densely sampled light fields in the order of 10^9 light rays allow us to capture the real world in unparalleled detail, but efficiently processing this amount of data to generate an equally detailed reconstruction represents a significant challenge to existing algorithms. We propose an …

READ MORE →

From Disneyland to You: Q+A with Creator of Disney's Air Interaction Aireal

Ideas for interaction have come from many places. But with illusion and immersion a key part of the magic of digital experiences today, maybe it’s about time to take a stroll to Disneyland. Yesterday, we saw the novel idea of using blasts of air to provide physical feedback without requiring touch: Into Thin Air: Disney’s Aireal Vortex Rings Give Tactile Feedback Where None Exists Today, Rajinder Sodhi of Disney Research, primary inventor of the tech, answers CDM’s questions about what all of this means. CDM: What other research has gone this direction before? Raj: This research comes from a big …

READ MORE →

From Disneyland to You: Q+A with Creator of Disney’s Air Interaction Aireal

Ideas for interaction have come from many places. But with illusion and immersion a key part of the magic of digital experiences today, maybe it’s about time to take a stroll to Disneyland. Yesterday, we saw the novel idea of using blasts of air to provide physical feedback without requiring touch: Into Thin Air: Disney’s Aireal Vortex Rings Give Tactile Feedback Where None Exists Today, Rajinder Sodhi of Disney Research, primary inventor of the tech, answers CDM’s questions about what all of this means. CDM: What other research has gone this direction before? Raj: This research comes from a big …

READ MORE →

Into Thin Air: Disney's Aireal Vortex Rings Give Tactile Feedback Where None Exists

The bane of wave-your-hands-in-the-air interaction systems is that you can’t feel anything when you use them. Swatting the air with your hands in front of a Kinect, for instance, gives you nothing in tactile resistance – those invisible objects can be seen, but not felt. So what’s the solution? Well, if the interaction is in the air, you could use actual air for feedback. That’s what researchers from Disney in Pittsburgh, PA propose with their new system Aireal. (Get it? Like the mermaid? Ahem.) The device is a robotic haptic air emitter, bursting short blasts of air called “vortexes.” When …

READ MORE →

Into Thin Air: Disney’s Aireal Vortex Rings Give Tactile Feedback Where None Exists

The bane of wave-your-hands-in-the-air interaction systems is that you can’t feel anything when you use them. Swatting the air with your hands in front of a Kinect, for instance, gives you nothing in tactile resistance – those invisible objects can be seen, but not felt. So what’s the solution? Well, if the interaction is in the air, you could use actual air for feedback. That’s what researchers from Disney in Pittsburgh, PA propose with their new system Aireal. (Get it? Like the mermaid? Ahem.) The device is a robotic haptic air emitter, bursting short blasts of air called “vortexes.” When …

READ MORE →

New Kinect Windows SDK Coming; Microsoft Opens Up Pre-release Developer Access [Timeline]

Whatever is going on in the new Kinect Microsoft unveiled recently, it’s doing more than its predecessor. It appears vastly more precise, smarter about telling people from objects, better at telling people from other people, and more responsive to gestures. And there’s another difference: this time, at last, Microsoft appears to be hitting the ground running. Caught flat-footed by the interest of innovative developers and artists in the original Kinect, Microsoft has only recently managed to get their SDK in a state that could rival efforts by hackers and sensor developer PrimeSense. The official Windows sensor, at least, is now …

READ MORE →

On Hacking the New Kinect

Will the new Kinect be hackable for artists and developers? Some of the best speculation I’ve seen yet actually shows up here in CDM comments. So, it’s worth elevating this to a news story, just in case you missed it. In short, the answer appears to be yes. I’m hopeful in particular for Microsoft’s own official developer tools when Kinect hits Windows next year, as I think it’s really the PC world that will be the most expressive and open. From an anonymous CDM reader calling him or herself “n4cer”: Though the port for the Kinect on Xbox One is …

READ MORE →

Biostagog: Fluid Cellular Architecture Combines Mapping, Responsive Interaction [Gallery]

BIOSTAGOG from Platige Image on Vimeo. When futurists dream of fluid architecture, more digital image than brick and mortar, this is one element of what they mean. From Warsaw, Poland comes a project combining algorithmic design, 3D-printed surfaces, and interactive motion turned into projection-mapped image. Yep, that ticks all the buzzword boxes. But the upshot really does signify something transformative here in all these trends: it shows an architectural surface imagined on computers that takes on new shapes and responds to its environment. So, while some of these particular interactions are familiar – apparently, no one gets tired of waving …

READ MORE →

Lawnmower Man-Style Audiovisuals, in Kinect Experiment, Plus a New Kinect

Oculus Rift + Kinect – Audio visual instrument a001 from Ethno Tekh on Vimeo. That window between science fiction and actual interfaces continues to narrow. Here, virtual hands paw at geometric orbs to produce sound, with simultaneous 3D visuals as accompaniment, in the latest artist/hacker experiment. You can thank the popular and surprisingly-accessible game engine, Unity – which recently added free deployment to mobiles, by the way. Description: This is our first Kinect-controlled, virtual reality experiment, using the greatly anticipated Oculus Rift. It’s a simple virtual reality environment built in Unity 3D with our own interactive framework. It allows us …

READ MORE →