Hey, remember this guy? It’s the Nintendo DS, and before shiny iPhones and iPads and Androids stole everyone’s heart away, Nintendo’s handhelds first demonstrated the musical, visual appeal of mobile among hackers and artists. Now, the 3DS could well win some of that spotlight back, perhaps surprisingly so. Our friend Dave Dri has gotten a rare hands-on with the new 3DS system. Games? Uh… sure. But with a beautiful, glasses-free 3D screen and lots of geek-friendly features, that might only be the beginning. Dave is already asking some of the questions handheld musicians and visualists might want to know. He writes:

I just had a one-on-one with the Nintendo 3DS, care of the PR person [from] Nintendo. They wouldn’t let me shoot the screen while it was on, but otherwise left us alone to geek it up.

We had three development units to play with, each with a game installed – Street Fighter, Zelda and the augmented reality example. The latter is an angle relevant to the music pitch. I asked if there were any plans for music apps, but my contact didn’t know of any plans to date, but using the augmented reality game, I was blown away by the possibilities. The game featured a dragon bursting out of the surface the target card is on, in our case a table at a Surry Hills cafe, and it had a seriously impressive trick of sampling and animating the surface “flipping over”, as well as concave and convex effects.
Another game, Face Raiders, “samples” someone’s face, and then super-imposes this on a series of characters that fly around the screen, merged with real-time video from cameras on the far side of the screen.

For video and audio hacking (care of the onboard SD card reader), or an extension of the Korg DS-10 style of retail offerings, there is some incredibly potential here! The tilt and motion controllers could conceivably be used to affect pitch and timbre of a virtual augmented reality synth – where in the game examples you have to move around the 3D world animated out of the target card and surface, and shoot targets in a full 360 sphere around the card, you could possibly be
triggering scenes and samples by moving around the real-world surface and “shooting” triggers.

Also… Nintendo have gone the total opposite direction to Apple. SD card, passive file transfers with other units within range, and a host of wifi and web features opens up a device that reminds us that “Sync to one library of wipe all content, no USB or SD, constrained media hosting, single-direction file transfers” devices aren’t the only things out there.

Just a ramble – you’re probably all over this, but I reckon you guys would get a lot out of the potential for audio and visual from this thing. Likewise let me know if there’s anything about the 3DS that I should check out. I get a review unit on loan in a few weeks, so more info the better!

Lucky you, Dave. So, readers – thoughts? Questions?

Wide-open connectivity sounds fantastic to me, and something I do desperately wish we had more of on iOS. (Android, at least, is “open” in this respect.) Development, though, is another story. I’d love for Nintendo to see developers flocking to iOS as a reason to open up their game system to casual and independent developers, let alone homebrew and hacking, but I’m anything but optimistic. Still, as with Apple, it’s hard not to love the machine anyway for their engineering – and seeing some of these connectivity and storage options is indeed encouraging.

Enjoy the images, ask questions, and we’ll for sure check in with Dave again soon.

  • I haven't researched enough to know the actual method of how they're displaying the 3d image…I'm hoping its better than the glasses-less TV screens that just look awful, but it may work better with pixel-y images. I'd definitely want more info on their sense of how fatiguing it is to look at..especially if I'm playing a game for 45minutes on the subway. Maybe it can be switched on and off somehow? The news about it not being recommended for use by children under 6 isn't very encouraging. The open-endedness is pretty great though..I've wanted to get a DS and this may be the one to beat.

  • newmiracle


    And supposedly you can "turn off" the 3d effect. Actually, it's a slider so you can set it to 0% or 100% or anywhere inbetween. I think they've learned from their VirtualBoy days, haha.

    I'm also skeptical about playing nice with homebrew, which is a shame. I wonder what the market response to a popular videogame system would be if they released an SDK to the public that allowed for some substantial development. At the very least, the ability for the 3DS to do cooler "open"ish type things gives hope that those same features will be unleashed by the inevietable homebrew scene that will revolve around this baby.

  • they've been cracking down on homebrew carts for the ds (which made it it nigh on a free for roms games machine) by making the firmware periodically updatable, like consoles, so i wonder where the homebrew community will fit in.

  • the DSi that is…

  • Peter Kirn

    If anyone can find out more info on the homebrew scene, I'd love to hear it. I think it's largely quiet at the moment as not even all official Nintendo devs seem to have the new 3DS SDK and test hardware, and of course no one really has the actual hardware. But the chatter I've seen in the homebrew world is that they're going to try to make it work. I don't know, sometimes Nintendo's efforts to block it seem to make developers only more enthusiastic.

  • I'm searching for a way to connect many ds screens and send the same video signal through them

    do you have any ideas?