Gordon P. Baty on Digital Experience

Icon

My professional opinion blog

It’s the era of the spatial UI

There’s a quiet user experience revolution going on, and although many people are aware of it on an ‘oh that’s neat’ level, I predict that we’ll see a snowball effect of user experiences in 3 dimensions.

The two big players that are bringing spatial UI into the mainstream are the iPhone and Wii.  Although iPhone is primarily a touch-driven device, anyone who has delved into the world of downloadable apps will find some very interesting uses of it’s spatial awareness features: Games that detect tiny changes in tilt angle for driving a car or balancing a pile of blocks, and apps that change to a different mode based on which way up you are holding it

You’re most likely already familiar with the Wii-mote and it’s spatial capabilities.  There are actually two features built into the Wii-mote: tilting (like the iPhone) and also pointing at the screen.  As you play through Wii games the controller takes on different modes – at one point you’ll be pointing at what to do next, then you’ll be tilting it to steer a vehicle, then waving it in ‘gestures’.  There’s been a deluge of sub-par games on the Wii since it became such a success, but look carefully and you’ll find games with highly innnovative interactions. 

Spatial UI has been beautifully brought together in the Siftables prototype, whereby small independent computers react to each other depending on each other’s roles and physical relationships.  Watch the presentation at TED and you’ll see it passes the ultimate test: It delights children. So this may not be a consumer device that people will run out and buy tomorrow, but the potential for UI innovation is fascinating.

Spatial experiences are going mainstream with 3D movies.After years sidelined at IMAX and amusement parks the 3D movie is back with a vengeance and it seems like every animated movie is now releasing in 3D. [update:] James Cameron in a recent Time article claims 2D is inherently harder for the brain to process, as opposed to 3 dimensions which the brain is designed to process.

So what’s next?  It’s hard to predict what will be a good spatial experience, how best to use the new technology and we’ll evidently need a period for people to just play with it and see what works and what doesn’t (there’s certainly been a fair share of both so far).  If you have the opportunity to build spatial awareness into your next product, I advise you to embrace it with fervour but also expect to prototype and go through a few iterations before you get it right.

Filed under: 3D, general, revolutions, trends, user interface , , , , , , , , , , , ,

Leave a Reply

You must be logged in to post a comment.