Solid motion: Softkinetic builds software that helps designers incorporate data from depth-sensing cameras into their applications. One of the system’s functions is to take a cloud of points from a depth map made by the camera and consolidate it into a human-shaped volume, shown above, with identifiable body parts. Developers can then use the volume as the basis for a video avatar, a figure used to represent a player in a 3-D game. Information about the position and velocity of the player’s body parts can be used to control the game.
Softkinetic

Computing

Whole-Body Gaming

New software makes it easier to build games controlled by a user's body position.

  • Monday, May 5, 2008
  • By Erica Naone

The massive success of the Nintendo Wii proved the appeal of motion-controlled gaming. Now Softkinetic, a company based in Belgium, is working to let video-game players use a wider range of more-natural movements to control the on-screen action. Softkinetic's software is meant to work with depth-sensing cameras, which can be used to determine a player's body position and motions. "You don't need a controller in your hand," says CEO Michel Tombroff. "You don't need to wear a special outfit. You just come in front of the camera in your living room, and you start playing by moving your entire body."

Attempts to commercialize gestural interfaces date back to at least the late 1980s and the Power Glove, an accessory for the original Nintendo Entertainment System. Many such systems, however, have been defeated by the need for awkward, bulky accessories; others just didn't work that well.

The Wii controller was the field's first success. But the motions it requires can sometimes feel stiff and unnatural, and it's sensitive only to gestures made by the hand in which it's held. Depth-sensing cameras, on the other hand, can pick up gestures made by a variety of body parts, Tombroff says. They can also be tuned to pick up motions more precisely. Designing programs that work with the cameras, however, is difficult: translating depth measurements into a map of a human figure, and determining what motions that figure is making, are computationally daunting tasks. This is where Softkinetic comes in.

Softkinetic's technology started out as research at the University of Brussels, in Belgium, aimed at exploring the user interfaces made possible by stereoscopic cameras, which sense depth by using two input sources, in much the way that the human brain perceives depth by comparing data from two eyes. The group created Softkinetic in mid-2007 and has adapted its research to work with newer depth-sensing cameras as well. Tombroff explains that the newer cameras have better commercial prospects because they've done away with the need for two input sources. As a consequence, they're smaller, with cheaper parts, and easier to incorporate into existing devices such as laptops.

Advertisement

Tombroff says that the new cameras sense depth by using infrared light in one of two ways. First, the camera might send out infrared light and receive the reflections of that light off objects in a room. The sending and receiving information can be compared to determine details of position and depth around the camera. Alternatively, the camera could project a grid of infrared light onto a room, and calculate the positions of objects based on how the grid is distorted.

Print

Related Articles

Advertisers Follow Audiences into Games

Broadening demographic reach makes entertainment software appealing for branding campaigns.

A Turing Test for Computer Game Bots

A new contest could help develop better AI for games and other applications.

Open-Source Data Glove

AcceleGlove can be programmed for many applications.

Close Comments

To comment, please sign in or register

Forgot my password

johnalphonse

78 Comments

  • 1371 Days Ago
  • 05/13/2008

Been there, done that.

Yes there's lots of room for improvement, but Sony's EyeToy is the exact same thing being proposed here via use of video capture.  Why no mention here?

Reply

LarryH

11 Comments

  • 1334 Days Ago
  • 06/19/2008

Re: Been there, done that.

I don't think the EyeToy senses depth. Three-dimensional awareness is what makes this approach so much more interesting (and effective).

Reply

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Sponsored Content

Technologies from National Instruments

Adding Data Logging
Log measured data to a file and open it in Microsoft Excel

> Click here for more National Instruments Videos <
Whitepaper

Temperature Measurements with Thermocouples: How-To Guide

This document is part of the “How-To Guide for Most Common Measurements” centralized resource portal. This tutorial provides a detailed guide for measurement and device considerations to take temperature measurements using thermocouples. Get an introduction to thermocouples, which are inexpensive sensing devices widely used with PC-based data acquisition systems. Also review some specific thermocouple examples and learn how thermocouples work and ways to integrate them into a data acquisition measurement system.

View full PDF > Listen to story >
Find us on Youtube

Videos

A Robot Recruit that Can Do It All

More

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

Square

Cotendo

BrightSource Energy

Novartis

More

Advertisement

Facebook

Advertisement