Glow sticks and sparklers are terrific fun. I love drawing light patterns in the air, forming images or tracing out fleeting letters that vanish seconds after they appear.
Similar wrist-strokes can be captured now, some of them anyway, by a prototype glove being designed at the Karlsruhe Institute of Technology in Germany.
A team at the Cognitive Systems lab put together inertial sensors, an accelerometer and a gyroscope on a knit glove. The retooled mitt recognizes letter and words and even sentences as its wearer draws them in the air.
The glove doesn’t attempt to recognize everything—it won’t try to decipher letters if you were waving to a friend across the street, perhaps, or stirring a pot of soup. Christopher Amma and the developers of the glove have set up the system to pay particular attention to alphabet-like patterns among the arm movements it is continuously tracking.
When nine volunteers took the gloves for a test run, using it to write words in the air as if drawing on an imaginary blackboard, the designers found that the glove almost never missed a handwriting segment.
That is, when a tester resumed tracing letters in the air after a break, or after using their hands for some other task, the glove listened up and started tracking 99 percent of the time. They wrote the same 366 words from a previously chosen script over 4 hours, taking breaks in between.
The system is designed to recognize more than 8,000 words, and in tests was able to recognize word patterns with an average error rate of 11 percent. Also, the glove’s performance varied depending on which tester was wearing it.
There’s room for improvement in how well the glove recognizes letters and words, the authors admit in their paper describing the glove. But, they claim, it’s a healthy first step towards a gesture sensor that’s built to pick out certain kinds of movements—sequences of alphabets in this case—over others.
How SpaceX’s massive Starship rocket might unlock the solar system—and beyond
With the first orbital test launch of Starship on the horizon, scientists are dreaming about what it might make possible— from trips to Neptune to planetary defense.
DeepMind says its new language model can beat others 25 times its size
RETRO uses an external memory to look up passages of text on the fly, avoiding some of the costs of training a vast neural network
The therapists using AI to make therapy better
Researchers are learning more about how therapy works by examining the language therapists use with clients. It could lead to more people getting better, and staying better.
What it will take to unleash the potential of geothermal power
Four new pilot plants funded by the US infrastructure bill could help expand the range of the “forgotten renewable.”
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.