Skip to Content
Uncategorized

The Puzzling Paradox of Sign Language

It takes longer to sign words than to say them. So how is it possible to sign and speak at the same rate?

Here’s a curious paradox related to American Sign Language, the system of hand-based gestures used by around 2 million deaf people in the US and elsewhere to communicate.

Almost 40 years ago, researchers discovered that although it takes longer to make signs than to say the equivalent words, on average sentences can be completed in about the same time. How can that be possible?

Today, Andrew Chong and buddies at Princeton University in New Jersey give us the answer. They say that the information content of the 45 handshapes that make up sign language is higher than the information content of phonemes, the building blocks of the spoken word. In other words, there is greater redundancy in spoken English than signed English.

In a way, that’s a trivial explanation, a mere restatement of the problem. What’s impressive about the Princeton contribution is the way they have arrived at this conclusion.

The team has determined the entropy of American Sign Language experimentally, by measuring the frequency of handshapes on video logs for deaf people uploaded to youtube.com, deafvideo.tv and deafread.com as well as from video recordings of signed conversations taken on campus.

It turns out that the information content of handshapes is on average just 0.5 bits per handshape less than the theoretical maximum. By contrast, the information content per phoneme in spoken English is some 3 bits lower than the maximum.

This raises an interesting question. The spoken word has all this redundancy for a reason: it allows us to be understood over a noisy channel. Lessen the redundancy and your capacity to deal with noise is correspondingly reduced.

Why would sign language need less redundancy? “Entropy might be higher for handshapes than English phonemes because the visual channel is less noisy than the auditory channel…so error correction is less necessary,” say Chong and co.

They go on to speculate that signers cope with errors in an entirely different way to speakers. “Difficulties in visual recognition of handshapes could be solved by holding or slowing the transition between those handshapes for longer amounts of time, while difficulties in auditory recognition of spoken phonemes cannot always be easily solved by speaking phonemes for longer amounts of time,” they say.

And why is all this useful? Chong and friends say that if sign language is ever to be encoded and transmitted electronically, a better understanding of its information content will be essential for developing encoders and decoders that do the job. A worthy pursuit by any standards.

Ref: arxiv.org/abs/0912.1768: Frequency of Occurrence and Information Entropy of American Sign Language

Keep Reading

Most Popular

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

How scientists traced a mysterious covid case back to six toilets

When wastewater surveillance turns into a hunt for a single infected individual, the ethics get tricky.

The problem with plug-in hybrids? Their drivers.

Plug-in hybrids are often sold as a transition to EVs, but new data from Europe shows we’re still underestimating the emissions they produce.

Google DeepMind’s new generative model makes Super Mario–like games from scratch

Genie learns how to control games by watching hours and hours of video. It could help train next-gen robots too.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.