Skip to Content

Virtual Reality for Fruit Flies: Plans Unveiled

The ability to track fruit flies in real time is the foundation of a virtual reality system that could revolutionize the study of animal flying behavior.

In 1939, John Kennedy at Imperial College, London, discovered a curious fact about mosquitoes. In flight, they tend to turn toward vertical landmarks such as fixed posts. A similar behavior is also observed in fruit flies.

This is a straightforward repeatable observation suggesting that it is hard-wired into a fly’s neurobiology. Changing the neurobiology, either genetically or chemically, should generate other flying behaviors. And studying these flying activities should give neurobiologists a way of understanding exactly how neurons and genes determine behavior. All you have to do is watch the flies.

That’s easier said than done. High-resolution cameras generally have a small field of view and the data they produce is so great that it cannot be processed in real time. That severely limits the kind of experiments scientists can do.

But all that looks set to change with the development of a system called Flydra by Andrew Straw and buddies from the California Institute of Technology in Pasadena. Flydra is formed from two words: fly, the object of the team’s study, and hydra, the many-headed creature of Greek mythology.

The system consists of many relatively low-resolution cameras each with a wide field of view, recording the same, relatively large volume of space. The images are processed in real time by a number of computers that track the 3-D motion of many flying animals at once. This tracking is entirely automated.

That’s an impressive system because it opens up the possibility of the systematic study of the flying behavior of many creatures over long periods of time. That’s never been done before. Potentially, it could revolutionize our understanding of flying behavior.

The team has already studied the flying behaviour of 20 female fruit flies in a box over a period of 12 hours. During this time, the team varied the contrast of a pattern beamed onto the walls of the box. (To give you an idea of how difficult these experiments must be without automatic tracking, the teams says the flies spent most of their time walking on the walls, floor and ceiling and the entire 12-hour run yielded a total of only 1,760 seconds of flight.)

Animal behaviorists have always assumed that flying animals use these patterns to determine their flying speed.

Sure enough, as the contrast of this pattern is reduced, the flies’ flying speed becomes more erratic, suggesting they’re having more difficulty controlling it.

That’s already a useful result (and confirms the results of other experiments)..

But the real power of Flydra is its ability to track movement in real time (or at least with a lag of only 40ms). This allows the pattern to be changed in real time in response to a fly’s motion–a kind of virtual reality for drosophila.

That opens up an entirely new way to study flying behavior. Imagine, for example, a fly veering towards a vertical post which then continually moves. Fruit fly aerobatics, anyone?

And of course, it’s not just fruit flies that can be studied. Straw and co are already looking at hummingbird behavior. “We are also studying maneuvering in solitary and competing hummingbirds and the role of maneuvering in establishing dominance,” they say.

It looks as if a golden age is nigh for the study of flying animal behavior. John Kennedy, who died in 1993, would have been amazed.

Ref: Multi-camera Realtime 3D Tracking of Multiple Flying Animals .

Keep Reading

Most Popular

images created by Google Imagen
images created by Google Imagen

The dark secret behind those cute AI-generated animal images

Google Brain has revealed its own image-making AI, called Imagen. But don't expect to see anything that isn't wholesome.

biomass with Charm mobile unit in background
biomass with Charm mobile unit in background

Inside Charm Industrial’s big bet on corn stalks for carbon removal

The startup used plant matter and bio-oil to sequester thousands of tons of carbon. The question now is how reliable, scalable, and economical this approach will prove.

AGI is just chatter for now concept
AGI is just chatter for now concept

The hype around DeepMind’s new AI model misses what’s actually cool about it

Some worry that the chatter about these tools is doing the whole field a disservice.

Peter Reinhardt
Peter Reinhardt

How Charm Industrial hopes to use crops to cut steel emissions

The startup believes its bio-oil, once converted into syngas, could help clean up the dirtiest industrial sector.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at with a list of newsletters you’d like to receive.