Skip to Content

Scientists Develop Financial Turing Test

Can humans distinguish between sequences of real and randomly generated financial data? Scientist have developed a new test to find out.

Various economists argue that the efficiency of a market ought to be clearly evident in the returns it produces. They say that the more efficient it is, the more random its returns will be and a perfect market should be completely random.

That would appear to give the lie to the widespread belief that humans are unable to tell the difference between financial market returns and, say, a sequence of coin tosses. A number of experiments seem to back up this belief, showing for example that humans studying randomly generated data very quickly identify ‘trends’ in the data and develop hypotheses about them.

To find out whether humans can reliably distinguish between real and random market data, Jasmina Hasanhodzic at AlphaSimplex, an investment strategy company in Cambridge, Mass, Andrew Lo at MIT’s Sloan School of Management, who founded AlphaSimplex and Emanuele Viola at NorthEastern University, have devised a simple experiment.

They have created a computer game in which a player is shown two time-series of data. One is real data from a financial market such as the US Dollar Index, or the spot price of Gold. The other is the same data randomly rearranged. The player has to guess which is the real series and is immediately told whether the guess is right or wrong.

Hasanhodzic and co call this a financial Turing test and anybody can sign up and take the test on their website.

In their experiment, 78 people took the test, with each contest lasting two weeks.

The results show that that humans are actually rather good at this game. After a few guesses most people quickly learn how to distinguish the real data from the random stuff. “The results provide overwhelming statistical evidence (p-values of at most 0.5%) that humans can quickly learn to distinguish actual price series from randomly generated ones,” say Hasanhodzic and co.

It’s not hard to see why. In feedback sessions, the players say that the real data was smoother than the randomised data or vice versa and that these patterns were easy to spot after a few goes.

That’s an intriguing result but what to make of it? First let’s look at what the study does not address. The study does not address any notion of predictability. A truly random market is entirely unpredictable, by definition. There is good evidence that real markets are not random and that their behaviour can be described by fairly simple principles. That doesn’t make them predictable, however (although we have looked at evidence that certain kinds of bubble markets might be predictable here, here and here).

Neither does the study address whether humans are good at making predictions; whether they are better at predicting the future performance of a market than, say, a coin toss.

So what does it show? It shows that humans are good at pattern recognition. Nothing more and nothing less.

Ref: Is It Real, or Is It Randomized?: A Financial Turing Test

Keep Reading

Most Popular

images created by Google Imagen
images created by Google Imagen

The dark secret behind those cute AI-generated animal images

Google Brain has revealed its own image-making AI, called Imagen. But don't expect to see anything that isn't wholesome.

AGI is just chatter for now concept
AGI is just chatter for now concept

The hype around DeepMind’s new AI model misses what’s actually cool about it

Some worry that the chatter about these tools is doing the whole field a disservice.

Hoan Ton-That, CEO of Clearview AI
Hoan Ton-That, CEO of Clearview AI

The walls are closing in on Clearview AI

The controversial face recognition company was just fined $10 million for scraping UK faces from the web. That might not be the end of it.

spaceman on a horse generated by DALL-E
spaceman on a horse generated by DALL-E

This horse-riding astronaut is a milestone in AI’s journey to make sense of the world

OpenAI’s latest picture-making AI is amazing—but raises questions about what we mean by intelligence.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at with a list of newsletters you’d like to receive.