Skip to Content
Uncategorized

‘Big Data’ Means Business Needs Mathematicians

The era when all the data a business gathered on itself could be accommodated by a single spreadsheet is coming to a close
September 28, 2011

The proliferation of ways to measure things – point of service terminals, web analytics, geographic and temporal records, even semantic information – means businesses are drowning in data. This has led to a new class of engineer, the “data scientist,” whose job it is to perform the sophisticated mathematical gymnastics required to extract actionable information from this mass of numbers. According to mathematician Cathy O’Neill, the skills of a data scientist include not only crunching numbers, but also visualizing the results.

Data Science visualization by Hilary Mason

As Carnegie Mellon statistician Cosma Shalizi points out, O’Neill’s description of the skills required of a data scientist are precisely those of a suitably well-educated statistician, even if he or she has only an undergraduate degree in the subject. Granted, Shaliz teaches at Carnegie Mellon, which is among the best engineering schools on the planet, so that’s not to say that everyone with a B.S. in statistics has mastered modern regression, advanced data analysis, data mining and statistical visualization.

This re-branding of statistical literacy as “data science” points out a larger trend – disciplines that were formerly the domain of the specialist, such as statistics, are now more important to a larger segment of the business world than ever. The fact that so few students view even a fraction of this level of mastery as necessary – and that schools often do not offer even a basic statistical education to non-math majors until the post-graduate level – suggests that in this area, perhaps even more than other areas associated with engineering, there is a yawning gap between the skills our workforce possesses and the skills employers require.

Physicists have long been drifting into Wall Street, which can use their mathematical abilities to manage hedge funds and the like. Will we see a similar drift of mathematicians into startups where business decision-making was formerly the sole domain of sales and C-level executives?

Keep Reading

Most Popular

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

The problem with plug-in hybrids? Their drivers.

Plug-in hybrids are often sold as a transition to EVs, but new data from Europe shows we’re still underestimating the emissions they produce.

Google DeepMind’s new generative model makes Super Mario–like games from scratch

Genie learns how to control games by watching hours and hours of video. It could help train next-gen robots too.

How scientists traced a mysterious covid case back to six toilets

When wastewater surveillance turns into a hunt for a single infected individual, the ethics get tricky.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.