We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Emerging Technology from the arXiv

A View from Emerging Technology from the arXiv

Benford's Law And A Theory of Everything

A new relationship between Benford’s Law and the statistics of fundamental physics may hint at a deeper theory of everything

  • May 7, 2010

In 1938, the physicist Frank Benford made an extraordinary discovery about numbers. He found that in many lists of numbers drawn from real data, the leading digit is far more likely to be a 1 than a 9. In fact, the distribution of first digits follows a logarithmic law. So the first digit is likely to be 1 about 30 per cent of time while the number 9 appears only five per cent of the time.

That’s an unsettling and counterintuitive discovery. Why aren’t numbers evenly distributed in such lists? One answer is that if numbers have this type of distribution then it must be scale invariant. So switching a data set measured in inches to one measured in centimetres should not change the distribution. If that’s the case, then the only form such a distribution can take is logarithmic.

But while this is a powerful argument, it does nothing to explan the existence of the distribution in the first place.

Then there is the fact that Benford Law seems to apply only to certain types of data. Physicists have found that it crops up in an amazing variety of data sets. Here are just a few: the areas of lakes, the lengths of rivers, the physical constants, stock market indices, file sizes in a personal computer and so on.

However, there are many data sets that do not follow Benford’s law, such as lottery and telephone numbers.

What’s the difference between these data sets that makes Benford’s law apply or not? It’s hard to escape the feeling that something deeper must be going on.

Today, Lijing Shao and Bo-Qiang Ma at Peking University in China provide a new insight into the nature of Benford’s law. They examine how Benford’s law applies to three kinds of statistical distributions widely used in physics.

These are: the Boltzmann-Gibbs distribution which is a probability measure used to describe the distribution of the states of a system; the Fermi-Dirac distribution which is a measure of the energies of single particles that obey the Pauli exclusion principle (ie fermions); and finally the Bose-Einstein distribution, a measure of the energies of single particles that do not obey the Pauli exclusion principle (ie bosons).

Lijing and Bo-Qiang say that the Boltzmann-Gibbs and Fermi-Dirac distributions distributions both fluctuate in a periodic manner around the Benford distribution with respect to the temperature of the system. The Bose Einstein distribution, on the other hand, conforms to benford’s Law exactly whatever the temperature is.

What to make of this discovery? Lijing and Bo-Qiang say that logarithmic distributions are a general feature of statistical physics and so “might be a more fundamental principle behind the complexity of the nature”.

That’s an intriguing idea. Could it be that Benford’s law hints at some kind underlying theory that governs the nature of many physical systems? Perhaps.

But what then of data sets that do not conform to Benford’s law? Any decent explanation will need to explain why some data sets follow the law and others don’t and it seems that Lijing and Bo-Qiang are as far as ever from this.

Ref: arxiv.org/abs/1005.0660: The Significant Digit Law In Statistical Physics

Want to go ad free? No ad blockers needed.

Become an Insider
Already an Insider? Log in.

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

Want more award-winning journalism? Subscribe to Insider Plus.
  • Insider Plus {! insider.prices.plus !}*

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus ad-free web experience, select discounts to partner offerings and MIT Technology Review events

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.