We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not a subscriber? Subscribe now for unlimited access to online articles.

Emerging Technology from the arXiv

A View from Emerging Technology from the arXiv

How Particle Physics Is Improving Recommendation Engines

The same physics that governs the behaviour of photons and electrons may also improve online shopping recommendations, say researchers

  • January 15, 2013

Most online shoppers will be familiar with phrases of the type “You liked X, so you might like Y” that are generated by the current crop of recommendation engines.  These play an increasingly important role for online retailers since they can increase sales by significant amounts.

And yet the actual recommendations can seem somewhat haphazard so there is no shortage of groups studying ways to improve them.

Today, Stanislao Gualdi at the University of Fribourg in Switzerland and a couple of pals say they’ve found a surprising new twist in this black art that increases the accuracy of these systems.

These guys begin by considering items that are adversely affected when too many people use them. For example, recommending a beach or a picnic spot because it is quiet can end up destroying the peace that gives it value. Similarly, restaurant recommendations can lead to overcrowding or difficulty getting a table which again makes the dining experience unpleasant. 

So Gualdi and co ask how to deal with recommendations for objects whose value diminishes with the number of people who use it. And their conclusions are surprising and counterintuitive. They say that this approach not only works well in these unusual circumstances but also improves conventional recommendations for objects or resources that are not in limited supply.

The approach these guys take is based on thinking used in particle physics, where particles tend to occupy the most energetically favourable states. If the particles are bosons, such as photons, there is no limit to the number that can occupy a given state.

But if they are fermions, like electrons, their physical properties dictate that no two can occupy the same state. Clearly the resulting distribution of these different types of particles is entirely different.The analogy here is with goods that any number of people can share or that only one person can have.

Gualdi and co’s use this physics-based approach to explore the space between these extremes where a single object/state can be shared with a relatively small number of users/particles.  In a sense, their model simulates a way to avoid crowds in restaurants, for example, while allowing small groups to dine.

These guys test the model on empirical data from DVD renting. They note that DVDs are not usually oversubscribed but say their approach produces surprising results. “We show that including crowd avoidance in the recommendation process can increase the accuracy of the recommendation,” they say.

The reason is subtle. They argue that by limiting the number of people who can have a single DVD, they remove biases that can emerge when an unlimited number of people have access.

This approach has other benefits too.  Preventing oversubscription ensures that the population of users sample a wider range of DVDs, which in turn provides a broader range of recommendations. This keeps the entire recommendation ecosystem healthy, say Gualdi and co.

That’s an interesting approach but one that is likely to need some significant real world testing and fine tuning. Retailers are not just interested in renting DVDs or selling books or whatever. They want to maximise profits.

So the idea of limiting the number of people who can rent the latest Hollywood blockbuster or buy the next Harry Potter on the day they are released may not be easy to swallow. Unless, of course, Gualdi and co can come up with good evidence that playing this game is more profitable in the long run.

But for and adventurous retailer, it might just be worth trying.

Ref: arxiv.org/abs/1301.1887Crowd Avoidance and Diversity in Socio-Economic Systems and Recommendation

Learn from the humans leading the way in Connectivity at EmTech Next. Register Today!
June 11-12, 2019
Cambridge, MA

Register now
More from Connectivity

What it means to be constantly connected with each other and vast sources of information.

Want more award-winning journalism? Subscribe to Print Subscription.
  • Print Subscription {! insider.prices.print_only !}*

    {! insider.display.menuOptionsLabel !}

    Six print issues per year plus The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Print magazine (6 bi-monthly issues)

    The Download: newsletter delivery each weekday to your inbox

You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.