TR Editors' blog

Facebook's Engineering Challenges Show How Fast It's Growing

More than half the data the site currently stores was added in the last year.

Erica Naone 06/23/2010

  • 1 Comment

Numbers on Facebook's exponential growth often get thrown around, but it can be hard to comprehend what those numbers mean. The site is becoming the repository for huge quantities of information about the daily lives of its users, and it can be easier to understand how significant this is when listening to company executives discuss how Facebook struggles to manage all of this information. Bobby Johnson, director of engineering at Facebook, spoke this morning at the Usenix WebApps '10 conference in Boston, where he outlined how the company handles the technical and organizational problems created by its rapid rise.

The site's 400 million users have an average of 130 friends each, and just this social graph data is tens of terabytes in size. What's more, this data has to stay accessible at all times, since it's used to respond to almost any action that a user takes. For example, when a user logs in, data about that person's social connections is used to figure out what information to display in the user's news feed (the first screen shown after login).

On top of keeping track of users' connections to each other, Facebook has increasingly become the archive for users' personal memories. The site has long been the largest photo-sharing site on the Web, and virtual photo albums have in many cases replaced the paper albums that used to sit on people's shelves.

But while the accumulation of photos and videos may become an issue for the site in the long run, Johnson says that for now the main issue is dealing with new data. More than half of the data currently on the site was added this year, he says. Facebook plans never to delete old data, but even if they did, Johnson notes that it would do little to relieve the challenge of storing the flood of new data.

The company obviously takes the responsibility of storing all this data seriously--it routinely replicates information at least three times to ensure it is safe from hardware failure and bugs. It's stunning, however, to contemplate how large a responsibility the company has for information belonging to a growing number of people around the world.

Will Spotify Be Fair to Artists?

Daniel Ek dodged the question during a keynote interview at South By Southwest Interactive.

Erica Naone 03/16/2010

Here at South By Southwest Interactive, the keynote interview of Daniel Ek, the 26-year-old founder of European music service Spotify, provided some satisfying insight into the major new music site.

Spotify has built a lovely music application that uses a peer-to-peer architecture to stream music at lightning speeds (a real improvement over the sometimes spotty service that comes with many other music streaming applications). The site is only licensed in Europe, but Ek says the site has 7 million users in 6 countries, and he's been working hard to get it licensed in the United States. Users can listen to music for free, with ads, or can pay for a subscription that grants access to perks such as the Spotify mobile app, and song downloads.

I couldn't help noticing, however, Ek's artful dodge to the question of how artists are paid by his service. The subject was broached by an audience member, who identified himself as an independent musician and thanked Ek profusely for the great application. He wanted to know how much he would be paid.

"It's complicated," was, in essence, Ek's reply. But he did reveal that it's a revenue sharing model; artists get paid a proportion of whatever Spotify gets paid, presumably based on the number of plays on the site they receive.

Ek's reply was disappointing because this is the million dollar question for many music sites. Pandora's been on the verge of going under for years in part because they've paid artists even when they couldn't afford to. It's clever of Spotify to find a way to be cash-positive where other sites have failed, but it means the artists must wait to be paid a fair rate.

There see other problems too. For example, pop stars are likely to draw the highest proportion of plays, but how does that relate to which fans pay a subscription fee? It seems that part of what Spotify will need to figure out is what brings money to the site and how to reimburse artists fairly.

Google's New Photo Editor

Web app Picnik may be integrated with Picasa.

Erica Naone 03/01/2010

  • 2 Comments

Google announced today that it has acquired Picnik, a company that provides a fully-featured Web-based photo editing application. This is the latest in a recent string of acquisitions that has also seen Google snap up the social search site Aardvark.

Picnik is a flash-based photo editor capable of real-time cropping, resizing, rotating, special effects, and other manipulations. It can pull photos from websites including Picasa, Flickr, Facebook, and MySpace, or from a user's computer. The basic service is free, but the site offers a more sophisticated service for about $25 a year.

Google most likely wants to beef up its online photo-sharing service, Picasa, which currently has fairly minimal photo editing capabilities. It says it's not changing Picnik yet, but will be working on "integration and new features."

Other online photo editors include Photoshop.com, Aviary, and FotoFlexer.

About

Insights, opinions, and our editors' analysis of the latest in emerging technologies.

Subscribe to the TR Editors' blog RSS Feed

Advertisement
Advertisement

Facebook

Advertisement