Technology Review - Published By MIT
Advertisement

Behind the Big Apple's Data Dump

NYC releases a wealth of data--but with a positive spin.

By David Talbot

Wednesday, October 07, 2009

smaller text tool iconmedium text tool iconlarger text tool icon

Becoming the latest municipality to fling open stores of data, New York City yesterday released 194 datasets--on everything from restaurant inspections and property sales to traffic data and the locations of laundry facilities. The city also launched a $20,000 competition to develop software applications using this data.

Big app: Days before yesterday’s release of data, New York City created an iPhone app to enable people to obtain local information and report problems.
Credit: New York City

While this may well be the largest release of public data to date by a U.S. city, it still represents a limited opening of the tap--one that doesn't illuminate governmental budget processes or many negative aspects of city life, such as crime or inferior city services.

A search of the new data site, which went live yesterday afternoon, found no datasets associated with the keywords "crime," "potholes," "homeless," or "campaign contributions." In the geographical datasets (which represent 93 of the total), the word "fire" produces data showing the location of police and fire stations, but no information about actual fires in the city. Even the word "budget" produced only one hit--a dataset on the city's adopted budgets. In contrast, Washington, DC, has released performance-tracking and accountability metrics for how capital projects and other programs are faring. The data does, however, include health-department inspection reports of restaurants.

But if you want to know anything about New York City "parks," you'll hit the jackpot: 25 separate directories on things like barbecuing sites, handball courts, dog runs, and sidewalk cafes.

Story continues below

"Hopefully what they've done is a first step toward the city making all government data, except that which poses a security or privacy concern, available," says Andrew Rasiej, founder of the Personal Democracy Forum, which tracks the intersection of technology, government, and politics. (Rasiej was also a 2005 candidate for New York City Public Advocate.) "Washington, DC, is way ahead of New York, but the reality is that it's significant that New York City has finally come to the party and recognized that open data is the future of civic engagement."

However, he added: "The three most important things people want to know--how to be safe, where my money is being spent, and how the children of our city are doing--are not there. Ten years from now, every city will be doing this by rote. What are we waiting for in New York?"

Comments

  • [no subject]
    Nice post and Its also provide good knowledge regarding the new technology so people can aware of it.
    Thanks for sharing
    Rate this comment: 12345

      neilkevin0...
    10/09/2009
    Posts:3
    Avg Rating:
    2/5
  • Proprietary formats
    The article doesn't mention the data files are frequently provided in proprietary formats, e.g. XLS, MBD, SAS.  Too bad the city, having gone to all the effort of creating the website and publishing the data, didn't adopt a standard, vendor-neutral format (tab-delimited UTF-8 text would be fine) and a standard format to document the data items.  Or, indeed, any documentation at all. 
    Rate this comment: 12345

    jklowden
    11/15/2009
    Posts:1

Log In

Forgot your password?     Register »
Advertisement
Advertisement
Advertisement
Subscribe to Technology Review's daily e-mail update. Enter your e-mail address

TECHNOLOGY RESOURCES
Advertisement
MIT Massachusetts Institute of Technology © 2009 Technology Review. All Rights Reserved.