It was a drab, chill day in November, and the clocks were striking thirteen. As the woman passed through Hangzhou Railway Station, she moved quickly through the ticket gates—though not quickly enough to avoid detection by the transport authority, which noticed her failure to swipe the correct transit pass. It was too late. She had received a black mark on government records that would make it harder than ever for her to travel in the future.
That’s a reimagining of the introduction to George Orwell’s dystopian novel Nineteen Eighty-Four. But it’s also set to become a reality for citizens of China if the government’s dream of an authoritarian big-data scheme comes to fruition.
The Wall Street Journal reports that the Chinese government is now testing systems that will be used to create digital records of citizens’ social and financial behavior. In turn, these will be used to create a so-called social credit score, which will determine whether individuals have access to services, from travel and education to loans and insurance cover. Some citizens—such as lawyers and journalists—will be more closely monitored.
Planning documents apparently describe the system as being created to “allow the trustworthy to roam everywhere under heaven while making it hard for the discredited to take a single step.” The Journal claims that the system will at first log “infractions such as fare cheating, jaywalking and violating family-planning rules” but will be expanded in the future—potentially even to Internet activity.
Some aspects of the system are already in testing, but there are some challenges to implementing such a far-reaching apparatus. It’s difficult to centralize all that data, check it for accuracy, and process it, for example—let alone feed it back into the system to control everyday life. And China has data from 1.4 billion people to handle.
As the Financial Times reported earlier this year, it’s not currently well-equipped to do so. Speaking about the nation’s attempts to probe citizen data to measure creditworthiness, Wang Zhicheng of Peking University’s Guanghua School of Management told the newspaper, “China has a long way to go before it actually assigns everyone a score. If it wants to do that, it needs to work on the accuracy of the data. At the moment it’s ‘garbage in, garbage out.’”
Not that such issues are likely to stop officials from pursuing such a goal. The nation’s citizens already have to deal with strict Internet censorship, and Jack Ma, the founder of Chinese e-commerce site Alibaba, recently called on the government to use sweeping data analysis to identify criminals.
If China can work out how to corral its data across government departments, cities, and districts, the scoring system will simply be another Big Brother tactic in the nation’s increasingly totalitarian approach to governance.
This is the real story of the Afghan biometric databases abandoned to the Taliban
By capturing 40 pieces of data per person—from iris scans and family links to their favorite fruit—a system meant to cut fraud in the Afghan security forces may actually aid the Taliban.
The Taliban, not the West, won Afghanistan’s technological war
The US-led coalition had more firepower, more equipment, and more money. But it was the Taliban that gained most from technological progress.
The covid tech that is intimately tied to China’s surveillance state
Heat-sensing cameras and face recognition systems may help fight covid-19—but they also make us complicit in the high-tech oppression of Uyghurs.
How Amazon Ring uses domestic violence to market doorbell cameras
Partnerships with law enforcement give smart cameras to the survivors of domestic violence. But who does it really help?
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.