Let big data flow: Removing needless barriers helps all prosper
Using aggregated information boosts well-being of citizens and companies
More information is being collected by more people about more things than ever before. Combine that data with easily available and cheap computing power, and you revolutionize our economy and society.
The best example I’ve seen of the power of big data comes from the 2009 H1N1 flu virus. The U.S. Centers for Disease Control (CDC) was trying to measure the disease’s spread by asking doctors to report flu symptoms in their patients. Unfortunately, it took two weeks for the data to reach the CDC. When a disease is spreading fast and you need to respond today, two-week old data is useless.
Internet search engine Google found a different way to get the information instantaneously. Instead of asking experts to gather and submit data, Google looked at how many people were searching the Internet for information about flu symptoms. As Google’s website notes, “We have found a close relationship between how many people search for flu-related topics and how many people actually have flu symptoms. Of course, not every person who searches for ‘flu’ is actually sick, but a pattern emerges when all the flu-related search queries are added together.”
In other words, a faster but highly accurate system of pinpointing the disease’s spread was made possible by a huge number of data points (queries about flu) and the computing power that was able to correlate that data with location and other relevant information.
Increasingly vast amounts of data are being collected by people who do not know what value might be wrung from it. Canadian gold-miner Goldcorp Inc. famously put online huge amounts of geological data about its mining sites and asked people to compete for prizes by interpreting what this vast data was telling them about where to look for gold. The results were spectacular.
Big data is also transforming how we drive, too. Listening to somebody in a helicopter hopping between a few traffic hot spots is passé. Increasingly, mobile phones equipped with GPS are able to generate real-time pictures of traffic density and flow, with the information about the overall pattern (and faster alternative routes) being fed back to the individual phones that supplied the data in the first place.
Big data generated by things such as credit card purchases and web searches for products are able to tailor marketing pitches to individual consumers based on purchases they’ve already made. But beyond that, it is increasingly possible to create virtual markets and economies in which new ideas and products can be tested to see what their chances of success are in the real world — lowering costs and reducing needless advertising and promotions.
In other words, big data is going to be a major driver of economic growth. According to one estimate, there will be 4.4 million big data jobs worldwide by 2015, and McKinsey, a global consultancy, says big data-driven companies are markedly more profitable than their Luddite peers.
But for us to get the benefits of big data, we have to keep our legal and regulatory regime supple, balancing competing values such as privacy, free expression, competition and security, as a paper for my institute argued recently. For instance, countries whose privacy laws allow the collection and analysis of data that cause no demonstrable harm to the people who created the data (think Internet search terms, traffic and weather patterns, even some health data) won’t just enjoy more economic opportunity. They’ll also learn invaluable information about themselves.
If Canada’s ridiculously unbalanced and burdensome new anti-spam regime is a harbinger of our future regulatory approach to data exchange issues, however, Canada can expect a mere fraction of the opportunity and the insight big data promises. The data-driven economy is evolving unpredictably and at lightning speed. The law should limit itself to protecting us from real and demonstrable harms. Otherwise, let that data flow.