Handing over your keys to Big Brother
Driverless cars offer new forms of control — no wonder governments are keen, reports Neil McBride, a reader in IT management at De Montfort University.
IMAGINE a stateoftheart driverless car is zipping along a road with a disabled 90yearoldpassenger. A young mother with a toddler steps into the road. The car must make a decision: drive into the mother and child and kill them, or hit a wall and kill the passenger.
This is a variation of the trolley problem, which dominates academic and popular thinking about the ethics of driverless cars. The problem is that such debates not only dismiss the complexity of the system in which driverless cars will exist, but are really moral red herrings. The real ethical issues lie in the politics and power concerns with driverless cars.
Governments across the world are taking a deep interest in driverless cars. The German Government has produced ethical guidelines for driverless cars. The UK Government has promised driverless cars on the road by 2021, and the Russian Government by the end of 2018. China has ambitious plans to connect driverless cars to the internet and install sensors in roads and traffic lights by 2025.
Most revealing is the way driverless cars feature in the EU’s white paper on the future of Europe in 2025, published in March 2017. They form a telling part of a snapshot of how Europe might look in a future where EU countries have effectively joined to become one federal superstate. In this scenario, the white paper says, driverless cars will flourish, flitting unhindered across borders from city to city.
There is a reason why governments are so keen on driverless cars — and it is not just because of the potential economic benefits. They offer the chance for even greater tracking and control of citizens’ every move. Far from setting us free, driverless cars threaten to enable new forms of surveillance and oppression.
A driverless car is a computer on wheels, the ultimate internetconnected mobile device. Bristling with sensors, it provides a constant twoway flow of information. The car sends information about its performance to the manufacturer. It receives software updates and signals to adjust its behaviour. The manufacturer knows where the car is, what the road conditions and temperature are and how the vehicle is performing at a particular speed.
The car’s insurer may receive minutebyminute information about the car’s state, location, speed and the condition of the road. and could vary the insurance accordingly. It could even give 10 minutes’ warning of loss of cover and halt the car.
Meanwhile, government databases will also be likely to know where the car is, whether it is meant to be there and where it is going. And even, using predictive analytics, where it will go for its next journey. Smart motorways will manage flows of traffic, slowing down driverless cars as part of a stream of communication between the car and the road. In smart cities, traffic lights will reroute cars into detours according to calculations about traffic jams, road works, or state requirements.
Markets in fast routes through cities and to central destinations may be created. Companies may pay for employees to use priority virtual routes. Travel logs may make it quite clear where you have gone and when. Reasons for your journey may be inferred from the landscape, destinations and timing.
For more than 130 years, cars have represented the ultimate in autonomy, individuality and democratic freedom. Our car trips are private and anonymous. We can go where we like and when we like. without having to tell anybody. And we retain responsibility for whether we obey the law. Driverless cars will bring that to an end.
Now manufacturers, governments and city authorities will know where we are going, what we are doing and when. If anyone does not like what we are doing, they will be able to stop us, withdraw technical and accident cover, stop us using particular roads or streets, or just shut us down. It will not be the car that is autonomous but the authorities and systems that run and maintain that car, that draw and send information to and from the car.
In the rhetoric of making us safer and reducing risk, power will be taken away and delivered to central authorities. To render us safe, governments will leave us powerless.
Now the controllers can simply change our route for their own purposes, whether to prevent traffic jams or to clear a route for a dignitary. Now they can send us to particular shops, or directly to a police station. Now the controllers can manage populations of cars to meet the purposes of the council or government.
In a democratic state, the growing flow of personalised information towards centralised authority will provides the basis for regulation and enforcement. Its new managed citizens will be the target for behavioural nudges and advertising flowing into the driverless car. In the dictatorial state, the authorities can stop you going to a demonstration, or to church.
And such centrally managed systems, which will be essential for the safety of driverless cars, are not only open to the inevitable technology failures of complex systems, but also to hacking and attacks by other states and individuals. Why hack into one car, when you can hack into a whole city system and bring traffic to a halt, or crash 30,000 cars into each other?
In reflecting on the ethics of driverless cars we need to address the concepts of autonomy, community, transparency, identity, value and empathy. Our debate has to address the power shifts, the political responsibilities and the human rights that our vision of driverless cars may require to be sacrificed.