Killer robots, but with ethics
The Australian Defence Force is set to spend more than A$5 million (NZ$5.2m) to develop battlefield robots which have a sense of morality.
It’s commissioned the University of New South Wales in Canberra and the University of Queensland to find ways to make machines behave in an ethical way in wartime.
The universities will spend an additional A$3.5m in what would be world-leading research.
Robots are increasingly being used by the military but there is a fear that, because they have no sense of right and wrong, they might commit atrocities when left to their own devices.
The idea is to identify what humans believe to be right and wrong and then program that into machines so they behave in the way humans would want them to.
If a human would not shoot at schoolchildren crossing a market square, the researchers want to find a way of getting robot soldiers to hold their fire in the same way.
It might be possible, for example, to teach killer robots to identify a Red Cross symbol on a vehicle and decide not to shoot at it.
A team of ethicists and engineers is being assembled at UNSW’s Canberra campus to work out technical ways of embedding human morality into machines. The work will involve surveying members of the public and the military to see what they think is acceptable behaviour.
The work is being led by Dr Jai Galliott, who has a background both as a philosopher and as a military man in the Royal Australian Navy. The money is being channelled through Australia’s Defence Co-operative Research Centre.
Many ethical dilemmas tax philosophers when they think about war, particularly the question of how many collateral deaths may be acceptable to destroy an important military target.
Galliott cited a case where two Nato rockets hit a train packed with civilians as it crossed a targeted bridge in Serbia in 1999. The rockets had no sense of right or wrong, and so didn’t abort the attack with the sudden appearance of civilians on the target – even if the technology had allowed them to do so.
Galliott said there might be a way to program the missiles of the future to recognise large, moving civilian objects and not hit them if they suddenly come into view.
There are two parts to the problem: working out what is right and wrong on a battlefield and, secondly, finding ways of putting that into machines.
Accordingly, the work will involve philosophers as well as computer coders and engineers.
The engineers would develop technologies like pattern recognition, so that war robots could recognise shapes and movements to better identify targets and non-targets.
The other side is the human element.
‘‘The idea is to figure out when a human would say ‘stop’, and build that into the system,’’ Galliott said.
As artificial intelligence develops, there have been increasingly loud concerns from some of the world’s leading scientists about its potential implications.
Might a machine become so intelligent it could override its human designer?
In the past, this was a question for the world of science fiction. Think of the movie Robocop ,in which a company develops a heavily armed robot police officer which (spoiler alert) turns on its board of directors in the final scene.
That world is now much nearer. There are already robot sentries on the border between North and South Korea, for example. Their full automation has been turned
off, according to the South Korean Government, to prevent them hitting innocent, non-threatening people. Their guns can only be triggered by human soldiers.
But there are many ‘‘lethal autonomous weapons’’ which can independently search and engage targets – albeit, usually, with a human pulling the trigger (whether on a battlefield or from a monitor in, for example, Nevada).
As technology moves, the human element may become less necessary. Robots are becoming more autonomous – more intelligent.
The task of the researchers is to program in more constraints to stop tragedies happening.
The Australian Defence Force is now at the forefront of developing that technology.
–