Should machines learn the world as it is or as we wish it to be?
LAST week I spoke at the Times Higher Education Emerging Economies Summit in Doha in Qatar on whether machines should learn from the real world or the imagined world.
As I was preparing for this talk, I remembered the trip I took to Singapore with three of the academics of the University of Johannesburg whose names are Mkhuseli Baloyi, John Smith and Peter Jones. These are not their real names, I have used fictitious names in order to protect their identities.
When we left Singapore, at the airport, I noticed that there was no one who was assisting us to depart but a machine.
What we did was to put the pages of our passports with our pictures on the machine. There was a camera, which captured our faces and a machine-learning algorithm compared the picture in the passport with the picture captured by the camera. If the two pictures matched, then the gate automatically opened allowing the passenger to enter. If the two pictures did not match, then the person takes her/his credentials to a human entry controller. Furthermore, the machine is able to match images to the Interpol database. Machine learning is a branch of artificial intelligence that uses statistics and the mechanism of the human brain to construct an intelligent machine.
I was the first one to put my passport on the machine, and the camera captured my face. The machine-learning algorithm could not match the picture on my passport to my face so a human controller had to assist me. The second person was John, the system could match the picture on his passport. The third person was Mkhuseli and the machine-learning algorithm could not match his passport photo to the photo captured by camera and he was also denied automatic access. Then the last was Peter, and the machine allowed him to pass.
What was common between Mkhuseli and I for us to be denied access by the machine-learning algorithm? It was that we were black Africans. What was common between John and Peter for them to be given access by a machine-learning algorithm? They were of European descent. Why is this machine-learning algorithm discriminating against people of sub-saharan African descent?
It is because machine-learning algorithms that are currently in use are largely trained using data gathered in North America, Europe and Asia and not by data that is gathered in Empangeni where Mkhuseli comes from or Duthuni where I come from.
Of course, in the Singapore case – the specific data of Mkhuseli and I is now recorded. This recording means that, in future, the Singapore entry for us is likely to be fine. The point, however, remains. Why is it that more data is gathered in Tokyo or New York or London than is gathered in Lagos or Johannesburg or Kinshasa? It is because an average person in Lagos, Johannesburg and Kinshasa is poorer than an average person in Tokyo, New York and London. Companies that seek to maximise shareholder returns by maximising profit create machine-learning algorithms that are used to automate these tasks.
How do we untangle this dilemma between reality and unreality, which, respectively, leads to discrimination and fairness?
Firstly, we need to understand that technology follows the characters of its makers. If its makers create technology without regard to human safety, then it can easily become a danger to society. The first principle we should adopt as far as technology is concerned is that it should not kill or harm people.
The second principle we should adopt is that technology should not go against the principles of human rights and dignity. The third principle is that we should embed into technology our values.
A classic example to illustrate this: a self-driving car that is travelling at 120km/h and it encounters a pedestrian. If it can possibly only do two things, should it save a pedestrian and kill a passenger or should it save the passenger and kill the pedestrian?
If as a country we do not have the means to design these self-driving cars, how do we ensure that we embed our values into the cars that we import?
In conclusion we should ensure that these machine-learning algorithms are designed to be fair, unbiased and are driven by the principle of fairness rather than the principle of maximisation of profit.