Agencies to front up on computer-based profiling
The department later denied it was engaged in racial profiling but has not responded to an Official Information Act request seeking clarification on seemingly conflicting information it gave on whether, why and how it was using data about people’s race and gender in deportation decisions.
The Corrections Department has used computer algorithms to help parole boards assess the likelihood of prisoners reoffending.
Algorithms are mathematical formula used to express and forecast relationships between data.
The Ministry of Social Development (MSD) conducted an experiment in 2015 to see if it could use algorithms to better identify children at risk of abuse, before that trial was canned by then-minister Anne Tolley.
However, ministers are not necessarily aware of how agencies are using algorithms for profiling, with Immigration NZ’S possible profiling and the MSD trial only coming to ministers’ attention after the fact.
Curran said the first stage of the stocktake would be completed by August and overseen by government chief information officer Colin Macdonald and chief data steward Liz Macpherson. A spokeswoman said those findings would be made public.
A new privacy law that is due to come into effect in Europe today, called the General Data Protection Regulation, will give Europeans the right to an explanation when an automated decisions are made about them.
The new regulation also gives people the right to have a human involved in any ‘‘significant’’ decision affecting them, unless suitable legal safeguards exist.
Curran is leading a project by the D7 group of digitally advanced nations that could see Kiwis get similar rights.
Otago University Professor Colin Gavaghan, who is assisting the Government in that work, has cautioned that in order for such safeguards to be effective, people needed to know algorithms were being used in decisions affecting them in the first place.
Curran said that as well as increasing ‘‘transparency’’, the stocktake would pave the way for guidelines to help ensure government agencies employed ‘‘consistent standards’’.
Shaw said using existing data to model possible outcomes was an ‘‘important part of modern government decision-making’’ that could make a positive difference for New Zealanders.
‘‘But there are challenges as well and we need to ensure that transparency and procedural fairness are maintained,’’ he said.