Teen’s app helps blind see the world
Seventeen-year-old Anmol Tukrel’s program identifies objects and describes it to the user
Atoronto teen is hoping to change the lives of visually impaired people around the world with a new app that can identify virtually any object with the quick tap of an iPhone or iPad.
Anmol Tukrel, a17-year-old Grade12 student at Holy Trinity School in Richmond Hill, has always been fascinated with technology, particularly artificial intelligence. By the time he was in Grade 7, he was already teaching himself how to code.
Growing up, Tukrel often travelled to Pena, India, to visit his aunt who worked at the K K Eye Institute, a hospital dedicated to providing eye care for people who can’t afford it.
That experience, combined with an internship at a startup that uses computer vision to make products for advertising firms, led him to the perfect idea for a Canada-wide Science Fair project.
“I thought I could use computer vision for a more humanitarian use and help visually impaired people,” he said.
Tukrel’s iPhone app, identifi, allows users to take a photo of virtually any object, and then describes that item in great detail back to the user. People can also take photos of text and have it read back to them, in one of 27 languages.
Tukrel hopes it makes everyday tasks — like picking out the can of pop you want — easier for people who are visually impaired.
Jason Fayre, the head of accessibility and assistive technology at the Canadian National Institute for the Blind, tested out the app and, although there are similar apps on the market, gave it a rave review.
“I’m extremely impressed, especially that it was written by a Grade12 person,” he said. As a blind person himself, Fayre said iDentifi would make his life easier when trying to identify things in the kitchen.
It took Tukrel more than a year to develop the app, a process that involved months of painstaking research and enough code to fill a twoinch binder. He had initially planned on making his own convolutional neural network — computer speak for the data structure used to make a program that recognizes objects. Eventually, he opted to integrate existing programs.
Tukrel casually speaks about computer vision, convolutional neural networks and application program interfaces as though he were a university graduate of computer science — not an about-to-graduate high schooler.
“I’ve always liked technology, but as much as I like playing video games and using different apps, I wanted to be able to make them myself,” Tukrel said.
For Tukrel, the work doesn’t stop now that the science fair is over.
He has already met with various organizations to get feedback on the app and plans on making tweaks to improve the user experience. So far, the app has been downloaded by several thousand people and is being used in 60 countries. And, it’s free — something Tukrel doesn’t plan on changing.