Daily Mail

Talking glasses that can read books and even recognise faces

- By VINCENT GRAFF

YOU might think it sounds like something from a joke shop: a pair of spectacles that talk to you. in fact, this clever gadget called OrCam is deadly serious. it has recently launched in this country and is aimed at the estimated 1.8 million people who are partially sighted and who, in order to read, normally rely on Braille, talking books or powerful magnifying glasses that can show only a few words at a time.

although i don’t fall into this category (i am long- sighted but can read with my glasses on), i spent a few days putting the technology to the test.

in essence, the device is very simple. a camera, smaller than the lid of a pen, fixes on to the corner of your glasses. this camera is attached by a wire to a black box in your pocket, which contains a computer, and a small speaker that perches next to your ear and ‘talks’ to you.

then the magic begins. the camera has been programmed to recognise when you point your index finger at some printed text. So, if you want to read a paperback, you simply touch the first word with your finger. the device then makes a beeping noise, takes a photograph of the page and, suddenly, a friendly male voice — not quite as polished as a Radio 4 announcer, but a vast improvemen­t on Stephen Hawking’s metallic delivery — begins reading the book out loud.

CeRtainly, if you’ve never been able to pick up a book and just read it, it’s a life-changing moment. in fact, OrCam doesn’t just read books. Using a technology called optical character recognitio­n (basically, it scans printed text and converts it into spoken words), it’ll talk its way through restaurant menus, newspapers, even street signs — though it stops at being able to read handwritin­g.

a more sophistica­ted version will also recognise people and packets of food for you.

OrCam was invented in 2010 by two israeli scientists who had previously worked in the car industry, developing cameras that detect pedestrian­s or other cars.

Since then, more than 2,000 of these devices have been sold worldwide and, according to the manufactur­ers, ‘ a few hundred’ have now sold here, following its launch in Britain in May.

But neither is cheap — the basic model, MyReader, sells for £1,600 while the more powerful version, o Myeye, costs £2,200 (both can be bought from the company’s website orcam. com: they are not available on the nHS). i tried out the more expensive model. if users of OrCam don’t already wear glasses, when they wear the device they’ll need a ‘dummy’ pair of spectacles with clear glass, so that the camera has something to attach to.

in my case, i swapped my own spectacles for clear glass ones, so that i wouldn’t be able to read a word — normally, i am dependent on my glasses. and once, i had the device in place, i barely noticed it was there.

So, how well does OrCam work? in my experience, very well — most of the time. Show it a paperback book and it reads it perfectly every time. every time you turn the page, you point at the first line and OrCam begins reading again.

OrCam also copes well when it is shown words in rather more exotic locations: a restaurant menu on a chalkboard, for example. and the intonation is much better than i’d expected. it reads the book to you in easy-to-understand human sentences. Rather. than. Just. Speaking. Words. at. you.

this isn’t to say it gets everything right first time. newspapers, for instance, can be a challenge. it’s only when you use a device such as this that you realise how clever our eyes and brains are.

For example, as you read this article, you will know to follow the words down to the bottom of one column and then to jump up to the top of the next one (rather than reading all the words horizontal­ly across the page). amazingly, OrCam knows this, too.

But my experience is that it sometimes struggles with headlines — especially if they run across the top of two pages. (For example, it translated ‘£73 Cost of Paying For your Car Premium Monthly’ into the short and meaningles­s ‘973 cost’.)

Humans make allowances for this. Computers do not. at least, not yet. My OrCam, though, did very well at recognisin­g faces, spotting when my wife came into the room every time.

to use this feature, you take pictures of your friends’ and relatives’ faces and record your voice announcing their names. OrCam then stores the images and, with the help of facial recognitio­n software, announces the person’s name back to you whenever they come within its sight.

it’ll do the same trick for food products. you show it what a packets of Weetabix looks like and, the next time you’re in the supermarke­t, it’ll make sure you don’t accidental­ly go home with a packet of Corn Flakes.

this is very useful, as most brands’ logos are not written in ‘ordinary’ type, but in decorative lettering that the MyReader would not be able to decipher.

the beauty of the device is that it opens up every book ever published to partially sighted people — the number of books that have been translated into Braille is relatively small.

Robin Spinks, senior strategy manager at the Royal national institute of Blind People and a spokesman for the charity, is an expert on technology designed for blind people. Robin, 43, was born with a condition called albinism, which causes him to have just 10 per cent vision — thus making him unable to read beyond the first line of an optician’s chart.

Robin has also tried out OrCam and is ‘hugely excited’ by it. ‘Very quickly, you’re aware that a barrier has been lowered,’ he says. ‘and that’s quite powerful.’

One day, Robin went into a bookshop for a leisurely browse — the first time in his life he’s done this. ‘i was able to discreetly go in and read extracts from seven or eight different books. that was pretty cool.’

He dOeS, however, think that the device won’t be much use for someone with no vision at all. you need to have enough sight to know where the words are, so that you can point the camera in the right direction.

‘like any consumer technology, the device isn’t perfect,’ he adds. ‘But it neverthele­ss represents a great example of technology that boosts independen­ce and discovery. Being able to walk around independen­tly and read street signs and menus offers the wearer a greater sense of freedom.’

in the future, no one doubts that technology such as this will get much cheaper. and, as Robin says, ‘it’s easy to imagine a future version of the device that is even more discreet and without cables’.

‘the real excitement isn’t about what it’s possible to do now,’ he adds, ‘it’s about where this technology can ultimately go.’

 ?? N A M S R O H A J N O S : e r u t c i P ?? Impressed: Vincent Graff tries the OrCam MyEye
N A M S R O H A J N O S : e r u t c i P Impressed: Vincent Graff tries the OrCam MyEye

Newspapers in English

Newspapers from United Kingdom