AN APP FOR BROWSERS WHO SPEAK ONLY IN SIGN LANGUAGE
▶ With many deaf people also unable to read, the internet has been a no-go area. But all that is changing
A friendly animated figure in a kandura pops up on a webpage and translates text into sign language for the hearing impaired.
This software to help the deaf community better understand online content could soon be widespread in the UAE.
A Jordanian company has developed a programme to be used on travel, telecommunication, restaurant, beauty, furniture and healthcare websites to guide the deaf and hard of hearing in real time.
“This helps a deaf person access websites in sign language for the first time. An avatar we created appears on the page to translate whatever text they need,” said Mahmoud Darawsheh, founder of Mind Rockets, a start-up that develops technology for the deaf community.
In the UAE, the application has recently been launched in Arabic Sign Language on the Ministry of Community Development and the Dubai Health Authority websites. When a user clicks on the symbol indicating hearing loss at the top of the page, an avatar appears on the bottom left corner of the page.
The animated character in white robes then begins translating the text into sign language when the user hovers over the words they want translated.
For a large proportion of those with impaired hearing, the internet is shut off. Many did not attend regular school and are not adept at reading. The new technology aims to bridge this gap.
Animated web interpreters will soon be available in American Sign Language. Arabic and American forms of sign language are popular in this region.
“We wanted to help them access information just like everyone else but in the mother tongue they are comfortable with,” Mr Darawsheh said.
“Our belief is that the deaf should not have to pay for this Mahmoud Darawsheh demonstrates the translation app technology. The idea is for corporations to use this to create deaf-friendly content, make their businesses accessible.
“Many deaf people cannot read and we set up this interface so they do not get further isolated.”
Not being proficient in reading limits the world of the hearing impaired, analysts said.
“This is a very important technology because the written word is not their natural language. Literacy rates are not very high among this community,” said Bedour Al Raqbani, director and founder of Kalimati Communication and Rehabilitation Centre for the Hearing Impaired in Dubai.
“They are very visual and so this could be something that
will be beneficial because it will be faster, instantaneous and help them comprehend quicker because it’s in sign language. This gives them a real choice because it respects their natural language.”
The aim is to build innovative technology to fully engage with
the hearing impaired.
Zain Telecom, an early adopter, has employed teams in call centres in Jordan to provide further technical support through video interaction.
“We believe no group or segment should be excluded, so Zain has chosen to partner
with Mind Rockets to harness its technology,” a spokesman said. “This will provide the best user support for the deaf and hard of hearing when they browse Zain Jordan’s website.”
Mind Rockets was started two years ago with mobile applications that translated spoken or
written words into American or Arabic Sign Language acted out by an animated figure. The website interpreter is the startup’s latest offering.
There are plans to tie up with film websites to load a version of the interpreter that will translate film dialogue into sign language.
Testing is taking place in Saudi Arabia on tablet computers to communicate between staff and customers in pharmacies.
A poster at the entrance or a sign on the website will let the hearing impaired know that an instant interpretation service is available.
Staff have tablets with the programme interpreting typedout questions or answers from staff into sign language for the customer, and also repeating the process in reverse.
Embedded information panels will have pre-prepared queries about allergies, patient’s age and gender to ensure the correct drug is prescribed.
“We got this idea from the deaf community because they complained they could not communicate in a pharmacy without help from a third party,” Mr Darawsheh said.
“Specific medication is required for people who are older or for a pregnant woman.
“Questions put directly to the deaf person will ensure the medicine is safe.”
If the pilot succeeds, the software could also be used as an interface in hotels and government offices.
There are plans to add Korean and British Sign Language, said Mohammed Kilany, co-founder of Mind Rockets.
“We would like to unify the community so there are fewer limitations. Our plan this year is to launch new products and services to enable further inclusion. It will help services to become deaf-friendly and further their participation in society,” he said.