San Francisco Chronicle

In better virtual world, the eyes might have it

San Francisco startup shows its vision for a different method of controllin­g movement

-

TOKYO — No more fiddling with remote- controller buttons or a mouse. Just look. San Francisco startup Fove has developed eye- tracking for virtual reality — that kernel of technology many feel is key for the illusion of becoming immersed in a setting.

Glance, and a video game character talks back. Or use a death stare to shoot down virtual spaceships. Watch a movie of a forest or a room and be able to look around wherever you want.

“It allows you to go inside the world that’s behind the display,” said Yuka Kojima, Fove’s co- founder and a rare female CEO in male- dominated Japan.

Fove, which comes from “fovea,” the part of the eye with the sharpest vision, from “field of view,” and the word’s similarity with “love,” has devised a way to use tiny infrared sensors inside headset goggles to monitor the movements of a wearer’s pupils.

It’s a small company, founded in 2014, with offices in San Francisco, Los Angeles and Tokyo, and employing just 17 people. But Fove is getting attention from the fledgling virtual reality industry, and winning backing from innovative financiers. It has raised about $ 500,000 through Kickstarte­r.

Virtual reality could revolution­ize entertainm­ent, like movies, games and live- streaming of sports. It has myriad potential business applicatio­ns, such as giving apartment hunters a virtual look at real estate options and car buyers tours of virtual showrooms.

It could also prove useful for training of pilots and surgeons, and has already been adopted by the military. The makebeliev­e experience could aid in “empathy training” for police and other service providers. Pornograph­y is another potentiall­y lucrative applicatio­n.

A recent report by New York’s Superdata, which analyzes data on games, said smaller companies could become “first- movers,” as establishe­d players

keep a wait- and- see attitude.

Rahat Ahmed, cofounder and chief of strategy at Trinity VR, an investor in technology and emerging markets, says the big plus of virtual reality is “intuitive interactio­n.”

“Every major company has to have a VR- AR strategy,” Ahmed said at a recent investor forum in Tokyo. AR is augmented reality, which enables users to see three- dimensiona­l objects in the real world, while virtual reality delivers a 360- degree fictional universe.

“It allows connecting — going fishing with your father who is far away.”

New technology usually has its share of detractors, and there are worries that virtual reality could have harmful effects if users become too immersed in their fantasy environmen­ts and estranged from reality.

But Fove developers say it can play a positive role.

In one poignant demonstrat­ion, a bedridden grandmothe­r wears a Fove headset to “attend” her grandson’s wedding, sending a humanshape­d robot controlled by her eyes in her place. The woman gestures happily, reaching out from her bed as if the newlyweds are standing before her.

Eye- tracking can enable disabled people to use their eyes to control devices, says Kojima’s co- founder at Fove, Australian Lochlainn Wilson. He developed Fove’s breakthrou­gh technology for eye- tracking.

With the help of Fove and a Japanese university, for example, a young man with spinal muscular atrophy, an illness that has weakened his arms and fingers, used eye movements to play a piano.

“We want to do things with VR that people haven’t thought about, or have thought to be impossible,” said Wilson, who met Kojima while she was studying English for four months in Australia. “And we have got other secret projects in the future.”

Fove has potential rivals, such as Sony Corp. and Facebook’s Oculus, which this month will begin shipping the consumer version of its Rift virtual reality headset for $ 600, plus $ 1,500 for an “Oculusread­y” computer.

Oculus says it is working on eye- tracking for its headsets, and other companies, including Eyefluence Inc. of Milpitas, have also developed the technology.

Microsoft Corp. will soon have a developer version of its augmented reality device, HoloLens, for $ 3,000.

Fove’s headset for game and other content developers will become available this year for about $ 500 — though for the headset to work well, you need a PC costing $ 1,000 or more.

The company plans to make 1,200 such headset kits, but Kojima says Fove could boost production to as many as 1 million headsets if she clinches a deal to supply them to Internet cafes. Fove also is offering to license the technology to other companies.

Fove’s eye- tracking technique is convincing: In one recent demonstrat­ion, a headset wearer watched a computergr­aphic figure holding a machine gun slowly approach, evoking a sense of menace.

Looking at the space behind the figure, the background came into more vivid focus and the figure in front dimmed bit, enhancing the illusion of perspectiv­e.

Kojima, who is also a filmmaker, became interested in storytelli­ng when she was studying at Tokyo’s prestigiou­s Ochanomizu University. Later, while working as a game producer at Sony Computer Entertainm­ent, she began to wonder why games allowed only “yes” or “no” choices, when stories usually called for more subtlety.

Fove, she believes, can fix that by making the interactio­n more intuitive.

“It should feel more like the way we are facing each other now, laughing, making eye contact, a nonverbal form of communicat­ion,” said Kojima. “Nuances should be part of storytelli­ng. It should be natural.”

 ?? Photos by Shizuo Kambayashi / Associated Press ?? Fove co- founder and CEO Yuka Kojima holds eye- tracking headset goggles as she speaks during an interview at her office in Tokyo. San Francisco startup Fove hopes the technology will be crucial for virtual reality.Yuka Kojima, Fove’s co- founder and CEO “It allows you to go inside the world that’s behind the display.”
Photos by Shizuo Kambayashi / Associated Press Fove co- founder and CEO Yuka Kojima holds eye- tracking headset goggles as she speaks during an interview at her office in Tokyo. San Francisco startup Fove hopes the technology will be crucial for virtual reality.Yuka Kojima, Fove’s co- founder and CEO “It allows you to go inside the world that’s behind the display.”
 ??  ?? A Fove’s employee uses the goggles, which have tiny infrared sensors that monitor the movements of a wearer’s pupils.
A Fove’s employee uses the goggles, which have tiny infrared sensors that monitor the movements of a wearer’s pupils.
 ?? Shizuo Kambayashi / Associated Press ?? Fove CEO Yuka Kojima talks with her co- founder, Australian Lochlainn Wilson, at the company’s office in Tokyo. The San Francisco startup also has an office in Los Angeles.
Shizuo Kambayashi / Associated Press Fove CEO Yuka Kojima talks with her co- founder, Australian Lochlainn Wilson, at the company’s office in Tokyo. The San Francisco startup also has an office in Los Angeles.

Newspapers in English

Newspapers from United States