Otago Daily Times

Videocalli­ng device developed at uni potentiall­y groundbrea­king

- HAMISH MACLEAN hamish.maclean@odt.co.nz

A POSSIBLE breakthrou­gh in video calling has been developed at the University of Otago.

As an informatio­n science PhD student in Dunedin, Jacob Young developed a prototype device, and a new way to talk to people over a video call which overcomes limitation­s of current video calling.

Dr Young, now a postdoctor­al research fellow at the Computatio­nal Media Innovation Centre at Victoria University of Wellington, created a prototype where a 360degree camera strapped to the back of a phone creates a 3D model of the room a caller is in.

The model that was created over the course of the call allowed another user to virtually move around the room the other caller was in, creating a more immersive, collaborat­ive experience, Dr Young said.

Originally from Gore, Dr Young spent seven years in Dunedin before defending his PhD in July.

The prototype he developed over his time in the city, nicknamed ‘‘mobileport­ation’’, has been said to potentiall­y be the next step in virtual communicat­ion.

The prototype developed at the university was not ready for the market, but he believed in the work’s potential, Dr Young said.

‘‘It’s really about making prototypes for a purpose.

‘‘It’s partly just making cool stuff, because everyone wants to do that, but it’s also what can you do with that cool stuff?

‘‘What kind of experience­s can I enable with that cool stuff?’’

While showing another person around a flat with current videocalli­ng apps, for example, the viewer is restricted to seeing what the other user shows them.

But with Dr Young’s prototype device, the 360degree camera mounted on the back creates a model of the room the speaker is in.

And the viewer they are talking to can move their phone to control what they see.

Rather than engaging only in facetoface communicat­ion, or seeing what the other person points their camera at, the person on the other end of the call can see the person they are having a conversati­on with, or can choose to look around the 3D model of the room, or other rooms, the other user’s phone has made during the call.

In September Dr Young presented his work to about 1000 leading internatio­nal researcher­s, designers, developers and practition­ers at UbiComp.

The major conference, sponsored by Google, Microsoft, Intel and others, brings people together to discuss new ideas and results in the field of computer science.

This year’s conference was originally planned for Cancun, Mexico, but was instead held virtually.

Associate Prof Tobias Langlotz, of the University of Otago department of informatio­n science, said the university would continue to develop the project with a ‘‘slightly different spin’’.

There was much potential for the prototype to be used to create virtual tourism, he said.

The idea would be to take people with you virtually on a hike or travel in New Zealand to give them the feeling they were along for the trip, he said.

Work was also required to increase the fidelity of the components.

But ‘‘in the not too far future’’ video calls and video conference­s would be conducted with panoramic cameras or 3D cameras in the same way as the university’s prototype, he said.

 ??  ?? ‘‘Mobileport­ation’’ mode . . . Dr Jacob Young tests his prototype ‘‘mobileport­ation’’ device.
‘‘Mobileport­ation’’ mode . . . Dr Jacob Young tests his prototype ‘‘mobileport­ation’’ device.
 ??  ?? Dr Jacob Young tests his prototype.
Dr Jacob Young tests his prototype.
 ?? PHOTOS: SUPPLIED ?? Picture this . . . Dr Jacob Young has developed a more interactiv­e videocalli­ng device at the University of Otago.
PHOTOS: SUPPLIED Picture this . . . Dr Jacob Young has developed a more interactiv­e videocalli­ng device at the University of Otago.
 ??  ?? Testing time . . . University of Otago research assistant Rosa Lutz tests the prototype.
Testing time . . . University of Otago research assistant Rosa Lutz tests the prototype.
 ??  ?? Now you see it . . . Dr Jacob Young’s Dunedin flat provides an example of the 3D reconstruc­tion used in his ‘‘mobileport­ation’’ device.
Now you see it . . . Dr Jacob Young’s Dunedin flat provides an example of the 3D reconstruc­tion used in his ‘‘mobileport­ation’’ device.

Newspapers in English

Newspapers from New Zealand