MAKING CAMERAS SMART
AI has created a revolution with cameras; a new kind of surveillance that could raise privacy issues, writes FARHAD MANJOO
SOMETHING strange, scary and sublime is happening to cameras, and it’s going to complicate everything you knew about pictures. Cameras are getting brains.
Until the past few years, just about all cameras — whether smartphones or point-andshoots or closed-circuit television surveillance — were like eyes disconnected from any intelligence.
They captured anything you put in front of them, but they didn’t understand a whit about what they were seeing. Even basic facts about the world eluded them. It’s crazy, for instance, that in 2018, your smartphone doesn’t automatically detect when you’ve taken naked pictures of yourself and offer to house them under an extra-special layer of security.
But, all this is changing. There’s a new generation of cameras that understand what they see. They’re eyes connected to brains, machines that no longer just see what you put in front of them, but can act on it — creating intriguing and sometimes eerie possibilities.
At first, these cameras will promise to let us take better pictures, to capture moments that might not have been possible with every dumb camera that came before. That’s the pitch Google is making with Clips, a new camera that went on sale last Tuesday. It uses so-called machine learning to automatically take snapshots of people, pets and other things it finds interesting.
Others are using artificial intelligence to make cameras more useful. You’ve heard how Apple’s newest iPhone uses face recognition to unlock your phone. A startup called Lighthouse AI wants to do something similar for your home, using a security camera that adds a layer of visual intelligence to the images it sees. When you mount its camera in your entryway, it can constantly analyse the scene, alerting you if your dog walker doesn’t show up, or if your kids aren’t home by a certain time after school.
It doesn’t take long to imagine the useful and creepy possibilities of cameras that can decipher the world. Digital cameras brought about a revolution in photography, but until now, it was only a revolution of scale: Thanks to microchips, cameras got smaller and cheaper, and we began carrying them everywhere.
Now, artificial intelligence (AI) will create a revolution in how cameras work, too. Smart cameras will let you analyse pictures with prosecutorial precision, raising the spectre of a new kind of surveillance — not just by the government but by everyone around you, even your loved ones at home.
The companies making these devices are aware of the privacy dangers. Many are moving into the field gingerly, slathering their products with safeguards that they say reduce the creepiness.
Take Google’s Clips, which I’ve used for the past week and half. It’s one of the most unusual devices I’ve ever encountered. The camera is about the size of a tin of mints, and it has no screen. On its front, there’s a lens and a button. The button takes a picture, but it’s there only if you really need it.
Instead, most of the time, you just rely on the camera’s intuition, which has been trained to recognise facial expressions, lighting, framing and other hallmarks of nice photos. It also recognises familiar faces — the people you’re with more often are those it deems most interesting to photograph.
Clips, which sells for US$249 (RM980), makes taking pictures unconscious and all but invisible. Carry it around wherever you go; the camera has a handy case with a big bendy clip, so it can be affixed to your jacket, set on a tabletop, carried in your palm or placed anywhere else with a view. From there, it’s all AI.
Clips watches the scene, and when it sees something that looks like a compelling shot, it captures a 15-second burst picture (something like a short animated GIF — graphics interchange format— or Live Photo on your iPhone).
I took a trip with my family to Disneyland last week, and over two highly photographable days, I barely took a photo. Instead, this tiny device automatically did the work, capturing a couple hundred short clips of our vacation.
But, obviously, setting up a camera that doesn’t need to be specifically triggered to take a picture is problematic. It raises the worry of spying — that Google can spy on you, or that you can use it to spy on others.
Google addresses that creepiness in two ways. The device is mostly unconnected from the Internet. It can take pictures without a connection, and it requires your phone for viewing or saving the clips. But even then, all its AI happens on the device, and it doesn’t even need you to have a Google account, the company said.
Clips also raises the memory of other products in this vein, including Snap’s Spectacles and Google Glass, the search company’s failed attempt to get consumers to use glasses that can take photos.
To ensure that, Clips is designed to look like a camera. When it’s on, it flashes a white LED to signal that it could be recording. It also does not record audio, because that might have felt too much like spying.
Lighthouse, which I’ve also used for a few weeks, is meant to be an upgrade over the Internetconnected home security cameras that have become popular. Those devices can be annoying because they freak out every time they spot any movement.
Lighthouse’s special trick is a camera system that can sense 3D space and learn to recognise faces — intelligence meant to avoid false alarms. It also has a nifty natural-language interface, so you can ask it straightforward questions: “What did the kids do when I was gone?” It will show you clips of your kids when you were gone.
Both Lighthouse and Clips are well-crafted against abuse. It should be noted that neither one allows for much more spying than we can already accomplish with smartphones; constant social surveillance is the norm in 2018.
But they are guides to the future. Tomorrow, all cameras will have their capabilities. And they won’t just watch you — they’ll understand, too.
I took a trip with my family to Disneyland last week, and over two highly photographable days, I barely took a photo. Instead, this tiny device automatically did the work, capturing a couple hundred short clips of our vacation.