Video games helped give us the self-driving car

Self-driving cars. They’re the future of transportation — and they’re getting smarter all the time. Thanks to advances in software and artificial intelligence, these machines are now able to distinguish between cars and cyclists, or between pedestrians and your pet. Many can now “see” just like you can, picking out objects and obstacles approaching ahead. All that tech could eventually save lives, helping to prevent the 95 per cent of car accidents that safety regulators estimate are caused by human error each year.

But none of this would be possible without a piece of hardware many of us take for granted in our own home computers. It’s a technology that traces back to the earliest days of modern personal computing, one that people tend to associate more with “World of Warcraft” than newfangled widgets on wheels.

We’re talking about the graphics processor.

In mainstream PCs, the graphics processor — often found on a graphics card — is what allows computers to draw all those pixels and polygons that make up today’s photorealistic video games. But as these processors have grown ever more powerful, engineers have discovered their utility in all sorts of nongaming applications. Graphics processing units — or GPUs — have transcended their origins to become entire computers in their own right.

“(The GPU) is now powering everything from games to the visual effects you see in Hollywood films,” said Danny Shapiro, the senior director of automotive at Nvidia, which accounts for roughly 75 per cent of the $7.8 billion market for GPUs. GPUs, said Shapiro, are central to “professional graphics, for automakers that are designing cars, to doctors and researchers that are searching for cures for cancer and using medical imaging techniques.” It’s a sign of how big the GPU business has grown that some 200 other companies work with Nvidia’s automotive unit alone. GPUs are even part of the brains behind artificial intelligence, appearing in technologies like the Amazon Echo, which converts natural human speech into data that machines can understand.

“The combination of GPUs and a CPU are now available that can accelerate analytics, deep learning, high-performance computing, and scientific simulations,” Chris Niven, research director for oil and gas issues at the research firm IDC, told ZDNet last month.

The best GPUs on the market today come with as many as 5,000 cores, said Jon Peddie, president of industry analysis firm Jon Peddie Research, not just two or four or eight as with CPUs. While CPUs can process smaller amounts of information very quickly, the advantage of GPUs has to do with scale — processing lots of information at the same time.

This is why self-driving cars find GPUs so useful. Through the use of optical cameras, laser and radar sensors, cars look at their surroundings by taking many measurements per second.

“It’s 30 pictures every second,” Shapiro said. “Each picture, a single frame, is made up of pixels. Each of these pixels or dots is a numerical value that says, ‘What is the colour of the light there?’ It’s just a bunch of numbers.”

GPUs like the ones found in self-driving cars are designed to crunch those numbers and figure out that some of those pixels represent an obstacle, whereas other pixels are lane markings and still others are traffic lights. While GPUs weren’t originally invented for those purposes, car engineers began taking advantage of the technology’s parallel computing powers about six or seven years ago, according to Peddie.

“The original use of GPUs in an automobile was for the instrument panel in the entertainment system,” he said. “It’s only been recently that people have been saying, ‘Hey, we can do this, or that!’”

As GPUs become even more powerful and gain even more features, you can expect them to crop up in even more places. Within automobiles alone, many standalone processors that used to handle just one function — such as the anti-lock brakes or the power windows — will all someday be routed through a single processor, the GPU, said Shapiro. And we’ll see cars work increasingly like Tesla’s automobiles, where you might customize your vehicle by picking and choosing different software packages to suit your driving style.

“You can almost have in-app purchases to add new features that weren’t there when you bought it,” he said.