AI IS FLYING DRONES (VERY, VERY SLOWLY)
A drone from the University of Zurich is an engineering and technical marvel. It also moves slower than someone taking a Sunday morning jog.
At the International Conference on Intelligent Robots and Systems in Madrid in October, the autonomous drone, which navigates using artificial intelligence, raced through a complicated series of turns and gates, buzzing and moving like a determined and oversized bumblebee. It bobbed to duck under a bar that swooshed like a clock hand, yawed left, pitched forward and raced toward the finish line. The drone, small and covered in sensors, demolished the competition, blazing through the course twice as fast as its nearest competitor. Its top speed: 5.6 mph.
A few weeks earlier, in Jiddah, Saudi Arabia, a different drone, flown remotely by its pilot, Paul Nurkkala, shot through a gate at the top of a 131-foot-high tower, inverted into a roll and then dove toward the earth. Competitors trailed behind or crashed into pieces along the course, but this one swerved and corkscrewed through two twin arches, hit a straightaway and then blasted into the netting that served as the finish line for the Drone Racing League’s world championship. The winning drone, a league-standard Racer3, reached speeds over 90 mph, but it needed a human to guide it. Nurkkala, known to fans as Nurk, wore a pair of goggles that beamed him a firstperson view of his drone as he flew it.
Artificial intelligence, or AI, has been on a hot streak, besting humans in competitions over the past five years. Alphago, a program built by Deepmind, the artificial intelligence arm of Google parent Alphabet, went from learning the basics of the game Go to beating the world’s best human player in a little over three years. More recently, the AI Alphastar, also by Deepmind, was able to beat a top player in the complex strategy video game “Starcraft II,” shutting out its human competitor five games to zero.
But the real world can be an immensely noisy place, and many Ai-powered, and autonomous, vehicles still struggle to excel in it.
This year, a new competition will try to make sure autonomous drones are more nimble — and that they are truly able to act by themselves.
“Right now, autonomous drones are a thing you’d only find in labs, being pioneered by a small, niche audience,” said Keith Lynn, Lockheed Martin’s program manager for Alphapilot, an autonomous drone racing competition organized by the Drone Racing League.
The Alphapilot competition, which is sponsored by Lockheed Martin and part of the racing league’s new Artificial Intelligence Robotic Racing Circuit, aims to drive interest and research into self-driving, or autonomous, vehicles. Nine teams will compete this fall, out of 430 currently making their way through qualifying rounds — students, AI researchers and independent drone enthusiasts, among others — according to the organizers. The winning team will take home a prize of $1 million. If the AI drone can also beat a top human pilot in a head-to-head race, the team will get an extra $250,000.
Competitors, the league said, will program a Racer3 that includes an artificial intelligence chip made by Nvidia, a partner in the competition. The nine qualifying teams will be announced this spring, according to the organizers.
For autonomous drones to be useful — in disaster zones, as delivery vehicles or in rural areas — they will need to be able to fly far, fast and without human oversight, often in environments where they can’t rely on external guidance systems, like GPS. And that’s one of their biggest challenges.
“Current autonomous drones have very little onboard decision-making,” said Kerry Snyder, a founder of KEF Robotics, a competing team from Pittsburgh. “They will almost always be following very specific human commands and rarely be able to accomplish higher level tasks such as ‘Find a trapped person’ or ‘Fly through an open window and then explore.’”
There’s also a gap between code created in the lab and real-world flying. “A lot of our AI is primarily developed in simulation,” said Dr. Chelsea Sabo, technical lead of the Alphapilot program at Lockheed Martin. “Going from simulation to the real world is going to be a big challenge in Alphapilot.”
Machine learning allows for AI to train much faster than fleshand-blood pilots. A human who wants to practice for 10,000 hours needs 3 1/2 years of eighthour days. A computer using machine learning can fly 10,000 simulated hours overnight.
Eric Amoroso, another cofounder of KEF Robotics, said that autonomous vehicles can also be more precise than human pilots. Autonomous drones can fly more precisely by making subtle alterations to how much thrust each propeller produces, for example, he said, and can use information from sensors that humans don’t have, like an accelerometer, to estimate where it is in space.
But where humans excel — and AI in general falls short — is in merging those individual skills into a cohesive whole, and doing it as fast as humans are capable. “Sensing the world, making decisions, acting on it, and doing that in real time, that’s really the fundamental challenge of robotics,” Amoroso said.
Autonomous drones also struggle to make sense of visual information, particularly at high speeds, in part because of shortcomings in sensors. “The main challenge of autonomous drone flight is perception based on cameras,” said Davide Scaramuzza, a professor of robotics and perception at the University of Zurich and creator of the autonomous drone that won the competition in Madrid last year. “The faster the drone goes, the more blurred the image gets.”
A drone flying in the Alphapilot competition will only be able to fly based on what it can see in front of it, and must use that information to know where it is in physical space. At 90 mph, even at the calculating speed computers are capable of, an autonomous drone won’t be able to process images as fast as a human can, and may be thrown off course by something as simple as a shadow, leading it to miss a gate or believe it’s 1 foot to the right of where it actually is. At best, this means the autonomous drone will need to course correct, slowing it down. At worst, it crashes.