Using facial recognition tech for hailstorms

Technology similar to what Facebook uses for recommending which friends you should “tag” may soon be coming to hailstorms. David Gagne, a machine learning scientist at the National Center for Atmospheric Research, is using facial recognition technology to unlock the secrets behind big hail.

“I’m using artificial intelligence techniques to predict the size of hailstorms,” Gagne said.

Working with computer-simulated storms, Gagne created software that is trained to determine which storms produce hail and then to recognize patterns associated with the storms behind the largest hailstones. “The shape of storms is really important,” he said.

Gagne’s latest work is published in Monthly Weather Review.

Gagne’s novel approach started with his Ph.D. dissertation between 2014 and 2015. It continued with a postdoc fellowship at NCAR, where he used “deep learning” to look at storms and find spatial patterns in the storm data he inputs. Past studies conducted by other scientists often looked at finer-scale processes within the storm. Gagne is taking the opposite approach, broadening outward to consider the storm’s entire structure.

The work he’s doing deals with computer-generated storms. “We create storms and derive their hail size with the microphysics,” he said.

Gagne then uses the raw data of what the storm “looks” like structurally to train software to predict its hail size. Over time, his machine learning model is refined, improving its predictions with each successive run.

Why not deal with actual hailstorms? “Simulated storms are a more self-consistent system,” Gagne said. In real life, there are many more complicating variables that render an experimental data set incomplete.

“The data we have is skewed,” Gagne said. “The hail reports cluster near cities or interstates.” In rural areas, the largest hail may strike in areas where nobody lives, leading to a missed event. Public-submitted hail reports may not be mapped correctly; even subtle discrepancies have a compounding effect over time. Doppler radar data could be used to fill in the gaps, but that comes down to radar coverage — which is somewhat lacking in many hail-prone areas. “And Doppler-estimated hail size has its own biases,” he said.

Other scientists agree that it’s a worthwhile project, citing promising results. Philippe Tissot, a researcher at Texas A&M who has worked at the intersection of atmospheric sciences in technology, said Gagne is “leading the field.”

“David is one of the young leaders in our field combining an excellent understanding of atmospheric processes, with high level computational skills and a deep understanding of how continuously evolving machine learning methods can help us better understand atmospheric and environmental processes and predict them more accurately,” Tissot wrote.

Tissot said Gagne is helping spearhead efforts to organize a conference on artificial intelligence in the environmental sciences at the American Meteorological Society’s January meeting in Boston.

Paul Miller, a professor at Louisiana State University, said machine learning can help forecasters sort out some of the randomness in an atmospheric setup.

“Even on days that we believe favorable for severe thunderstorms, not all thunderstorms turn out to be severe due to numerous other processes also affecting thunderstorm intensity,” Miller wrote. “Machine and deep learning techniques can potentially help forecasters refine their severe weather forecasts.”

Miller described Gagne’s paper as “a very advanced meteorological application of deep learning that illustrates how much storm-scale information can be gleaned from model output” beyond that of coarser, lower-resolution weather models.

But it’s not all about the atmospheric sciences, though. David Wanik is an assistant professor at the University of Connecticut School of Business who studies natural hazards and their impacts with machine learning. He said Gagne’s project could offer new insight into the computer science elements as well.

“Understanding why a model makes a prediction can be equally as important as the accuracy of the prediction itself,” Wanik wrote. “This paper is an excellent example of how scientists can interact with deep learning models, glean new insights and spark new research ideas from observing how deep learning models treat their input data.”

Gagne hopes that his endeavor eventually will serve as a supplement to meteorologists when dealing with the forecasting and warning of hail events.

“Our goal is to help better forecast hours or even days in advance,” Gagne said.

His aspirations include making more accurate real-time warnings but also stretching the warning time.

“Then we could tell folks to maybe change their plans, put their car in the garage, tweak their outdoor schedules,” Gagne said.

He believes this to be of great appeal to larger-scale interests as well, such as for event planners or those in the transportation sector.

“You could bring in more staff to help with crowd control at the airport or to move the planes faster,” he said.