Meta’s AI to bring kids’ drawings to life

Meta (formerly Facebook) researchers have developed an Artificial Intelligence (AI) system that can identify and automatically animate the human-like figures in children's drawings with a high success rate, and without any human guidance.

‘Humans’ in children’s drawings come in many different forms, colours, sizes and scales, with little similarity when it comes to body symmetry, morphology, and point of view.

“We’re excited to announce a first-of-its-kind method for automatically animating children’s handdrawn figures of people and humanlike characters (a character with two arms, two legs, a head, etc.) that bring these drawings to life in a matter of minutes using AI,” Meta researchers said in a statement.

By uploading the artwork to its prototype system, parents and children can experience the excitement

of watching their drawings become moving characters that dance, skip and jump.

“They can even download their animated drawings to share with friends and family. If parents choose, they can also submit those drawings to help improve the AI model,” Meta said.

The first step in animating children’s drawings of people is distinguishing the human figures from the background and from other types of characters in the picture.

Object detection using existing techniques works quite well on children’s drawings, but the segmentation masks aren’t accurate enough to be used for animation.

“To address this, we instead use the bounding boxes obtained from the object detector and apply a series of morphological operations and image processing steps to obtain masks,” the researchers explained.

They use Meta AI’s convolutional neural networkbased object detection model, ‘Mask R-CNN’, to extract the human-like characters within a child’s drawing for processing.

—IANS