Robotics and artificial intelligence

the multi-media screen in the center stack.

With its broad-based advances in hardware and software, Platform 2.1 is a research tool for concurrent testing of TRI’s dual approaches to vehicle autonomy – Guardian and Chauffeur – using a single technology stack. Under Guardian, the human driver maintains vehicle control and the automated driving system operates in parallel, monitoring for potential crash situations and intervening to protect vehicle occupants when needed. Chauffeur is Toyota’s version of SAE Level 4/5 autonomy where all vehicle occupants are passengers. Both approaches use the same technology stack of sensors and cameras. This week marks the first time the Guardian and Chauffeur systems have been demonstrated on the same platform, which includes multiple test scenarios to demonstrate TRI’s advances in both applications.

These include the ability of the Guardian system to detect distracted or drowsy driving in certain situations, and to take action if the driver does not react to turns in the road. In such a situation, the system first warns and then will intervene with braking and steering to safely follow the road’s curvature. Chauffeur test scenarios demonstrate the vehicle’s ability to drive itself on a closed course, navigate around road obstacles, and make a safe lane change around an impediment in its path with another vehicle travelling at the same speed in the lane next to it.

In addition to real- world testing, TRI is using simulation to accurately and safely test engineering assumptions, and investors can experience automated driving test scenarios in a virtual simulator. TRI is also making advancements in robotics and artificial intelligence.

As part of its research into human support robots that can assist with tasks in the home, such as item retrieval, TRI has pioneered new tools to give future robots enhanced, humanlike dexterity in order to grasp and manipulate objects so that they are not dropped or damaged. TRI is also applying computer vision and artificial intelligence to robot development, allowing robots to detect the physical presence of humans and objects, note their locations and retrieve objects for humans when prompted. The robots can detect when objects have been relocated, updating the item’s location in the robot’s database, and even detect faces of known people and differentiate individuals.

TRI’s progress in robotics have been made possible by its ability to increase the value and accuracy of simulation to augment physical testing. Since it is impossible to physically test the wide variety of situations robots may encounter in the real world, the institute uses simulated environments, constantly adapting them with data collected in real- world testing for greater precision.

Additionally, TRI is pursuing new concepts for applying artificial intelligence inside a vehicle cabin to keep occupants comfortable, safe and satisfied. The institute has created a simulator showing an in- car AI agent that can detect a driver’s skeletal pose, head and gaze position and emotion to anticipate needs or potential driving impairments.

For example, when the system detects the driver taking a drink and facial expressions which might indicate discomfort, the agent hypothesizes that the driver might be feeling warm and can adjust the air conditionin g or roll down the windows. If the agent detects drowsiness, it might provide a verbal prompt in the cabin suggesting that the driver pull over for coffee or navigate the car to a coffee shop.

Automated driving white paper

In addition to its technology demonstrations, Toyota also released a comprehensive overview of its work on automated driving, including the philosophy that guides its approach to the technology, its ongoing research programs, and its near-term product plans. The white paper reflects Toyota’s understanding of the potential for automated driving to dramatically expand mobility options for people around the world, helping to create a society where mobility is safe, convenient, enjoyable, and available to everyone. It summarizes the dual concepts of Guardian and Chauffeur that guide Toyota’s research and the Mobility Teammate Concept that guides its product development.

“Vehicles with automated driving technology will bring many benefits to society, but one of the top priorities at Toyota is to help make the traffic environment safer,” said Kiyotaka Ise, chief safety technology officer and senior managing officer of Toyota Motor Corp. “By having our vehicle technologies seamlessly anticipate and interact with human beings and the traffic environment, we will get closer to realizing a future without traffic injuries or fatalities.”