A team of researchers led by Professor Tim Barfoot (UTIAS) has applied a new strategy for robots to predict the future location of dynamic obstacles, allowing them to navigate spaces without colliding with people.
The project, which is supported by Apple Machine Learning, will be presented at the International Conference on Robotics and Automation in Philadelphia at the end of May. The results from simulation have also been published in an article on arXiv.
“The principle of our work is to have a robot predict what people are going to do in the immediate future,” says Dr. Hugues Thomas (UTIAS), a postdoctoral fellow in Barfoot’s lab. “This allows the robot to anticipate the movement of people it encounters rather than react once confronted with those obstacles.”
To decide where to move, the robot makes use of Spatiotemporal Occupancy Grid Maps (SOGM). These are 3D grid maps maintained in the robot’s processor, in which each 2D grid cell contains predicted information about the activity in that space at a specific time. The robot choses its future actions by processing these maps through existing trajectory-planning algorithms.
Another key tool used by the team is light detection and ranging (lidar), a remote sensing technology similar to radar, except that it uses light instead of sound. Each ‘ping’ of the lidar creates a point stored in the robot’s memory, and previous work by the team has focused on labeling these points based on their dynamic properties. This helps the robot recognize different types of objects within its surroundings.
The team’s SOGM network is currently able to recognize four lidar point categories — the ground; permanent fixtures, such as walls; things that are moveable but still, like chairs and tables; and dynamic obstacles, such as people — without requiring any human labelling of the data.
“With this work, we hope to enable robots to navigate through crowded indoor spaces in a more socially aware manner,” says Barfoot. “By predicting where people and other objects will go, we can plan paths that anticipate what dynamic elements will do.”
In the paper, the team reports successful results from the algorithm carried out in simulation. The next challenge is to show similar performance in real-world settings, where human actions can be difficult to predict. As part of this, they have tested their design on the first floor of U of T’s Myhal Centre, where the robot was able to move past busy students.
“When we do experiment in simulation, we have agents that are encoded to a certain behaviour, and they will go to a certain point by following the best trajectory to get there,” says Thomas. “But that’s not what people do in real life.”
When people move through spaces, they may hurry or stop abruptly to talk to someone else or turn in a completely different direction. To deal with this kind of behaviour, the network employs a machine learning technique known as self-supervised learning.
Self-supervised learning contrasts with other machine-learning techniques, such as reinforced learning, where the algorithm learns to perform a task by maximizing a notion of reward in a trial-and-error manner. While this approach works well for some tasks — for example, a computer learning to play a game, such as chess or Go — it is not ideal for this type of navigation.
“With reinforcement learning, you create a black box that makes it difficult to understand the connection between the input — what the robot sees — and the output — what the robot does,” says Thomas. “It would also require the robot to fail many times before it learns the right calls, and we didn’t want our robot to learn by crashing into people.”
By contrast, self-supervised learning is simple and comprehensible, meaning that it’s easier to see how the robot is making its decisions. This approach is also point-centric rather than object-centric, which means the network has a closer interpretation of the raw sensor data, allowing for multimodal predictions.
“Many traditional methods detect people as individual objects and create trajectories for them. But since our model is point-centric, our algorithm does not quantify people as individual objects, but recognizes areas where people should be. And if you have a larger group of people, the area gets bigger,” says Thomas.
“This research offers a promising direction that could have positive implications in areas such as autonomous driving and robot delivery, where an environment is not entirely predictable.”
In future, the team wants to see if they can scale up their network to learn more subtle cues from dynamic elements in a scene.
“This will take a lot more training data,” says Barfoot. “But it should be possible because we’ve set ourselves up to generate the data in more automatic way: where the robot can gather more data itself while navigating, train better predictive models when not in operation, and then use these the next time it navigates a space.”
