Human-like Brain Helps Robot Out of a Maze
December 13, 2021 | Eindhoven University of Technology (Estimated reading time: 4 minutes
A maze is a popular device among psychologists to assess the learning capacity of mice or rats. But how about robots? Can they learn to successfully navigate the twists and turns of a labyrinth? Now, researchers at the Eindhoven University of Technology (TU/e) and the Max Planck Institute for Polymer Research in Mainz, Germany, have proven they can. Their robot bases its decisions on the very system humans use to think and act: the brain. The study, which was published in Science Advances, paves the way to exciting new applications of neuromorphic devices in health and beyond.
Machine learning and neural networks have become all the rage in recent years, and quite understandably so, considering their many successes in image recognition, medical diagnosis, e-commerce and many other fields. Still though, this software-based approach to machine intelligence has its drawbacks, not least because it consumes so much power to train the algorithms.
Mimicking The Human Brain
This power issue is one of the reasons that researchers have been trying to develop computers that are much more energy efficient. And to find a solution many are finding inspiration in the human brain, a thinking machine unrivalled in its low power consumption due to how it combines memory and processing.
Neurons in our brain communicate with one another through so-called synapses, which are strengthened each time information flows through them. It is this plasticity that ensures that humans remember and learn.
“In our research, we have taken this model to develop a robot that is able to learn to move through a labyrinth”, explains Imke Krauhausen, PhD student at the department of Mechanical Engineering at TU/e and principal author of the paper.
“Just as a synapse in a mouse brain is strengthened each time it takes the correct turn in a psychologist’s maze, our device is ‘tuned’ by applying a certain amount of electricity. By tuning the resistance in the device, you change the voltage that control the motors. They in turn determine whether the robot turns right or left."
So How Does It Work?
The robot that Krauhausen and her colleagues used for their research is a Mindstorms EV3, a robotics kit made by Lego. Equipped with two wheels, traditional guiding software to make sure it can follow a line, and a number of reflectance and touch sensors, it was sent into a 2 m2 large maze made up out of black-lined hexagons in a honeycomb-like pattern.
The robot is programmed to turn right by default. Each time it reaches a dead end or diverges from the designated path to the exit (which is indicated by visual cues), it is told to either return or turn left. This corrective stimulus is then remembered in the neuromorphic device for the next effort.
“In the end, it took our robot 16 runs to find the exit successfully,” says Krauhausen (see image). “And, what’s more, once it has learned to navigate this specific route (target path 1), it can navigate any other path that it is given in one go (target path 2). So, the knowledge it has acquired is generalizable.”
Part of the success of the robot’s ability to learn and exit the maze lies in the unique integration of sensors and motors, according to Krauhausen, who cooperated closely with the Max Planck Institute for Polymer Research in Mainz for this research. “This sensorimotor integration, in which sense and movement reinforce one another, is also very much how nature operates, so this is what we tried to emulate in our robot.”
Smart Polymers
Another clever thing about the research is the organic material used for the neuromorphic robot. This polymer (known as p(g2T-TT)) is not only stable, but it also is able to ‘retain’ a large part of the specific states in which it has been tuned during the various runs through the labyrinth. This ensures that the learned behaviour ‘sticks’, just like neurons and synapses in a human brain remember events or actions.
The use of polymer instead of silicon in the field of neuromorphic computing was pioneered by Paschalis Gkoupidenis of the Max Planck Institute for Polymer Research in Mainz and Yoeri van de Burgt of TU/e, both co-authors of the paper.
In their research (dating from 2015 and 2017), they proved that the material can be tuned in a much larger range of conduction than inorganic materials, and that it is able to ‘remember’ or store learned states for extended periods. Since then, organic devices have become a hot topic in the field of hardware-based artificial neural networks.
Bionic Hands
Polymeric materials also have the added advantage that they can be used in numerous biomedical applications. “Because of their organic nature, these smart devices can in principle be integrated with actual nerve cells. Say you lost your arm during an injury. Then you could potentially use these devices to link your body to a bionic hand,” says Krauhausen.
Another promising application of organic neuromorphic computing lies in small so-called edge computing devices where data from sensors is processed locally outside of the cloud. Van de Burgt: “This is where I see our devices going in the future, our materials will be very useful because they are easy to tune, use much less power, and are cheap to make.”
So will neuromorphic robots one day be able to play a soccer game, just like TU/e’s successful soccer robots?
Krauhausen: “In principle, that is certainly possible. But there’s a long way to go. Our robots still rely partly on traditional software to move around. And for the neuromorphic robots to execute really complex tasks, we need to build neuromorphic networks in which many devices work together in a grid. That’s something that I will be working on in the next phase of my PhD research.”
Read the original article, here.
Suggested Items
Chinese Smartphone Market Maintains its Recovery Momentum at 6.5% Growth in 1Q24,
04/26/2024 | IDCAccording to preliminary data from the International Data Corporation (IDC) Worldwide Quarterly Mobile Phone Tracker, China smartphone shipments grew 6.5% year over year (YoY) to 69.3 million units in 1Q24.
Boeing Opens Research & Technology Center in Japan
04/23/2024 | BoeingBoeing today opened a Boeing Research & Technology (BR&T) Center in Japan that will focus on innovation to enable the commercial aviation industry meet its goal of net zero carbon emissions by 2050.
Gartner Forecasts Worldwide IT Spending to Grow 8% in 2024
04/17/2024 | Gartner, Inc.Worldwide IT spending is expected to total $5.06 trillion in 2024, an increase of 8% from 2023, according to the latest forecast by Gartner, Inc. This is an increase from the previous quarter’s forecast of 6.8% growth and puts worldwide IT spending on track to surpass $8 trillion well before the end of the decade.
Argonne, RIKEN Sign a Memorandum of Understanding in Support of AI for Science
04/16/2024 | BUSINESS WIRELeaders in high performance computing in the U.S. and Japan have signed a memorandum of understanding (MOU) establishing a cooperative relationship in support of artificial intelligence (AI) computing projects.
RAICo Fellowship to Widen Participation Within the Field of Robotics and Artificial Intelligence
04/12/2024 | RAICoWOMEN and those early in their academia career who are passionate about robotics and artificial intelligence are encouraged to apply for a RAICo Fellowship.