When Japan’s Fukushima nuclear disaster struck in 2011 following a devastating earthquake and tsunami, the robots that were deployed to support rescue workers were very basic and largely ineffective, says robotics expert Professor Sven Behnke at the University of Bonn in Germany.

Spurred by this problem, Prof. Behnke and his team developed a robust disaster-response system through a project called CENTAURO. The robot is controlled by a human from a safe distance while various sensors allow it to perceive its environment and relay information back to its operator.

‘The main operator controls the robot through a telepresence suit which measures the motions of the operator's arms, wrists and fingers and transfers them to the robot,’ said project coordinator Prof. Behnke. A head-mounted display worn by the operator allows them to see in 3D what the robot sees from its own perspective, he adds.

Named Centauro, the 1.5-metre-tall robot weighs 93 kilograms, is made of lightweight metals like aluminum and has 3D-printed plastic skin.

Centaur-like

‘The robot has a centaur-like body plan with four articulated legs ending in steerable wheels,’ said Prof. Behnke. Those four legs make it more stable than bipedal robots. As it is able to rotate at the hip, knee and ankle, Centauro can take on numerous postures and navigate in challenging environments.

Centauro’s upper body has two arms with multi-fingered hands which allow it to lift objects and manipulate tools and doors. Although tele-operated, the robot has some degree of autonomy. For example, if it is told to move to specific locations or grasp an object it will plan and execute the action.

Last year, Centauro was tested in real-world, challenging scenarios at the German nuclear disaster-response provider Kerntechnische Hilfsdienst GmbH. It successfully climbed stairs, navigated debris, overcame gaps, unlocked a door, operated valves and power tools, and more, says Prof. Behnke. ‘The CENTAURO disaster-response system provided the high degree of flexibility needed for realistic missions,’ he said.

Prof. Behnke hopes the technology may one day play a crucial role in disaster relief efforts although it isn’t ready to face radiation just yet. However, researchers at the University of Birmingham, UK, are in the process of developing robots that can handle high radiation levels to clean up nuclear waste from the past half century.

Across the European Union, more than 90 nuclear reactors have been permanently shut down while more facilities are set to be decommissioned. Under its 2021-2027 budget, the European Commission has proposed to allocate nearly €1.2 billion towards nuclear safety.

‘There’s nearly five million tonnes of legacy nuclear waste in the UK and cleaning that up is the biggest and most difficult environmental remediation challenge in the whole of Europe,’ said robotics expert Professor Rustam Stolkin who coordinates the RoMaNs project.

Prof. Stolkin and his colleagues are designing autonomous behaviours in robots so that they can sort radioactive waste according to various contamination levels.

‘This can only be done by robots because this waste is too radioactive for humans to go near, even (when) wearing protective suits,’ said Prof. Stolkin.

AI-controlled

To date, robots operating in dangerous environments are controlled entirely by a human, but this one-way approach would be painstakingly slow for grasping and moving huge amounts of materials of unpredictable shapes, sizes and consistencies, says Prof. Stolkin.

‘There’s nearly five million tonnes of legacy nuclear waste in the UK and cleaning that up is the biggest and most difficult environmental remediation challenge in the whole of Europe.’ Professor Rustam Stolkin, University of Birmingham, UK

To overcome this problem, the team developed an autonomous, vision-guided robot which uses AI to assist the human operator.

Their project partner CEA, the French Alternative Energies and Atomic Energy Commission, created a nuclear-resilient robot arm with a hand and fingers, which is controlled by a robotic glove, or haptic exoskeleton, worn by the operator.

‘This now is a bit like a fancy joystick,’ explained Prof. Stolkin. ‘So as you move your arm and your fingers, the slave arm in the radioactive zone moves its arm and its fingers.’

The system uses AI for automatic vision, allowing the robot to know how to detect, recognise and pick up all kinds of objects.

The human operators share control of the robotic arm with the robot through tele-operation and AI, says Prof. Stolkin. For example, the operator can move the arm around and the robot automatically controls the orientation of the hand to make the grasp easier, or the robot, planning to grasp an object, would display its intentions to the human for confirmation.

‘The robot (AI) is doing all the hard work, but the human still feels in charge at some level,’ he said.

Such systems are usually very complex to control, says Prof. Stolkin, however theirs allows operators to simply mouse click on an object that the robot goes to and grasps.

When the robot arm touches a surface or grasps an object, the operator feels the contact forces through the robotic glove. Giving remote operators situational awareness of what’s going on inside the no-go zone through a virtual sense of touch is extremely useful, says Prof. Stolkin.

For the gloves to work, the robot arm must behave adaptively, responding to the environment they encounter, he says. To achieve this, the CEA team developed adaptive mechanisms in the arm joints that mechanically move just like springs and are more resilient against radiation than delicate electronic parts.

Near future

The RoMaNs team successfully tested a robot arm with the AI control system they developed, in a radioactive environment in 2017, under full nuclear safety and UK national security regulations, at a site in northern England operated by the National Nuclear Laboratory. This was the first time ever an AI-controlled robot was deployed into a real-world, radioactive environment.

Prof. Stolkin had previously imagined that it may take at least another decade to transfer these technologies to the nuclear industry, but says plans are already being made to deploy them at decommissioning sites in the near future.

‘When we proposed this, the idea of AI-controlled robots, it was considered absurd by this industry,’ he said.

The research in this article was funded by the EU. If you liked this article, please consider sharing it on social media.