Picture this: hundreds of ant-sized robots climb over rubble, under rocks and between debris to inspect the damage of a fallen building before human rescuers explore on-site.&nbsp;Downscaling legged robots to the size of an insect enables access to small spaces that humans and large robots cannot reach. A swarm of small robots can even collaborate like their insect counterparts to haul objects and protect one another. Picotaur, a new robot from the labs of Sarah Bergbreiter and Aaron Johnson is the first of its size able to run, turn, push loads and climb miniature stairs.“This robot has legs that are driven by multiple actuators so it can achieve various locomotion capabilities,” said Sukjun Kim, a recent Ph.D. graduate advised by Bergbreiter. “With multiple gait patterns it can walk like other hexapod robots, similar to how a cockroach moves, but it can also hop from the ground to overcome obstacles.” &nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/V6PjNExaVbA?&amp;wmode=opaque&amp;rel=0&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true">&nbsp;</iframe>Video above depicts Picotaur, a 7.9 mm robot, is the first of its size to run, turn, push loads and climb miniature stairs.The 7.9 mm robot was 3D-printed using two-photon polymerization, a process previously successful in building various small-scale robotic systems in the lab such as microbots, microgrippers, microswimmers, and microsensors.“Using this process, we were able to miniaturize the two degree of freedom linkage mechanism that allows Picotaur to clear step heights and easily alternate between walking and jumping,” said Bergbreiter, a professor of mechanical engineering. &nbsp;Kim tested Picotaur’s ability to push loads by creating a miniature soccer field. He found that the robot has enough force to push the ball and then turn, reorient itself, and follow the ball into the net.<blockquote>Now we have this capability to expand the design space from 2D to 3D. We can apply this process to create other small-scale robotic systems for various applications.<cite>Sukjun Kim, Ph.D. Alumni, Mechanical Engineering</cite></blockquote>“Historically, microfabrication technology was limited in manufacturing microscale devices in two-dimensional spaces, like for the semiconductor industry,” said Kim. “But now we have this capability to expand the design space from 2D to 3D. We can apply this process to create other small-scale robotic systems for various applications, for example, microgrippers for grasping and delivering small objects for surgical applications and microscale manufacturing applications.”Because microrobotics is still in early development, there are challenges yet to overcome before we see fully integrated robots in the field. For example, the team hopes to explore adding solar cells to the top of the robot so that it can be powered without tethers.“Now that we see and accept larger robotic systems in the world, I hope that with this work people can imagine small-scale robots working around us and understand that that future is not too far off,” Kim said. &nbsp;“We can start thinking about where micro-robots would be useful and even find applications we haven’t thought of yet.”

Researchers in the Department of Mechanical Engineering at Carnegie Mellon University have created the first legged robot of its size to run, turn, push loads and climb miniature stairs.

It's an ant... it's a robot... it's Picotaur! The unrivaled micro robot

Yokohama, Japan, May 14, 2024 -- DEEP Robotics, a leading quadrupedal robot developer, yesterday began to participate in the 2024 IEEE International Conference on Robotics and Automation (ICRA) in Yokohama, Japan, showcasing the company's latest advances in AI reinforcement learning and robotic technologies.At the conference, held from May 13 to 17, Hangzhou-based DEEP Robotics aims to present AI innovations that pave the way for its smaller and full-size quadrupedal robots to complete a series of highly complex and even acrobatic movements.The Lite3, one of the company's signature robot dogs, can scurry across a stack of large boxes, leap across gaps, navigate around stairs, and climb easily onto an elevated platform about a half meter tall.A more stunning feat is that the Lite3 can shift its center of gravity when tossed in the air, spin its body and land on its four feet, or quickly roll over after falling on its back. <img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzE2NDQ1MTk5NzQ4LTQuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib">The Lite3, in action during a parkour demonstration, can scale elevated platforms that are at least 50 centimeters tall.“We successfully applied the Proximal Policy Optimization (PPO) method combined with depth camera sensor inputs and trained an end-to-end policy,” Zunwang Ma, a robot control engineer at DEEP Robotics, said in a speech yesterday at the 2024 IEEE ICRA.“This approach effectively broaden the limitations of traditional model-based control methods, enabling our quadruped robot to traverse high platforms and gaps without requiring precise perception and robot modeling,” Ma noted.Meanwhile, the X30, a larger, industrial-grade robot dog also produced by DEEP Robotics, amazed visitors with its autonomous adaptation to an array of unstructured, uneven surfaces such as grass, gravel, and rubble.&nbsp;The X30 stands out with the ability to traverse rugged terrains and navigate random objects with ease. It is designed to withstand external interference like pushing or pulling, maintaining its balance, which proves to be a big advantage in outdoor operations. <img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzE2NDQ1NjI5MjMxLTEuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib" alt="X30 Quadruped Robot">The X30 climbs up stairs in a demonstration at the 2024 IEEE ICRA.Built to IP67 standards, the robot is able to function under the rain, on plateaus or Gobi deserts, or in any challenging environments with huge variances in temperature, altitude or degrees of humidity. Algorithmic improvementsThrough a series of algorithmic innovations and reinforcement learning iterations, engineers from DEEP Robotics have given a huge boost to the dexterity, autonomy and self-balancing abilities of Lite3 and X30.In the case of Lite3, it gains enhanced motion control capabilities on the back of intensive AI training. In a simulation mode, an avatar of the robot is always kept initially at a slant, said Ma, the engineer.By devising reinforcement learning policies and setting up rewards to guide the avatar, AI engineers enable the quadruped to shift in the air and maintain its dynamical balance in the virtual world.Other improved metrics of Lite3 include faster walking speed, topping up at 4 meters per second. When pushed to its limits, the robot can scramble up platforms higher than 50 centimeters, as well as jump over a 80-centimeter-wide gap.For its part, DEEP Robotics' X30 robot, when it comes with a depth camera, lidar and other type of sensors, is capable of perceiving the surrounding environment on the fly and thus figuring out its next steps.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzE2NDQ1NjYyMjQ4LTIuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib" alt="ICRA Tech Talk">Zunwang Ma, a robot control engineer at DEEP Robotics, delivers a speech at 2024 IEEE ICRA. ‘AI-Plus Plan’The company is looking to incorporate advanced AI technologies into its robotics systems under a "DEEP Robotics AI-Plus Plan" to enable bigger breakthroughs in embodied AI.Application-wise, legged robots from DEEP Robotics have proven practical in an array of use cases including autonomous inspection, emergency detection and rescue.Overall, thanks to a large amount of data acquired from real-world application of its products, DEEP Robotics has met with relatively fewer difficulties in the sim-to-real transfer, meaning the deployment of robotics algorithms to a physical robot prototype.Going forward, the company aims to integrate reinforcement learning further into its development to broaden the application scenarios of its robots and explore the next frontiers of AI-powered robotics."With reinforcement learning, we can use fewer policies to achieve greater terrain adaptation and coverage , making the robot more robust and intelligent," Ma explained.Under DEEP Robotics' AI-Plus Plan, product capabilities will extend further to facets like perception, planning, decision-making and human-machine interaction. DEEP Robotics' products have been widely adopted in more than a dozen countries in North America, Western Europe, Japan and Korea, the Middle East and other regions.

The X30 and the Lite3, two quadrupedal robot models from DEEP Robotics, showcase their locomotion and perception capabilities at the 2024 IEEE ICRA in Yokohama, Japan from May 13 to 17.

DEEP Robotics Attends 2024 IEEE ICRA, Showcases Progress in AI-Enabled Quadrupedal Robotics

Parents spend roughly 300 hours each year cleaning up after their kids. That’s nearly two weeks that could be otherwise spent doing, well, anything else. Researchers in Carnegie Mellon University’s <a href="https://www.meche.engineering.cmu.edu/index.html" rel="noopener" target="_blank" id="isPasted">Department of Mechanical Engineering</a>, in collaboration with Google DeepMind and the University of Washington, are hopeful that parents will regain tidying time and then some with <a href="https://linchangyi1.github.io/LocoMan/" rel="noopener" target="_blank">LocoMan</a>, a four-legged version of the Jetsons’ beloved maid “Rosey the Robot,” that could lend a hand in the not-so-distant future.<iframe width="640" height="360" src="https://www.youtube.com/embed/d-GLiRPiHIE?&amp;wmode=opaque&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true">&nbsp;&nbsp;&nbsp;</iframe>Quadrupedal robots, designed to move on four legs much like a dog, are already found leading search and rescue missions, surveying construction sites, and moving parts around factories. Their ability to navigate complex environments with a low center of gravity and light weight make quadrupedal robots a top contender for household use, too. Until now, the missing piece was the dexterity and versatility skills necessary for them to be efficient in daily life.By installing two custom-designed, lightweight manipulators (think robot arms) onto the front legs of a quadrupedal robot, <a href="https://engineering.cmu.edu/directory/bios/zhao-ding.html" target="_blank">Ding Zhao</a> has created a robot versatile enough to open doors, pour drinks, plug a phone in to charge, and—perhaps best of all—clean up after your on-the-go toddlers.<blockquote>While many researchers work on humanoid robots that look like humans, with potential to directly learn from humans or even replace humans in some tasks, we focus on robots that are complementary to humans to team up with them.<cite>Ding Zhao, Associate Professor, Mechanical Engineering</cite></blockquote>“While many researcher work on humanoid robots that look like humans, with potential to directly learn from humans or even replace humans in some tasks, we focus on robots that are complementary to humans to team up with them,” said Zhao, associate professor of mechanical engineering.Unlike humanoid robots that come at a high cost and hefty weight, Zhao’s manipulators can be added to existing lower-cost quadrupedal robots and are compact, lightweight, and easy to fabricate, making them an accessible technology.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzE1NzM1MTQ3ODg3LTA1MDktZW0taG9tZS1oZWxwZXItcm9ib3QucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib">The core idea is to leverage the leg as an integral component of the “robotic arm” for executing 6D pose manipulation.“We used four commercially available servos and 3D printed a few other parts to bring them to life,” Changyi Lin, a Ph.D. candidate in the CMU Safe AI Lab and the first author of the paper explained.Zhao’s team introduced the robot to a class of five preschool students at The Cyert Center for Early Education. After explaining to children how robots work and what we use them for, the children had the opportunity to interact with Zhao’s robot. The students were impressed with the robot’s capabilities and didn’t want it to leave their classroom.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzE1NzM1MTc3MDc1LTA1MTMtZW0yLWhvbWUtaGVscGVyLXJvYm90LnBuZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6OTUwLCJmaXQiOiJjb3ZlciJ9fX0=" style="width: 100%px;" class="fr-fic fr-dib">Ding Zhao (center), with children from the Cyert Center, interacting with the home-helper robot.The group continues to develop LocoMan to perform tasks autonomously by integrating advanced perception and intelligence planning capabilities into its existing whole-body controller.“We anticipate that robots like LocoMan will be ready to help out at home, or in daycares, within the next three years,” said Zhao. “It is a pleasant job just to imagine that I may no longer need to handle my kids’ messy fun.”This work will be presented at the loco-manipulation workshop and the manipulation skills workshop of the 2024 IEEE International Conference on Robotics and Automation.

New locomotion and manipulation technology from Ding Zhao’s lab will enable four-legged robots to lend a hand in the not-so-distant future.

Manipulation technology makes home-helper robot possible

<img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1715299294035-5712x4284.jpg" style="width: 100%px;" class="fr-fic fr-dib">The robot spontaneously changed its gait to cross a terrain with gaps. 2024 EPFL/BioRob-CC-BY-SA 4.0With the help of a form of machine learning called deep reinforcement learning (DRL), the EPFL robot notably learned to transition from trotting to pronking – a leaping, arch-backed gait used by animals like springbok and gazelles – to navigate a challenging terrain with gaps ranging from 14-30cm. The study, led by the&nbsp;<a href="https://www.epfl.ch/labs/biorob/" target="_blank">BioRobotics Laboratory</a> in EPFL’s School of Engineering, offers new insights into why and how such gait transitions occur in animals. “Previous research has introduced energy efficiency and musculoskeletal injury avoidance as the two main explanations for gait transitions. More recently, biologists have argued that stability on flat terrain could be more important. But animal and robotic experiments have shown that these hypotheses are not always valid, especially on uneven ground,” says PhD student Milad Shafiee, first author on a paper published in <a href="https://www.nature.com/articles/s41467-024-47443-w" target="_blank" rel="noopener">Nature Communications</a>.Shafiee and co-authors Guillaume Bellegarda and BioRobotics Lab head Auke Ijspeert were therefore interested in a new hypothesis for why gait transitions occur: viability, or fall avoidance. To test this hypothesis, they used DRL to train a quadruped robot to cross various terrains. On flat terrain, they found that different gaits showed different levels of robustness against random pushes, and that the robot switched from a walk to a trot to maintain viability, just as quadruped animals do when they accelerate. And when confronted with successive gaps in the experimental surface, the robot spontaneously switched from trotting to pronking to avoid falls. Moreover, viability was the only factor that was improved by such gait transitions.“We showed that on flat terrain and challenging discrete terrain, viability leads to the emergence of gait transitions, but that energy efficiency is not necessarily improved,” Shafiee explains. “It seems that energy efficiency, which was previously thought to be a driver of such transitions, may be more of a consequence. When an animal is navigating challenging terrain, it’s likely that its first priority is not falling, followed by energy efficiency.”<img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1715299423668-ezgif-3-e8b7f9ed78.jpg" style="width: 100%px;" class="fr-fic fr-dib">Guillaume Bellegarda, Milad Shafiee and Auke Ijspeert. 2024 EPFL/Jamani Caillet - CC-BY-SA 4.0<h2>A bio-inspired learning architecture</h2>To model locomotion control in their robot, the researchers considered the three interacting elements that drive animal movement: the brain, the spinal cord, and sensory feedback from the body. They used DRL to train a neural network to imitate the spinal cord’s transmission of brain signals to the body as the robot crossed an experimental terrain. Then, the team assigned different weights to three possible learning goals: energy efficiency, force reduction, and viability. A series of computer simulations revealed that of these three goals, viability was the only one that prompted the robot to automatically – without instruction from the scientists – change its gait.The team emphasizes that these observations represent the first learning-based locomotion framework in which gait transitions emerge spontaneously during the learning process, as well as the most dynamic crossing of such large consecutive gaps for a quadrupedal robot.“Our bio-inspired learning architecture demonstrated state-of-the-art quadruped robot agility on the challenging terrain,” Shafiee says.The researchers aim to expand on their work with additional experiments that place different types of robots in a wider variety of challenging environments. In addition to further elucidating animal locomotion, they hope that ultimately, their work will enable the more widespread use of robots for biological research, reducing reliance on animal models and the associated ethics concerns.<hr>ReferencesShafiee, M., Bellegarda, G. &amp; Ijspeert, A. Viability leads to the emergence of gait transitions in learning agile quadrupedal locomotion on challenging terrains. Nat Commun 15, 3073 (2024). <a href="https://doi.org/10.1038/s41467-024-47443-w" target="_blank" rel="noopener">https://doi.org/10.1038/s41467-024-47443-w</a>

Guillaume Bellegarda, Milad Shafiee and Auke Ijspeert. 2024 EPFL/Jamani Caillet - CC-BY-SA 4.0

A four-legged robot trained with machine learning by EPFL researchers has learned to avoid falls by spontaneously switching between walking, trotting, and pronking – a milestone for roboticists as well as biologists interested in animal locomotion.

Trotting robots reveal emergence of animal gait transitions

In Singapore, DEEP Robotics, in collaboration with its official partner EGP, is participating in the AMR SPPG Tunnel Project of the Singapore Powergrid (SPPG). This project utilizes quadruped robots for power tunnel inspections and integrates related detection systems to provide early warnings for emergencies. This marks the first time domestically-produced quadruped robots have been involved in overseas power industry applications. The relevant team has conducted extensive training and deployment locally.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzEzNTA2OTA1MDQ4LeWbvueJhzEucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib"><blockquote>“Additionally, in South Korea, a factory production line management project employs DEEP Robotics quadruped robots for line meter recognition, tray handling, and component picking” said Zheng Dongxin, Product Manager of DEEP Robotics.</blockquote><h3>Quadruped Robot Applications in 26 Provinces and Cities in China</h3>Public information shows that DEEP Robotics' industrial-grade quadruped robot has served more than 100 clients in 26 provinces and cities in China including Guangzhou, Beijing, Shanghai, Hebei, Shandong, Zhejiang, Hubei, and Anhui. Moreover, in countries such as Singapore, South Korea and more, several DEEP Robotics industry projects have also been implemented, marking the first overseas industry application of domestically-produced quadruped robots.During the recent Spring Festival, quadruped robots stood guard at a certain ±800kV converter station in Hunan Province. Faced with significantly increased pressure on power guarantee during the Spring Festival, it utilized its superior full-process autonomous inspection capabilities and 24-hour all-weather operation capabilities. Equipped with a dual-light gimbal and a series of equipment modules, it replaced humans in conducting inspections in complex and dangerous industrial environments, helping companies identify potential risks, ensuring the smooth operation of Spring Festival power maintenance, and allowing everyone to celebrate the festival with peace of mind.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzEzNTA2NzY4NjYwLeWbvueJhzIuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib">In a substation in Anhui, the "robot dog + drone" low-altitude integrated intelligent operation and maintenance inspection was carried out, achieving autonomous inspection, automatic defect identification, timely detection of equipment operation abnormalities, and improving the reliable power supply capacity of the substation.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzEzNTA2Nzg1OTMyLeWbvueJhzMucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib">At a power station in Guangdong, quadruped robots conducted inspections tirelessly against wind and rain. Compared with traditional intelligent robots, its inspection point quantity increased by 60%. Equipped with dual-light gimbal cameras, it can identify 30 types of power equipment defects and read 9 types of meter readings. Previously, to achieve full coverage of intelligent equipment in substations, at least 9 intelligent robots were required. Now, with just one quadruped robot, it can be achieved, saving 70% of the investment in intelligent operation and maintenance costs. Unlike drones, quadruped robots have rich external device mounting capabilities. The project team attempted to mount a high-precision force-controlled six-axis mechanical arm on the robot body, enabling it to assist in maintenance, support emergency safety operations, and perform emergency breaker operations with high precision under extreme conditions.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzEzNTA2ODA3OTY4LeWbvueJhzQuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib">In a 220 kV cable tunnel in Fujian, maintenance personnel used quadruped cable inspection robots to comprehensively diagnose the health of power equipment. According to media reports, it can timely detect 95% of cable line surface defects, overheating faults, and channel fires, significantly improving inspection efficiency.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzEzNTA2ODQ0MzExLeWbvueJhzUucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib">At the receiving-end station of a ±1100 kV ultra-high voltage direct current transmission line in Anhui, maintenance personnel used quadruped robots and other intelligent devices to conduct inspections to ensure the safe operation of power equipment. With the help of intelligent AI algorithms, autonomous collection, identification, calculation, and diagnostic analysis of equipment status and other data can be achieved.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzEzNTA2ODY2MjIwLeWbvueJhzYucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib">In the 8-meter underground power gallery in Hangzhou, since the 19th Asian Games, DEEP Robotics’ quadruped robots have been working for more than half a year. State Grid Zhejiang Electric Power Research Institute, DEEP Robotics, MY Software, and other units have collaborated to perceive the environmental conditions such as temperature and humidity, harmful gas concentrations, and smoke density in the gallery through quadruped robots, and real-time monitoring of cable operation indicators such as protective layer circulation, partial discharge, and operating temperature. With the help of daily intelligent autonomous inspection and weekly intelligent active detection of new equipment, staff only need to inspect once every six months and conduct live measurements once a year, making the work process more streamlined and the inspection results more accurate.Looking at the world, as the wave of "Robot + AI" sweeps across the globe, global industry giants are also accelerating digitization and preparing for quadruped robot industry application projects. Whether the application potential of quadruped robots will explode in 2024 remains to be seen, but it is worth looking forward to! Additionally, DEEP Robotics (Hall 5 D46-3) is set to participate in the Hannover Messe in Germany from April 22nd to 26th. At the event, the quadruped robot will make its debut, showcasing its capabilities. Industrial scenes often involve significant dangers and tedious tasks. Challenges such as stairs, outdoor harsh weather conditions, extreme temperatures, darkness, and other adverse environments hinder traditional robots from entering industrial sites for operations. However, DEEP Robotics' quadruped robot can effectively address these issues.

In Singapore, DEEP Robotics, in collaboration with its official partner EGP, is participating in the AMR SPPG Tunnel Project of the Singapore Powergrid. This project utilizes quadruped robots for power tunnel inspections and integrates related detection systems to provide warnings for emergencies.

DEEP Robotics Lands Applications in Singapore and South Korea! Will Quadruped Robots Experience an Application Boom?

The New B2 and Go2

A Look at the Newest Unitree Quadrupeds

<h3 id="isPasted"><iframe width="640" height="360" src="https://www.youtube.com/embed/Qozjbn0nE-I?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe></h3><h3>Background</h3>Cable tunnels are essential for urban power transmission, especially for ultra-high-voltage cables requiring complex networks and flexible layouts. However, cable tunnels also face many challenges in terms of construction and maintenance, such as seepage, gas explosion, dust pollution, and partial discharge.&nbsp;Traditional cable tunnel inspection methods are labour-intensive, time-consuming, subjective, and unsafe. They usually involve many trained operators to conduct regular inspections for hours, shortening the time for analyzing reports for the day. Moreover, the operators have to enter the tunnel environment that may be full of poisonous gases, high-voltage cables, and other electrical equipment, which greatly threatens their health and safety.Therefore, there is an urgent need for a new technology that can improve the efficiency, accuracy, and safety of cable tunnel inspection. <h3 id="isPasted"><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjg5MDY1NTc3NjMxLURlZXAgUm9ib3RpY3MgMS5wbmciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 766px;" class="fr-fic fr-dib">X20 has the capability to traverse rugged terrain Solution</h3>DEEP Robotics is a leading company in the field of quadruped robot industrial applications in China, which cooperates with Jiangsu Mingyue Software Technology to develop an intelligent cable tunnel inspection system that integrates various detection methods such as partial discharge, temperature detection, video monitoring, and defect warning. The system uses a four-legged robot equipped with partial discharge sensors on the robotic arm and a Bi-spectrum camera to inspect multiple cables along a planned route in the tunnel environment and upload the data in real-time. The system can greatly reduce the number of times and frequency of inspection personnel entering the cable tunnel and improve maintenance efficiency and safety.The X20 robot dog can perform automatic inspection tasks according to the preset path and tasks. During the inspection, the robot uses LiDAR and depth cameras to detect the terrain and can turn around, climb stairs and obstacle avoidance. The six-degree-of-freedom robotic arm can flexibly perform cable detection work with trajectory restorations in a narrow tunnel space.The partial discharge detection device can detect discharge signals from 0 MHz to 100 MHz, and accurately identify surface discharge, corona discharge and internal discharge of cables within 200 meters, providing early warning of risks to ensure safe operation.&nbsp;The Bi-spectrum camera features video monitoring and infrared temperature scouting for video and photo capture, identifying temperature differences with an AI algorithm to find out overheated points for early warning.All collected data can be transmitted to the server in real-time through network devices and timely synchronize information with the staff responsible for monitoring in the background, providing data support for further decision analysis for maintenance personnel. <img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjg5MDY1NjU1NTgwLURlZXAgUm9ib3RpY3MgMy5wbmciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 766px;" class="fr-fic fr-dib">Partial discharge detection with a robotic arm <h3>Benefits</h3>The X20 intelligent cable tunnel inspection system with mobile partial discharge detection has brought many benefits to the power industry, such as:&bull; &nbsp; &nbsp;Improving the efficiency of cable tunnel inspection by reducing the time of inspection and data analysis.&bull; &nbsp; &nbsp;Improving the accuracy of cable tunnel inspection by using objective and quantitative data from multiple sensors instead of relying on subjective and qualitative judgments from human operators.&bull; &nbsp; &nbsp;Improving the safety of cable tunnel inspection by minimizing the exposure of human operators to hazardous environments such as poisonous gases, high-voltage cables, and other electrical equipment.&bull; &nbsp; &nbsp;Improving the reliability and safety of the power supply by detecting and preventing potential faults caused by partial discharge in advance, avoiding fire or breakdown accidents.

The X20 robot dog can perform automatic inspection tasks according to the preset path and tasks. During the inspection, the robot uses LiDAR and depth cameras to detect the terrain, and has the ability to turn around, climb stairs, and obstacle avoidance. 

How X20 Robot Dog Intelligent Cable Tunnel Inspection System Complete Mobile Detection

Jueying X20 can complete unmanned detection and rescue tasks in harsh conditions

With the flexibility to deliver unmanned detection and rescue services, Jueying X20 is designed for the complex terrain of a post-earthquake landscape, the insides of vulnerable debris buildings, tunnel traffic accidents, and in toxic, hypoxia, and high-density smoke environments created by chemical pollution or disaster event.

Jueying X20 Robot Dog Hazard Detection Rescue Solution

This article was first published on&nbsp;<a href="https://news.mit.edu/2023/legged-robotic-system-playing-soccer-various-terrains-0403" id="isPasted" rel="noopener noreferrer" target="_blank">MIT News</a>. &nbsp;<hr>If you&#39;ve ever played soccer with a robot, it&#39;s a familiar feeling. Sun glistens down on your face as the smell of grass permeates the air. You look around. A four-legged robot is hustling toward you, dribbling with determination.&nbsp;While the bot doesn&rsquo;t display a Lionel Messi-like level of ability, it&#39;s an impressive in-the-wild dribbling system nonetheless. Researchers from MIT&#39;s Improbable Artificial Intelligence Lab, part of the Computer Science and Artificial Intelligence Laboratory (CSAIL), have developed a legged robotic system that can dribble a soccer ball under the same conditions as humans. The bot used a mixture of onboard sensing and computing to traverse different natural terrains such as sand, gravel, mud, and snow, and adapt to their varied impact on the ball&rsquo;s motion. Like every committed athlete, &quot;DribbleBot&quot; could get up and recover the ball after falling.&nbsp;Programming robots to play soccer has been an active research area for some time. However, the team wanted to automatically learn how to actuate the legs during dribbling, to enable the discovery of hard-to-script skills for responding to diverse terrains like snow, gravel, sand, grass, and pavement. Enter, simulation.&nbsp;A robot, ball, and terrain are inside the simulation &mdash; a digital twin of the natural world. You can load in the bot and other assets and set physics parameters, and then it handles the forward simulation of the dynamics from there. Four thousand versions of the robot are simulated in parallel in real time, enabling data collection 4,000 times faster than using just one robot. That&#39;s a lot of data.&nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/bV4ek-zI3CU?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe>Video: MIT CSAIL&nbsp;The robot starts without knowing how to dribble the ball &mdash; it just receives a reward when it does, or negative reinforcement when it messes up. So, it&#39;s essentially trying to figure out what sequence of forces it should apply with its legs. &quot;One aspect of this reinforcement learning approach is that we must design a good reward to facilitate the robot learning a successful dribbling behavior,&quot; says MIT PhD student Gabe Margolis, who co-led the work along with Yandong Ji, research assistant in the Improbable AI Lab. &quot;Once we&#39;ve designed that reward, then it&#39;s practice time for the robot: In real time, it&#39;s a couple of days, and in the simulator, hundreds of days. Over time it learns to get better and better at manipulating the soccer ball to match the desired velocity.&quot;&nbsp;The bot could also navigate unfamiliar terrains and recover from falls due to a recovery controller the team built into its system. This controller lets the robot get back up after a fall and switch back to its dribbling controller to continue pursuing the ball, helping it handle out-of-distribution disruptions and terrains.&nbsp;&quot;If you look around today, most robots are wheeled. But imagine that there&#39;s a disaster scenario, flooding, or an earthquake, and we want robots to aid humans in the search-and-rescue process. We need the machines to go over terrains that aren&#39;t flat, and wheeled robots can&#39;t traverse those landscapes,&quot; says Pulkit Agrawal, MIT professor, CSAIL principal investigator, and director of Improbable AI Lab.&quot; The whole point of studying legged robots is to go terrains outside the reach of current robotic systems,&quot; he adds. &quot;Our goal in developing algorithms for legged robots is to provide autonomy in challenging and complex terrains that are currently beyond the reach of robotic systems.&quot;&nbsp;The fascination with robot quadrupeds and soccer runs deep &mdash; Canadian professor Alan Mackworth first noted the idea in a paper entitled &quot;On Seeing Robots,&quot; presented at VI-92, 1992. Japanese researchers later organized a workshop on &quot;Grand Challenges in Artificial Intelligence,&quot; which led to discussions about using soccer to promote science and technology. The project was launched as the Robot J-League a year later, and global fervor quickly ensued. Shortly after that, &quot;RoboCup&quot; was born.&nbsp;Compared to walking alone, dribbling a soccer ball imposes more constraints on DribbleBot&#39;s motion and what terrains it can traverse. The robot must adapt its locomotion to apply forces to the ball to &nbsp;dribble. The interaction between the ball and the landscape could be different than the interaction between the robot and the landscape, such as thick grass or pavement. For example, a soccer ball will experience a drag force on grass that is not present on pavement, and an incline will apply an acceleration force, changing the ball&rsquo;s typical path. However, the bot&#39;s ability to traverse different terrains is often less affected by these differences in dynamics &mdash; as long as it doesn&#39;t slip &mdash; so the soccer test can be sensitive to variations in terrain that locomotion alone isn&#39;t.&nbsp;&quot;Past approaches simplify the dribbling problem, making a modeling assumption of flat, hard ground. The motion is also designed to be more static; the robot isn&rsquo;t trying to run and manipulate the ball simultaneously,&quot; says Ji. &quot;That&#39;s where more difficult dynamics enter the control problem. We tackled this by extending recent advances that have enabled better outdoor locomotion into this compound task which combines aspects of locomotion and dexterous manipulation together.&quot;On the hardware side, the robot has a set of sensors that let it perceive the environment, allowing it to feel where it is, &quot;understand&quot; its position, and &quot;see&quot; some of its surroundings. It has a set of actuators that lets it apply forces and move itself and objects. In between the sensors and actuators sits the computer, or &quot;brain,&quot; tasked with converting sensor data into actions, which it will apply through the motors. When the robot is running on snow, it doesn&#39;t see the snow but can feel it through its motor sensors. But soccer is a trickier feat than walking &mdash; so the team leveraged cameras on the robot&#39;s head and body for a new sensory modality of vision, in addition to the new motor skill. And then &mdash; we dribble.&nbsp;&quot;Our robot can go in the wild because it carries all its sensors, cameras, and compute on board. That required some innovations in terms of getting the whole controller to fit onto this onboard compute,&quot; says Margolis. &quot;That&#39;s one area where learning helps because we can run a lightweight neural network and train it to process noisy sensor data observed by the moving robot. This is in stark contrast with most robots today: Typically a robot arm is mounted on a fixed base and sits on a workbench with a giant computer plugged right into it. Neither the computer nor the sensors are in the robotic arm! So, the whole thing is weighty, hard to move around.&quot;There&#39;s still a long way to go in making these robots as agile as their counterparts in nature, and some terrains were challenging for DribbleBot. Currently, the controller is not trained in simulated environments that include slopes or stairs. The robot isn&#39;t perceiving the geometry of the terrain; it&#39;s only estimating its material contact properties, like friction. If there&#39;s a step up, for example, the robot will get stuck &mdash; it won&#39;t be able to lift the ball over the step, an area the team wants to explore in the future. The researchers are also excited to apply lessons learned during development of DribbleBot to other tasks that involve combined locomotion and object manipulation, quickly transporting diverse objects from place to place using the legs or arms.&ldquo;DribbleBot is an impressive demonstration of the feasibility of such a system in a complex problem space that requires dynamic whole-body control,&rdquo; says Vikash Kumar, a research scientist at Facebook AI Research who was not involved in the work. &ldquo;What&rsquo;s impressive about DribbleBot is that all sensorimotor skills are synthesized in real time on a low-cost system using onboard computational resources. While it exhibits remarkable agility and coordination, it&rsquo;s merely &#39;kick-off&rsquo; for the next era. Game-On!&rdquo;The research is supported by the DARPA Machine Common Sense Program, the MIT-IBM Watson AI Lab, the National Science Foundation Institute of Artificial Intelligence and Fundamental Interactions, the U.S. Air Force Research Laboratory, and the U.S. Air Force Artificial Intelligence Accelerator. The paper will be presented at the 2023 IEEE International Conference on Robotics and Automation (ICRA).<hr>&quot;Reprinted with permission of&nbsp;<a href="https://news.mit.edu/2023/legged-robotic-system-playing-soccer-various-terrains-0403" id="isPasted" rel="noopener noreferrer" target="_blank">MIT News</a>&quot; &nbsp;

Researchers created DribbleBot, a system for in-the-wild dribbling on diverse natural terrains including sand, gravel, mud, and snow using onboard sensing and computing. In addition to these football feats, such robots may someday aid humans in search-and-rescue missions. Photo: Mike Grimmett/MIT CSAIL

“DribbleBot” can maneuver a soccer ball on landscapes such as sand, gravel, mud, and snow, using reinforcement learning to adapt to varying ball dynamics.

A four-legged robotic system for playing soccer on various terrains

Coordinated Movement has always been one of the primary challenges to tackle in robotics. Locomotion and manipulation are the two main concepts of movement. Locomotion describes the method a robot uses to transport itself from one place to another. This can take the form of legged, wheeled, or tracked motion. Manipulation, on the other hand, describes the manner in which a robot interacts with objects around it. That includes grabbing an object, picking something up, throwing something, or even opening a door.For years, researchers and engineers have studied ways to control locomotion and manipulation simultaneously. Particularly for legged robots, attaching an arm can enable them to perform several mobile manipulation tasks that wheeled or tracked robots cannot perform. The conventional way of controlling such legged manipulators has been to control locomotion and manipulation separately - otherwise known as decoupling mobility and manipulation. While this method has its perks, it does require a lot of engineering efforts to maintain sufficient coordination between the legs and the arm.&nbsp;&nbsp;<iframe id="638d493a4c420f000872b315" width="250" class="specs-iframe" height="400" src="https://wevolver.com/iframe/specs/unitree-robotics-go1-edu-plus?iframe=true" frameborder="0" scrolling="true" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe>Researchers refer to modeling an arm-carrying legged robot as &ldquo;a dynamic, high-degree-of-freedom, and non-smooth control problem.&rdquo; This means the complexity of such a model would limit its operation to within specified settings. Venturing into different real-life scenarios would make it increasingly complex and burdensome, and errors can arise, leading to undesirable and unnatural movements.This has driven engineers to explore different methods that can bring synergy between the limbs in a way that resembles biologically coordinated movement. Think of the way your arms and legs move and how interconnected they are. For instance, it is difficult to move your left arm and your left leg in different motions while standing. The same applies to your right side. Or consider the activity of picking up something on the ground. Your legs and arm would work together to help you reach the object and pick it up. This is referred to as interlimb neural coupling. In simpler terms, it is called whole-body control. It allows for coordination between the limbs and the extension of the capabilities of individual parts. In a similar sense, researchers at Carnegie Mellon University have successfully developed a unified policy that governs an arm-carrying legged robot in a whole-body control manner using the concept of reinforcement learning (RL). This allowed them to train the robot to synergize its locomotion and manipulation and perform specific tasks through a dynamic and agile behavior.<iframe width="640" height="360" src="https://www.youtube.com/embed/t6NoCx_zitM?autoplay=1&mute=1&wmode=opaque&rel=0" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe><h2 dir="ltr" id="isPasted">A Unified Policy for Coordinated Locomotion and Manipulation</h2>Earlier this year, Zipeng Fu, Xuxin Cheng, and Deepak Pathak from Carnegie Mellon University[1] set out to test whether a learning-based, unified policy would outperform existing decoupling techniques in controlling a robot&rsquo;s movement and ability to interact with its surrounding. As they explained, hierarchy-based decoupled and semi-coupled control methods have been ineffective due to a &ldquo;lack of coordination between the arm and legs, error propagation across modules, and slow, non-smooth and unnatural motions.&rdquo;The unified policy was based on a machine-learning training concept called reinforcement learning (RL). This method simply rewards desirable behaviors and punishes undesirable ones. Through RL, the robot would learn by trial and error to perceive and analyze its environment and act accordingly.The study comprised simulation experiments, which were then transferred into real-world experimentation. However, three distinct issues made it challenging beyond the standard RL model of training in simulation and transferring to the real world:<ol><li dir="ltr">Multiple degrees of freedom (12 DoFs in the quadruped robot and 6 DoF in the attached arm)</li><li dir="ltr">Conflicting objectives in mobility and weight balance</li><li dir="ltr">Dependency between manipulation and locomotion&nbsp;&nbsp;</li></ol>This is why Fu et al. proposed adding&nbsp;regularized online adaptation&nbsp;to bridge the so-called Sim2Real gap - i.e., the information gap between the skills acquired in simulation and those transferred to the real-world system; also referred to as the&nbsp;realizability gap. Regularization is a machine learning technique that helps calibrate the model and minimize the deviation between the model and the dataset, thus minimizing the realizability gap. This adaptation helps eliminate the conventional, two-phase, teacher-student scheme used in previous Sim2Real transfer applications. This is where a &ldquo;teacher network&rdquo; is trained by RL in simulation using full-state information, and a &ldquo;student network&rdquo; attempts to imitate it in real life based on partial information from onboard observations.&nbsp;<iframe id="6389f2641a0dc20008fdb9d3" width="250" class="specs-iframe" height="400" src="https://wevolver.com/iframe/specs/interbotix-widowx-250-6dof?iframe=true" frameborder="0" scrolling="true" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe>The researchers also tackled the dependency issue by proposing the concept of&nbsp;advantage mixing. Advantage functions describe how much a particular action is a good or bad decision given a specific state. Knowing that locomotion tasks mostly rely on leg activity and manipulation tasks on arm activity, mixing the advantage functions of both locomotion and manipulation can help encourage and boost the robot&rsquo;s learning of the unified policy.<h2 dir="ltr">A Low-Cost Legged-Robot with Whole-Body Control</h2>The researchers presented a simple design for the legged manipulator made of the following elements:<ol><li dir="ltr">A 4-legged robot platform</li><li dir="ltr">A robot arm on top of the platform</li><li dir="ltr">An RGB camera positioned next to the gripper of the arm</li><li dir="ltr">An onboard battery to power the arm and the quadruped robot</li></ol><h2 dir="ltr">Robust Unified Policy in Simulation and Real World</h2>With this design, they were able to show in the simulation experiments an increase in whole-body coordination as the legs helped the arm reach beyond its own workspace by bending to reach lower objects (e.g. picking up a cup) and standing up high to reach higher objects (e.g. wiping a whiteboard). Similarly, the arm helped the legs maintain balance even under relatively large disturbances (e.g. running with an initial speed of 1 m/s). This demonstrates a solid unified policy with a high survival rate.Advantage mixing also helped the policy focus on each task and then combine them to induce a mechanism that boosts training. Furthermore, the proposed regularized adaptation resulted in improved performance and better prediction of the environment, as errors at the level of the gripper dropped by 20% compared to other systems, such as the two-phase teacher-student scheme.As for the real-world experiments, the researchers studied three activities: teleoperation using joysticks, closed-loop control through RGB vision-guided tracking, and open-loop response to human demonstrations.<ul><li dir="ltr">For teleoperation, the researchers used two joysticks to command the end-effector (gripper) to reach particular points even beyond the space of training. They found out that both the leg and arm joints coordinated to help the end-effector reach those points.</li><li dir="ltr">During vision-guided tracking, the RGB camera was used alongside the joystick control to provide visual feedback to the robot and improve its picking tasks. It showed repeated success on both easy and hard tasks.</li><li dir="ltr">In the open-loop control experiments, the researchers tested the coupling of the robot&rsquo;s agile locomotion with its dynamic arm movement. They commanded the end-effector to follow a predefined path while the robot was walking. The results showed dynamic coordination even while walking on an uneven grass area.</li></ul><iframe width="640" height="360" src="https://www.youtube.com/embed/zhpI3JTqQGI?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe> <h2 dir="ltr">How the Unified Policy Approach be Further Expanded</h2>The success of the unified policy opens up a new scope of coordinated robotic movement. As the researchers suggested, those results are merely preliminary. Further exciting research is expected to stem from this work, such as enabling the robot to climb on a table using its front legs to pick something up from atop the table. Another suggestion was to mount a camera onto the center of the torso, providing different visual feedback, which would pave the road for vision-based policy learning.<a href="https://manipulation-locomotion.github.io/" target="_blank">Read the full study and learn more about the exciting research of Fu et al. by visiting their dedicated website.</a>1.&nbsp;Zipeng , F., Cheng, X. and Pathak, D. (2022) &ldquo;Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion ,&rdquo;&nbsp;CoRL 2022 Conference Paper&nbsp;[Preprint].&nbsp;

Could this be the time we say goodbye to robotic awkwardness and hello to seamless motion? This article highlights the groundbreaking concept of whole-body control, a coordinated robotic motion technique that resembles natural movement. Imagine a robot smoothly navigating its environment, performing tasks with grace and precision. This innovative approach allows for improved efficiency and greater versatility in real-world settings.


Unifying Robotic Arm and Leg Movement for Whole-Body Control

DEEP Robotics recently released its newest robotics technique, of autonomous coordinated multi-robot exploration; the experiment occurred in a 3,000 m2&nbsp;unknown environment with five Jueying X20 robot dogs. The experiment accomplished the coordinated exploration of eight targets along with its fully autonomous decision-making and planning. The purpose of the experiment is to seek out the infinite applicable potentials in the field of rescue and exploration. &nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjY3NDY4NDc4NTMzLTE2Njc0Njg0Nzg1MzMucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 766px;" class="fr-fic fr-dib">Multiple Jueying robot dogs exploring under unknown environments togetherDuring rescue and exploration, collecting information is often found insufficient in manned operations; operators often encounter difficult situations such as anoxia, toxic gas, landslip, etc. The quadruped robot can assist or replace operators to get into the complex and hazardous areas that wheel or tracked robots have difficulties accessing. The technique of coordinated quadruped robot exploration explored information and paths shared between robots, which enhanced exploration efficiency under unknown environments.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjY3NDY4NTU0MTQ0LTE2Njc0Njg1NTQxNDQucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 766px;" class="fr-fic fr-dib">Jueying X20 discovered and recognized the targetThe technique of autonomous exploration under an unknown environment is a frontier in the research of robotics, in which specific movement coordination, like robot dance, is unable to compare with its quality and difficulty. Jueying robots were equipped with a high-resolution omnidirectional camera, Lidar, and mesh network during the experiment. The robots build the map together by Lidar and locating algorithm; they use the omnidirectional camera for deep learning and target recognition. Each robot dog autonomously assigns its unexplored area in real-time by the cooperative mechanism. In the progress of exploration, robots autonomously planned workable paths for obstacle avoidance; eventually pulled off coordinated robot exploration and target recognition in a largely unknown area.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjY3NDY4NTc0NDMzLTE2Njc0Njg1NzQ0MzMucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 766px;" class="fr-fic fr-dib">Jueying X20 robots share information through tracked signalsTang Wei, the manager of the Perception algorithm department, introduced: The key to an efficient, coordinated exploration is the cooperative algorithm. The robots share the simplest and most useful information, which can gradually reduce bandwidth communication cost and enhance the system&#39;s adaptability under Bandwidth-constrained Conditions. The research was issued 2022 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR2022).<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjY3NDY4NjAwODA0LTE2Njc0Njg2MDA4MDQucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 766px;" class="fr-fic fr-dib">5 Juying X20 robot dogs share the boundary of explored area with each otherDEEP Robotics is a leading quadruped robot company in Asia; the self-developed &quot;Jueying&quot; series robots are already applied in power inspection, public rescue, discovery, and other applicable fields with its advanced locomotion control algorithm, environmental perception, and AI algorithm. Besides the coordinated multi-robot exploration, DEEP Robotics has tried corporative operation with other forms of robots from the Huzhou institute of Zhejiang University in the &quot;yellow dragon&quot; cave.

DEEP Robotics recently released its newest robotics technique, which is autonomous coordinated multi-robot exploration; the experiment is operated under a 3,000 m2 unknown environment with five Jueying X20 robot dogs.

Coordinated multi-robot dog exploration in unknown environment

It would be awesome to have robots that can help us do important things, like aid disaster recovery efforts or monitor the environment. In the case of quadrupeds, robots that walk on four legs, their mobility requires many software components to work together seamlessly. It&rsquo;s a drag when all your time is spent on developing lower-level infrastructure instead of focusing on high-level behaviors. <a href="https://engineering.cmu.edu/directory/bios/johnson-aaron.html" id="isPasted" target="_blank">Aaron Johnson</a>&rsquo;s <a href="https://www.cmu.edu/me/robomechanicslab/" rel="noopener" target="_blank">Robomechanics Lab</a> experienced these frustrations firsthand. His team often had to rely on simple models for doing research because existing software solutions were not open sourced, did not provide a modular framework, and lacked end-to-end functionality.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjU5NzE4NTkzNzMxLTA3MjYtZW0tMS1xdWFkcnVwZWQucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 766px;" class="fr-fic fr-dib">A four-legged robot using Quad-SDK software is shown jumping. Source:&nbsp;Carnegie Mellon University/Robomechanics Lab&nbsp;An example of innovation born out of necessity, Johnson, an associate professor of <a href="https://www.meche.engineering.cmu.edu/index.html" id="isPasted" rel="noopener" target="_blank">mechanical engineering</a>, and his team designed their own locomotion software stack, <a href="https://github.com/robomechanics/quad-sdk" rel="noopener" target="_blank">Quad-SDK</a>, a full-stack framework for agile quadrupedal locomotion. Many graduate students have contributed to the development of the software across a two-year period, but it was time well spent. Their design can simplify the development process for roboticists everywhere because it uses an open-source license, meaning the software can be used and modified as the user wishes. Quad-SDK comes ready to use, so researchers don&rsquo;t have to worry about implementing the necessary tools and infrastructure; instead, they can get right to work on exciting behaviors and applications.&nbsp;<iframe src="https://www.youtube.com/embed/kSXKjTxKpuA?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" style="width: 767px; height: 430px;"></iframe>Unlike other options, Quad-SDK is also compatible with the Robot Operating System (ROS). ROS is a middleware, somewhere between hardware and software, that lets different parts of a system talk to each other. For example, if a robot senses an obstacle in its path and needs to transfer information from its perception module to its decision-making module, ROS is what enables that communication. Imagine an app that doesn&rsquo;t use iOS or Android&mdash;it&rsquo;s much simpler when everything works together.Locomotion is a layered problem, as team member and Ph.D. student Ardalan Tajbakhsh describes it. &ldquo;In order to do anything meaningful on a robot, you need to have many components working together seamlessly.&rdquo; Quad-SDK provides a framework for robotics researchers and developers to focus their efforts on the core algorithms instead of the software tooling and infrastructure.<blockquote>In order to do anything meaningful on a robot, you need to have many components working together seamlessly. - Ardalan Tajbakhsh, Ph.D. student, Mechanical Engineering&nbsp;</blockquote>Other software packages are very good at solving one component, like motion planning, but it&rsquo;s critical to have end-to-end frameworks that provide the necessary algorithms, tools, and infrastructure for performing high-quality robotics research. Quad-SDK is full stack, meaning it contains every level of the hierarchy that affects quadruped locomotion, starting with global planning. This layer sits at the top of the stack; Tajbakhsh compares it to Google Maps, because it chooses where the robot should roughly go to reach its destination. The next layer, local planner, is what decides the specifics of the route, like where the robot should place its feet. This culminates in a third layer, the robot driver, which sends commands to the quadruped&rsquo;s joints to execute the desired motion.In the weeks since Quad-SDK <a href="https://leggedrobots.org/contributions.html" rel="noopener" target="_blank">won a Best Paper Award</a> at the Workshop on Legged Robots at the 2022 IEEE International Conference on Robotics and Automation (ICRA), people have already requested to use it, a clear indicator of how useful its solutions are and how the open-source format invites collaboration within the robotics community. Figuratively and literally, Quad-SDK can go many places.

Aaron Johnson’s Robomechanics Lab has developed an open-source software that enables more agile movement in legged robots.

Open-source software gives a leg up to robot research

A praying mantis for the moon, Mars and meteorites: the mantis-like robot "Mantis" is said to be able to independently explore planets and build an infrastructure with its claws. The hardware and software are developed by scientists from the Robotics Innovation Center at the German Research Center for Artificial Intelligence (DFKI) and the University of Bremen.&nbsp;Thanks to his bio-inspired body and various running patterns, he will master steep craters and boulder fields as well as manipulate with his front legs.&nbsp;By learning from his experiences, he should be able to act purposefully.&nbsp;The LIMES project that has just started is being funded with around 3.7 million euros by the German Aerospace Center (DLR).&nbsp;The term is four years.&nbsp;LIMES stands for “Learning Intelligent Motions for Kinematically Complex Legged Robots for Exploration in Space”. The name of the robot is borrowed from the mantis, which belongs to the mantis order.&nbsp;The robot morphology will be similar to that of the natural model: the system should not only be able to use the two front of its six legs to walk, but also to grab objects.&nbsp;To do this, it lifts its upper body – like the praying mantis. "The challenge is to learn running patterns for different ground conditions in which all six legs work in unison despite different tasks," explains Prof. Dr.&nbsp;Frank Kirchner, head of the DFKI Robotics Innovation Center and the Robotics working group at the University of Bremen.&nbsp;The many joints, distributed over several legs, enable many different movement patterns.&nbsp;In this way, the robot can adapt its posture to the circumstances – and maneuver safely in unfamiliar terrain. Robot selects situationally from its "behaviour library" The aim of the project is to give the robot algorithms for different walking modes.&nbsp;These can be designed for energy-saving or careful movement.&nbsp;Mantis senses stumbling blocks, craters and hills with tactile sensors that he wears in his soles.&nbsp;Using a camera in his head, he creates a 3D image of the environment.&nbsp;The data is transmitted to earth by satellite.&nbsp;The human instructs the robot which destination to head for.&nbsp;"Based on the data, Mantis selects the appropriate walking pattern from its so-called behavior library.&nbsp;It recognizes obstacles and then avoids them of its own accord,” says Sebastian Bartsch, DFKI computer scientist and project manager.&nbsp;After each action, the robot evaluates its decision.&nbsp;“For example, he asks himself: Was my energy use good?&nbsp;If not, he will act differently in a similar situation in the future,” says Bartsch. The movement patterns are pre-learned in simulations that simulate extraterrestrial conditions: gravitation, lighting conditions, gradients. Real tests follow in the DFKI's space exploration hall, a 288 square meter test site with an artificial crater landscape.&nbsp;

Inspired by the mantis: Robot "Mantis" will not only be able to walk with its front legs, but also to manipulate.

A praying mantis for the moon, Mars and meteorites: the mantis-like robot "Mantis" is said to be able to independently explore planets and build an infrastructure with its claws. 

The Praying Mantis As A Model - Six-Legged Robot To Build Infrastructure On Celestial Bodies

The Spacebit Engineering Challenge enables engineers around the world to contribute to the development of “Asagumo 2.0”, a four-legged walking rover that is set to fly to the Moon with the NASA Commercial Lunar Payload Services (CLPS) program in 2021 and 2022.Spacebit is a UK-based space startup developing space robotic technology and space data analytics tools for space exploration that includes advanced micro robotics and Artificial Intelligence (AI). Their approach to engineering is to deliver competitive cost solutions for the exploration of celestial bodies.Spacebit's goal is to create new opportunities for industry, academia, and government, advancing the future development of a new infrastructure and commercial resource exploration ‘offworld’ - &nbsp;beginning with the Moon.The company's micro-rover technologies and rover deployment systems are designed to carry scientific payloads in support of the Artemis Program space exploration and research goals. Spacebit is the only commercial company to secure two consecutive NASA Commercial Lunar Payload Services (CLPS) delivery missions to the Moon in 2021. Spacebit is one of the first commercial lunar companies that plans to fly on every NASA CLPS delivery on the market.Future versions of the rover would be sent to explore tubular cave structures – subsurface tunnels, believed to have been formed by ancient basaltic lava flows – to see if they are viable locations in which to build future lunar habitats for human presence on the moon.<iframe src="https://www.youtube.com/embed/QSGFL4W1guk?&amp;feature=emb_title&amp;ab_channel=SpacebitCompany&amp;wmode=opaque&amp;rel=0" frameborder="0" allowfullscreen="" class="fr-draggable" style="width: 788px; height: 406px;"></iframe><h2 dir="ltr">Contribute and get your name on the Moon</h2>Over the next several weeks Spacebit will invite the Wevolver community in an open format, for inputs and ideas on various engineering challenges as they develop new rover designs and technologies for space-based applications, beginning with the Moon. The technical feedback will be used to help improve and iterate Spacebit’s technology.The engineering inputs will be assessed and the most valuable contributors will be rewarded by having their name engraved on the Asagumo rover before it launches on its maiden journey to the Moon. Additionally, the winning engineer will be invited to the control room in the UK or US; or, participate in Spacebit’s remote Robotic Operations &amp; Control Center (ROCC). <div class="fr-img-space-wrap"><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjIzMzMzNTM3MDkwLVNwYWNlYml0LTZiLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6OTUwLCJmaXQiOiJjb3ZlciJ9fX0=" style="width: 788px;" class="fr-fic fr-dib">The winner of the challenge will have their name engraved on the rover and be invited to the launch control room. Image credit: Spacebit/Wevolver.<h2 class="fr-img-space-wrap2">Asagumo</h2></div>Asagumo is a semi-autonomous micro rover built on a single-unit CubeSat frame, usually used for micro &nbsp;satellites. The &nbsp;rover weighs just 1.3 kilograms, is solar-powered and instead of wheels or tracks, is equipped with four spider-like legs. Mission 1 is a tech demo mission where Asagumo is equipped with sensors and camera technology; the rover will attempt to walk for ≤10 meters on the lunar surface, sending data back to Earth. The goal is to eventually explore the moon’s subsurface through the labyrinth of lunar lava tubes and caves. Because of its four legs rather than wheels or tracks, the rover has an advantageous design to explore parts of the Moon other rovers &nbsp;cannot reach.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjIzMjUzNTcyMTE4LVNwYWNlYml0LTEuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 788px;" class="fr-fic fr-dib" alt="A small square gold rover robot with four black spider-like legs.">The Asagumo micro rover is built on a single-unit CubeSat frame. Image credit: Spacebit.&nbsp;<h2 class="fr-img-space-wrap2">How to contribute?</h2>Joining the discussion is simple. On Wevolver's social media channels, we will share regular updates regarding the progress of the project. Spacebit will ask for feedback on engineering challenges they have on which you can comment and engage with. To make sure you stay in the loop, follow their company profile on <a href="https://www.wevolver.com/profile/spacebit" target="_blank">Wevolver</a>.We're excited to see your feedback, and look forward to seeing the first Wevolver community member inscribed on the Moon!

Contribute to the development of a four-legged walking rover that is set to fly to the Moon with NASA in 2021 and 2022.

The Spacebit Engineering Challenge

<div data-wow-delay=".09s">A frenetic, hopping rodent is giving University of Michigan engineers new ways to think about and design two-legged robots.Biologists and engineers from U-M, Harvard University and the University of California, San Diego used information theory to, for the first time, quantify the entropy in an animal’s gait in three dimensions. The team’s findings, published in Nature Communications on Sept. 5, could help engineers make biomimetic robots that are tailored to specific environments.“This work points at a new way of building a robot that may be useful in navigating desert environments or desert planets,” said <a href="https://me.engin.umich.edu/people/faculty/ramanarayan-vasudevan" rel="noopener noreferrer" target="_blank">Ram Vasudevan</a>, U-M assistant professor of mechanical engineering and a co-author of the paper. “We want to try and build robots that are capable of thriving in all sorts of environments.”He recalled a time when NASA’s wheeled Curiosity rover got stuck in the Martian desert.“It dug a deeper and deeper hole,” Vasudevan said. “What if they had taken a look at how these rodents travel through the desert? Evolution has found a suitable solution several times over. Until now, we haven’t appreciated how useful a system it is in this context.”<iframe src="https://www.youtube.com/embed/35MSBu7-mk0?&amp;wmode=opaque" allowfullscreen="" class="fr-draggable" style="width: 800px; height: 421px;" frameborder="0"></iframe>The researchers explain their approach to studying the jerboa and its future applications to robotics. Video: Evan Dougherty, Michigan Engineering Communications &amp; Marketing.<div data-wow-delay=".09s">For biologists seeking to understand the ecological structure of animal communities, the findings also show how sudden changes in direction, gait and speed help the jerboa—a bipedal desert rodent—elude hungry predators and gain a competitive edge over their quadrupedal neighbors. The researchers compared the behavior of jerboas to jirds, which have four legs and are in the gerbil family.<h4>Entropy is the answer</h4>The jerboa is native to North Africa and Central Asia. Although bipedalism has evolved multiple times in rodents—including kangaroo rats and Australian hopping mice—jerboas are the only group to use three different gaits when moving on their long hind legs: hopping, skipping and running. They can leap more than half a meter high, which is about ten times their hip height.Talia Moore, a postdoctoral research fellow in the U-M Department of Ecology and Evolutionary Biology, was tasked with characterizing the jerboa’s locomotion and comparing it to other bipedal animals.<img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1563294792374-jerboa-gif-5.gif" style="width: 766px;" class="fr-fic fr-dib">IMAGE: &nbsp;In order to study a jerboa’s gait, the researchers had the rodent run laps around a track with a strategically placed high-speed camera and force plate. Credit: Talia Moore&nbsp;“When we put the jerboa on a force platform, every step had a different signature,” Moore said. “I thought, ‘This is so weird. It’s like they’re completely unpredictable and I’m unable to characterize it based on the techniques we have.’”She consulted with Vasudevan. “I said, ‘Ram, I wish there was a way to measure unpredictability,’” Moore recalls. “He said, ‘There is.’”They borrowed a metric of randomness from information theory—entropy. Entropy is a measure of the uncertainty of an outcome. With it, they developed a model that calculates the probability that the animal will move in a specific way.Moore and her colleagues suspected that these herky-jerky movements help jerboas foil an aerial predator’s efforts to calculate an intercept course.<h4>Jerboas vs. jirds in the wild and the lab</h4>Since they wanted to see how these animals behave in their natural habitat, they traveled to northwestern China and designed a novel set of field experiments to study whether jirds and jerboas escape predators in different ways.Combining their observations and their new model, they found that the jerboas were much more unpredictable than the jirds. Their maneuvers included momentary bursts of acceleration, kangaroo-like hopping, erratic zigzagging and acrobatic leaps.To test whether the jerboa’s unpredictability truly corresponds to increased predator-evasion success, the researchers performed behavioral experiments that measured the animals’ tendency to seek shelter, which is called thigmotaxis.Small foraging animals face a conflict between their needs to venture out for food and to stay under cover—to avoid becoming food. Due to this conflict, the amount of time an animal spends in an open area varies with its ability to evade predators. As evasiveness increases, the behavioral affinity to shelter, and so-called “open-field anxiety,” decrease.During simulated predation trials, Moore and her colleagues observed that the bipedal jerboas explored the entire experimental enclosure, while jirds tended to remain near the walled periphery. She performed a second experiment in the lab with captive-bred animals that had never seen predators before. The results from both experiments suggest that bipedalism in rodents is associated with lower thigmotaxis and greater predator evasion in open settings.<h4>Why this matters for robotics</h4>Much of the research into robot locomotion involves smooth movement in low-variability environments. But these findings demonstrate some of the limits to that perspective.For biomimetic robots to interact with the world, we’ll need to engineer unpredictability in motion.<cite>Talia Moore</cite><div data-wow-delay=".09s">“The key insight here is it’s a big engineering challenge to engineer unpredictability this has shown that it’s a worthwhile pursuit,” Vasudevan said.Added Moore, “If we want to make more biomimetic robots that interact with the world around us, we’re going to need to think about how to engineer unpredictability in motion.”The paper is titled “Unpredictability of escape trajectory explains predator 2 evasion ability and microhabitat preference of desert rodents.” Co-authors in addition to Moore and Vasudevan are Kimberly L. Cooper of the University of California, San Diego, and Andrew A. Biewener of Harvard University. The study was funded in part by a Chapman Memorial Scholarship to Moore.</div> </div></div>

IMAGE:  The jerboa - a bipedal desert rodent native to North Africa and Central Asia. Credit: Christian Baker

many legged robots

Profiles