<section id="isPasted"><p>Even the most advanced robots struggle to sense touch as effectively as humans do -- just think of all the “fail” videos online where robots grasp eggs and accidentally crack them, or a robot arm moves too fast and smashes a bottle to pieces. Touch has been a huge challenge for roboticists who are working to develop more sophisticated systems that enable robots to accomplish tasks with human-like precision and adaptability.</p><h2>New tool gives machines a new level of dexterity and precision</h2><p>To address this challenge,&nbsp;<a href="https://yunzhuli.github.io/">Yunzhu Li</a>, an assistant professor of&nbsp;<a href="https://www.cs.columbia.edu/">computer science</a> at&nbsp;<a href="https://www.engineering.columbia.edu/">Columbia Engineering</a>, has developed a robot learning system that fuses the sense of touch with sight, giving machines a new level of dexterity and precision. His latest paper introduces&nbsp;<a href="https://arxiv.org/pdf/2410.24091">3D-ViTac</a>, a multi-modal robot manipulation system that is the first to integrate visual and tactile data into a unified 3D point cloud space for imitation learning. This system allows robots to “see” and “feel” objects, handle fragile objects, and perform long-horizon, precise tasks far more effectively than vision-only systems. Li and collaborators presented the paper Nov. 6 at the&nbsp;<a href="https://www.corl.org/">Conference on Robot Learning (CoRL)</a> in Munich, Germany.</p><p>“Our tactile sensors bring robots' sensing capabilities a step closer to human levels,” said Li, who joined Columbia this year. This research builds on his previous work on a&nbsp;<a href="https://stag.csail.mit.edu/">tactile glove for understanding how humans use their hands</a>. “The sensors are flexible, scalable, cost-effective, and able to detect detailed contact patterns, making them superior to previous tactile sensors used by robots.”</p><h2>New approach&nbsp;</h2><p>In this work, the researchers introduce a high-resolution force sensor, made from force-sensitive materials (specifically, piezoresistive materials), to the robot learning community to mimic human tactile sensing capabilities. The piezoresistive tactile sensor converts applied pressure into changes in electrical resistance. This change in resistance enables the robot to “feel” the objects it interacts with, allowing for precise grip strength and accurate in-hand object manipulation.</p></section><section><h2>3D-ViTac in Action</h2><p><span contenteditable="false" draggable="true" class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable"><iframe width="640" height="360" src="https://www.youtube.com/embed/ZN3mHMNZC7Q?&amp;wmode=opaque&amp;rel=0&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe></span></p><p id="isPasted">This contact-rich data provides a clear demonstration of how touch can enhance manipulation and how combining touch with vision can bring robots closer to human-level dexterity. The system was tested on tasks like grasping fragile items, such as eggs and grapes, and performing in-hand manipulation, like reorienting a hex key between fingers or adjusting the grip on a spatula. The tactile and visual fusion significantly outperformed systems relying solely on visual inputs, which was especially useful when handling fragile items or doing tasks with limited visibility.</p><h2>Thin, flexible tactile sensors transform robots from clunky tools into ones capable of precise, fluid manipulation&nbsp;</h2><p>The researchers developed a dense, flexible tactile sensor array integrated into a soft robotic gripper. The data from the sensors, combined with visual data, generate a 3D-point cloud, like a visual representation or a scene, that enables the robot to both “see” and “feel” its surroundings. The tactile feedback allows the robot to adjust its grip strength in real time, which is especially crucial when visual information is limited or occluded.&nbsp;</p><p>Equipped with “fingers” capable of feeling the world around them, these robots can now handle fragile objects with care. Thin, flexible tactile sensors cover their hands, enabling them to perceive the slightest pressure and adjust their movements accordingly. This innovation has transformed the robots from clunky tools into ones capable of precise, fluid manipulation once thought impossible for machines.</p><p>“This breakthrough also enables robots to handle occluded objects more reliably and effectively,” said&nbsp;<a href="https://binghao-huang.github.io/">Binghao Huang</a>, the project lead and a Columbia Engineering PhD student who works with Li. Occlusion occurs when an object is hidden from view, which is problematic for robots that rely on visual information to manipulate objects. “As the demand for humanoid robots to assist with household chores grows, our bimanual system equipped with tactile sensors presents a promising solution for achieving such tasks.”</p><h2>What’s next?</h2><p>With this leap forward in robotics, the line between human and machine skills begins to blur, opening the door to a future where robots cannot only see the world but feel it, too.&nbsp;</p><p>The next step for the researchers is to further improve the system's scalability and to scale up data collection. They are also developing a tactile simulation and integrating it into the robot learning process. This will allow for larger-scale data collection and better generalization of the policy, enabling the system to perform well in new situations for which it was not explicitly trained.</p><hr><h2>About the Study</h2><p><strong>Conference</strong>:&nbsp;<a href="https://www.corl.org/">Conference on Robot Learning (CoRL)</a> in Munich, Germany, November 6-9, 2024.</p><p><strong>Title</strong>:&nbsp;<a href="https://binghao-huang.github.io/3D-ViTac/">3D ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensing</a></p><p><strong>Authors</strong>: Binghao Huang<sup>1</sup>, Yixuan Wang<sup>1</sup>, Xinyi Yang<sup>2</sup>, Yiyue Luo<sup>3</sup>, Yunzhu Li<sup>1</sup>,&nbsp;</p><ol><li>Columbia University</li><li>University of Illinois Urbana-Champaign</li><li>University of Washington</li></ol><p><strong>Funding</strong>: This work is partly funded by the Toyota Research Institute (TRI). This research solely reflects the opinions and conclusions of its authors and not TRI or any other Toyota entity.</p></section>

Columbia Engineering computer scientists introduce a novel system that mimics human tactile sensing capabilities in robots.

Advancing Robotics with the Power of Touch

<div data-breakout="normal" id="isPasted"><p dir="auto">Manufacturing is swiftly moving towards automation. If you want to stay ahead of the curve and streamline your manufacturing processes, cobots could be the game-changer for your business needs.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">In this blog post, we'll dive deep into cobots in manufacturing, exploring their various applications in manufacturing, their benefits, and how to seamlessly integrate them into your production line.</p></div><div data-breakout="normal"><h2 dir="auto">What Is a Cobot?&nbsp;</h2></div><div data-breakout="normal"><p dir="auto">Imagine a world where robots aren't just machines confined to cages but are your partners, working alongside you to perform various tasks. That's the essence of a cobot or collaborative robot.</p></div><div data-breakout="normal"><p dir="auto">Unlike traditional industrial robots, industrial cobots have advanced sensors and safety features that allow them to detect and react to their surroundings, enabling them to share workspaces with human workers without posing safety risks.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">They are adaptable, learning from and complementing human employees to boost productivity and minimize the strain of repetitive tasks. Whether you run a small business or a large enterprise, industrial collaborative robots can allow you to enhance various manufacturing processes.</p><p dir="auto"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1730084180697-8c1b4c_bb7732de635e4f7b91eb35b4b6a3ce77%7Emv2.webp" style="width: 832px;" class="fr-fic fr-dib"></p><div data-breakout="normal" id="isPasted"><h2 dir="auto">What Is the Difference Between a Cobot and a Robot?</h2></div><div data-breakout="normal"><p dir="auto">While both ''cobot'' and ''robot'' might sound interchangeable at first glance, there are key distinctions between them, especially regarding their role in manufacturing. Here are the key differences:</p></div><div data-breakout="normal"><h3 dir="auto">Interaction</h3></div><div data-breakout="normal"><p dir="auto">While cobots are designed to augment and enhance human capabilities, traditional robots are designed for autonomous operation. They typically perform repetitive, high-precision, or dangerous tasks with minimal human involvement.</p></div><div data-breakout="normal"><h3 dir="auto">Safety</h3></div><div data-breakout="normal"><p dir="auto">Cobots have sophisticated <a target="_blank" href="https://www.botasys.com/post/choosing-the-right-force-torque-sensor-external-and-built-in-options-compared" rel="noopener" data-hook="WebLink"><u>sensors&nbsp;</u></a>and safety features that detect and respond to human presence. On the other hand, traditional industrial robots require cages or barriers to separate them from humans due to their speed, power, and size.</p></div><div data-breakout="normal"><h3 dir="auto">Ease of Use</h3></div><div data-breakout="normal"><p dir="auto">Cobots usually have user-friendly interfaces that allow for easier programming and quick changes. Conversely, robots require complex programming by skilled robotic engineers or developers.</p><p dir="auto"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1730084203357-8c1b4c_bc80541079014f43881179306776faba%7Emv2.webp" style="width: 100%px;" class="fr-fic fr-dib"></p><div data-breakout="normal" id="isPasted"><h2 dir="auto">Uses of Collaborative Robots in Manufacturing</h2></div><div data-breakout="normal"><p dir="auto">Cobots can perform a variety of tasks that can streamline your operations, improve efficiency, and enhance safety. Here are some common cobot applications in manufacturing:</p></div><div data-breakout="normal"><h3 dir="auto">Assembly Line Tasks</h3></div><div data-breakout="normal"><p dir="auto"><a target="_blank" href="https://www.botasys.com/applications/assembly-robots" rel="noopener" data-hook="WebLink"><u>Collaborative assembly robots</u></a> excel at performing repetitive tasks like welding, soldering, screwing, and component assembly with exceptional accuracy. From small electronic components to larger mechanical assemblies, cobots can adapt to a variety of production lines, ensuring quality and consistency.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">As a result, cobots can free up human workers' time, allowing people to prioritize complex tasks that require critical thinking and problem-solving skills rather than mundane tasks.</p></div><div data-breakout="normal"><h3 dir="auto">Machine Tending</h3></div><div data-breakout="normal"><p dir="auto">Machine tending can be monotonous and physically demanding, making it an ideal task for collaborative robots. Cobots can load and unload materials from CNC machines, injection molding machines, or presses diligently, maintaining operational efficiency round-the-clock.</p></div><div data-breakout="normal"><p dir="auto">The flexibility of cobots means they can easily switch between different tasks or machines, optimizing production flow and reducing downtime. For manufacturers, this means reduced manual labor costs and better use of machinery.</p></div><div data-breakout="normal"><h3 dir="auto">Quality Control and Inspection</h3></div><div data-breakout="normal"><p dir="auto">Cobots with vision systems and sensors can perform automated visual inspections with unprecedented accuracy and speed. They can detect product defects, identify inconsistencies in size or shape, and even compare components to pre-defined specifications.</p></div><div data-breakout="normal"><p dir="auto">This streamlines the quality control and inspection process and significantly reduces the risk of shipping defective products. For manufacturers, this means higher customer satisfaction and fewer returns or recalls.</p></div><div data-breakout="normal"><h3 dir="auto">Material Handling</h3></div><div data-breakout="normal"><p dir="auto">Material handling involves moving components or products between different stages of the production process.</p></div><div data-breakout="normal"><p dir="auto">Cobots can be fitted with specialized grippers or vacuum attachments to handle various materials, from large to small components. This relieves human workers from the burden of transporting heavy parts, minimizing the risk of injury from repetitive lifting and carrying.</p></div><div data-breakout="normal"><h3 dir="auto">Welding</h3></div><div data-breakout="normal"><p dir="auto">Welding is a high-precision task that's often performed in hazardous conditions.<a target="_blank" href="https://www.botasys.com/applications/welding-robots" rel="noopener" data-hook="WebLink">&nbsp;</a><a target="_blank" href="https://www.botasys.com/applications/welding-robots" rel="noopener" data-hook="WebLink"><u>Welding cobots</u></a> can weld with high precision and consistent quality. Additionally, they can operate in dangerous environments that might be unsafe for human workers.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">As a result, by automating welding processes using cobots, manufacturers can improve the quality of their products and reduce employees' exposure to harmful fumes and materials.</p></div><div data-breakout="normal"><h3 dir="auto">Finishing and Painting</h3></div><div data-breakout="normal"><p dir="auto">Cobots can be seamlessly integrated into finishing and painting processes, collaborating with human workers to perform tasks like sanding, buffing, and applying paint.</p></div><div data-breakout="normal"><p dir="auto">Their ability to maintain consistent pressure and access hard-to-reach areas can improve the quality and consistency of the final output while reducing the physical strain on human employees. Collaborative robots in automotive manufacturing are often used for paint jobs.</p></div><div data-breakout="normal"><h3 dir="auto">Research and Development</h3></div><div data-breakout="normal"><p dir="auto">Besides their direct applications in manufacturing, cobots are also valuable assets in research and development (R&amp;D).&nbsp;</p></div><div data-breakout="normal"><p dir="auto">They can be used to prototype new processes, test products, and refine manufacturing techniques. For innovative businesses looking to stay ahead of the pack, cobots offer a flexible, cost-effective way to develop new products and processes.</p></div><div data-breakout="normal"><h3 dir="auto">Data Collection and Analysis</h3></div><div data-breakout="normal"><p dir="auto">Cobots fitted with sensors can collect valuable data during production, providing insights into machine performance, cycle times, and potential issues.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">Manufacturers can use these insights to optimize production processes, rectify issues, and make data-driven decisions for their manufacturing operations.</p><p dir="auto"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1730084264693-8c1b4c_6e9985f8daa44bf1889cd4979b2e135c%7Emv2.webp" style="width: 100%px;" class="fr-fic fr-dib"></p><div data-breakout="normal" id="isPasted"><h2 dir="auto">Benefits of Cobots in Manufacturing</h2></div><div data-breakout="normal"><p dir="auto">Integrating cobots into your <a target="_blank" href="https://www.botasys.com/industries/manufacturing-automation" rel="noopener" data-hook="WebLink"><u>manufacturing</u></a> processes offers a multitude of advantages that can positively impact your bottom line, workforce, and overall production efficiency. Here are some key benefits cobots can offer:</p></div><div data-breakout="normal"><h3 dir="auto">Enhanced Productivity</h3></div><div data-breakout="normal"><p dir="auto">Cobots work tirelessly, performing mundane tasks with consistent speed and precision round-the-clock. This relentless pace ensures a steady production flow, minimizing downtime and maximizing output.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">By handling repetitive and time-consuming tasks, cobots free up human workers' time to focus on more complex tasks that require critical thinking and problem-solving skills. This optimized workflow boosts productivity and allows human workers to prioritize tasks where cobots fall short.&nbsp;</p></div><div data-breakout="normal"><h3 dir="auto">Enhanced Safety&nbsp;</h3></div><div data-breakout="normal"><p dir="auto">Cobots are designed with safety in mind. Their lightweight construction, visual sensors, and safety features minimize the risk of injuries to human workers.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">This is especially beneficial for tasks that involve heavy lifting, hazardous materials, or repetitive motions, which can lead to fatigue and injuries to human workers. By automating these tasks, cobots can reduce the likelihood of workplace injuries.</p></div><div data-breakout="normal"><h3 dir="auto">Greater Flexibility and Scalability</h3></div><div data-breakout="normal"><p dir="auto">Cobots are renowned for their flexibility. They can easily be reprogrammed and adapted to new tasks, making them ideal for a variety of applications within the manufacturing process. This flexibility is especially beneficial in today's fast-paced market, where product life cycles are short, and the ability to quickly adjust to new products or processes can provide a competitive edge.</p></div><div data-breakout="normal"><p dir="auto">Additionally, cobots can be scaled up or down depending on changing demand or seasonal fluctuations without significant investment or disruptions.</p></div><div data-breakout="normal"><h3 dir="auto">Reduced Costs</h3></div><div data-breakout="normal"><p dir="auto">While there's an initial investment involved in purchasing cobots, they offer significant cost savings in the long term. Cobots can reduce the need for manual labor, minimize material waste due to improved accuracy, and potentially lower insurance premiums due to a safer work environment.</p></div><div data-breakout="normal"><h3 dir="auto">Quick Integration</h3></div><div data-breakout="normal"><p dir="auto">Collaborative mobile robots are easier to integrate into existing workflows than traditional robots. Their compact size and mobility enable them to be deployed in various areas without requiring major modifications to a manufacturing facility.</p></div><div data-breakout="normal"><p dir="auto">Additionally, cobots have intuitive programming interfaces, unlike traditional robots with complex ones. As a result, human workers can quickly learn to operate and reprogram them as needed without the intervention of skilled robotics engineers.</p></div><div data-breakout="normal"><p dir="auto">This means manufacturers can start reaping the benefits of cobot technology without significant downtime or disruption to their operations. &nbsp;</p></div><div data-breakout="normal"><h3 dir="auto">Enhanced Product Quality</h3></div><div data-breakout="normal"><p dir="auto">Cobots are programmed to perform tasks with unprecedented accuracy and precise movements. This eliminates human error and ensures product uniformity, resulting in fewer defects and higher-quality products.</p></div><div data-breakout="normal"><p dir="auto">Additionally, cobots equipped with vision systems and sensors can be used for automated quality control, further enhancing consistency and reducing the need for manual inspections.</p></div><div data-breakout="normal"><h3 dir="auto">Improved Employee Morale</h3></div><div data-breakout="normal"><p dir="auto">Cobots can improve employee morale by automating mundane, physically demanding, and repetitive tasks. This is because cobots relieve employees from handling monotonous tasks, allowing them to focus on more challenging and fulfilling tasks that engage their skills and creativity.</p></div><div data-breakout="normal"><p dir="auto">This can lead to increased job satisfaction, motivation, and a sense of ownership among employees, contributing to a healthier work environment.</p></div><div data-breakout="normal"><h2 dir="auto">Streamline Your Manufacturing Operations With Cobots</h2></div><div data-breakout="normal"><p dir="auto">In 2023,<a target="_blank" href="https://www.marketsandmarkets.com/Market-Reports/collaborative-robot-market-194541294.html" rel="noopener" data-hook="WebLink">&nbsp;</a><a target="_blank" href="https://www.marketsandmarkets.com/Market-Reports/collaborative-robot-market-194541294.html" rel="noopener" data-hook="WebLink"><u>the global cobot market was valued at $1.2 billion</u></a>, and it's expected to rise to a remarkable $6.8 billion by 2029. This is because more and more businesses are embracing automation to streamline their manufacturing operations, and cobots have been proven to yield positive results.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">Yet another crucial aspect to consider is the integration of torque force sensors into your manufacturing processes. By accurately measuring torque and force, these sensors ensure precise control over assembly operations, resulting in higher product quality and reduced downtime due to errors or equipment failures.&nbsp;</p></div></div></div></div>

In this blog post, we'll dive deep into cobots in manufacturing, exploring their various applications in manufacturing, their benefits, and how to seamlessly integrate them into your production line.

Cobots in Manufacturing: Their Uses and Advantages

<p id="isPasted">A patient recovering from a limb amputation won’t use a prostheses that isn’t comfortable. A person rehabbing from a stroke won’t use a robotic exoskeleton if the mobility it grants doesn't allow them to perform everyday activities. And a diabetes patient won’t use an insulin pump that doesn’t deliver the appropriate dosage of medicine to control their blood sugar.</p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 832px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1729896386001-IMG_8127_0_0.jpg" style="width: 100%px;" class="fr-fic fr-dib"><span class="fr-inner">Human-in-the-loop optimization algorithms could greatly improve human-robot interaction with medical devices like this exosuit, dramatically improving the results for patients. (Harvard Biodesign Lab)</span></span></span></p><p>All of these challenges fall under a concept known as “human-robot interaction,” a critical issue in robotic design and engineering. A new perspective from researchers at the <a href="https://seas.harvard.edu/">Harvard John A. Paulson School of Engineering and Applied Sciences</a> (SEAS) delves into a potential approach to improve human-robot interaction. The approach, known as “human-in-the-loop optimization” (HILO), explores the potential of combining individual patient data with machine learning algorithms as a way to fine-tune robotic design and improve results for specific performance metrics. Patrick Slade, Assistant Professor of Bioengineering at SEAS, was first author on the perspective, which was published in <em>Nature.</em></p><p>“I hope this perspective can accelerate the development and effectiveness of human-robot interactions when developing robotic systems, especially for medical applications where these systems interact with people,” Slade said. “I’m hopeful that this perspective will encourage researchers to think about humans as complex, challenging systems to design for. HILO can be a tool to maximize the effectiveness of devices that interact with people.”</p><p>The idea of human-in-the-loop optimization has been around for about 7 years, Slade said, but has yet to be fully adopted into the robotic engineering space. Because every human is different, human-robot interaction is a very difficult concept to predict and design for, which can slow down innovation in the field.</p><p>“Working with these populations and devices for a while, I’ve seen that when people are introduced to a new device, their conceptions of the device, what they want and how they might use it, change as they get used to it,” he said. “It’s a moving target with dual challenges, where you need them to understand and adapt with the device, and you also want to provide them with something that provides a benefit to the user and is acceptable for regular use. HILO can help inform what the human-robot interaction should be to improve whatever human-robot metric is important to that population. Knowing what effective human-robot interaction is needed, for example, what torque to provide with an ankle exoskeleton to help people post-stroke to walk more quickly and efficiently, can inform the development of effective devices. HILO can also maximize performance of an existing commercial device by systematically tuning how that device interacts with the user. We’ve seen an optimized assistance double the benefits compared to a generic controller for an ankle exoskeleton device, showing HILO can have a big impact on patient outcomes without even changing the device hardware."</p><blockquote><p>One challenge in the field of robotics is that people often get treated as robots.</p><p>Patrick Slade, Assistant Professor of Bioengineering at SEAS</p></blockquote><p>Though called an optimization algorithm, Slade described it as closer to a “personalization” algorithm, in that it uses personal data to optimize the device to the individual patient. And because it’s based on machine learning algorithms, the optimal adjustments can be found quickly and without an engineer needing to pour through multiple potential designs.</p><p>“One challenge in the field of robotics is that people often get treated as robots,” Slade said. “People are complex and often don’t respond to robotic assistance in a predictable way. This paper is posing the idea that a lot of our research intuitions on human-robot interaction aren’t great because people are very complex. If we admit that, we can use this systematic approach to optimize assistance and really accelerate the field. Adopting HILO would really accelerate the field, and patients would see more benefits.”</p><p>Slade envisions HILO as especially valuable in the earliest design stages, when research is still being done in labs as opposed to field testing finished or nearly finished designs. During those early stages, engineers typically test out numerous different designs and functions to try to hone in on one that meets whatever they determine to be the most important performance metrics. Examples of metrics in medical devices, for example, include muscle contraction,fatigue, walking speed, heart rate, blood glucose levels, or other measures of improved mobility.</p><p id="isPasted">Using HILO algorithms, designers could quickly determine if a design needs to be adjusted based on individual patient data to maximize its benefit.</p><p>“HILO allows you to identify the meaningful interactions, then build a portable device based on what you’ve learned,” he said. “Rather than building multiple interactions of a portable device, you could do it in a single shot, which could help accelerate the field.”</p><p>Conversely, Slade’s perspective suggests even late-stage design or products already on the market could still benefit from these optimization algorithms. HILO is similar to getting a glasses prescription, systematically tuning the human-robot interaction to achieve a desired outcome, similar to a new prescription.</p><p>“You have a device, you optimize the controller, and now you have a more personalized controller and see better benefits,” he said. “We’ve seen from a few studies that existing portable devices can double their performance if you apply HILO. It’s the same hardware – you just update the controller, and all of a sudden your device is twice as effective. That’s exciting. You could spend years developing something, and then all of a sudden double the performance just by systematically tuning the human-robot interaction.”</p>

Human-in-the-loop optimization algorithms could greatly improve human-robot interaction with medical devices like this exosuit, dramatically improving the results for patients. (Harvard Biodesign Lab)

New research touts effectiveness of individual optimization algorithms

Keeping humans in the loop of robotic design

<p><span contenteditable="false" draggable="true" class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable"><iframe width="640" height="360" src="https://www.youtube.com/embed/yvgfl9zTHk0?&amp;wmode=opaque&amp;rel=0&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"><span class="fr-mk" style="display: none;">&nbsp;</span></iframe></span><em>Tom van Mulken uses the successor (MUSA3) to the robot from his research (MUSA2). Photo: Microsure - Video: Microsure</em></p><p><strong id="isPasted">Thanks to a newly developed surgical robot, reconstructive surgery can be performed more safely and accurately in the future. This is also expected to lead to fewer complications and faster patient recovery. On October 18<sup>th</sup>, plastic surgeon Tom van Mulken of Maastricht UMC+ obtained his doctorate in research into this robot, which can significantly improve the precision and efficiency of microsurgical procedures. In doing so, Van Mulken is driven to use his research to contribute to better care, lower costs, and a direct impact on patients' quality of life.</strong></p><p><strong id="isPasted"><span class="fr-img-caption fr-fic fr-dib" style="width: 832px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1729804113170-csm_MUSA3_naaldje_Lenno+van+Dekken-Telegraaf_d8df898a58.jpg" style="width: 100%px;" class="fr-fic fr-dib"><span class="fr-inner">Robotic instruments with needle and suture for a two-millimeter artificial vessel. The surgeon watches the operation on the screen, with 3D image from the microscope. This is the largest cross-section of channels that microsurgeons suture. Usually these are much smaller still. Photo: Lenno van Dekken</span></span></span></strong></p><p data-pm-slice="0 0 []" id="isPasted">Reconstructive surgery requires tremendous precision. Think of breast reconstruction after cancer treatment or repairing an amputated finger. Surgeons then suture blood vessels, lymphatic vessels, and nerves, often thinner than a millimeter. Van Mulken focused his doctoral research on developing and testing a robot that can support these extremely delicate surgeries.&nbsp;</p><h2 data-pm-slice="0 0 []">A precision robotic system&nbsp;</h2><p data-pm-slice="0 0 []">The surgical robot was developed by startup Microsure where Van Mulken works with engineers from Eindhoven University of Technology. It offers the ability to operate with unparalleled precision.&nbsp;</p><p data-pm-slice="0 0 []">The physician can work with the robotic arm at the submillimeter level where the human hand is limited in its accuracy by vibration and fatigue. This robot allows the physician to suture blood vessels, lymphatic vessels, and nerves with greater precision. In doing so, he uses sutures that are thinner than a hair. This is crucial to the success of such precise reconstructive surgeries.</p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 832px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1729804194597-csm_Microsure_MUSA3_MUMC_5+%283%29_25623fd357.jpg" style="width: 100%px;" class="fr-fic fr-dib"><span class="fr-inner">Hands of microsurgeon intuitively operating the instruments of the MUSA 3. Photo: Microsure</span></span></span></p><p id="isPasted">“The challenge was to develop a technology that is actually applicable in clinical practice,” Van Mulken explains. “Through close cooperation between technicians and surgeons, we have developed a system that is not only technically sophisticated but also meets the practical requirements of the operating room. This is a big step forward in improving care for our patients.”</p><h3><strong>Patient's interest</strong></h3><p>For future patients, robotic-assisted surgeries mean less invasive operations. And a shorter and better recovery process.</p><p>Current microsurgical operations are sometimes risky because of the fine motor skills required of the physician. The robot offers the physician more stability and precision. This translates into fewer complications, such as poorly healing wounds or tissue rejection, and a higher success rate.</p><p>In addition, the technology offers benefits in function restoration. In breast reconstruction after cancer, for example, not only the shape of the breast is restored, but also the function of tissues and (sensory) nerves in the arm. This greatly impacts the patient's self-image and quality of life.</p><h3 id="isPasted"><strong>Improving the quality of operations</strong></h3><p>“This technology should improve the quality of current microsurgery operations, allowing patients to resume their daily lives faster,” Van Mulken said. “Fewer postoperative complications and faster recovery of function, ultimately contributing to improved physical and mental well-being.”</p><p>This is the purpose of his doctoral research. The first part of the research shows that a doctor can safely and properly perform microsurgeries with the robot. “There is also a faster learning curve for plastic surgeons. As a result, with the robot support, surgeons can perform microoperations independently sooner and continue with the same precision into old age.”</p><p>Follow-up research is underway to understand patient outcomes better.&nbsp;</p><h3><strong>Collaboration</strong></h3><p>The success of the innovative surgical robot comes from an intensive collaboration between clinicians and engineers. This multidisciplinary team turned a clinical problem into a practical, technological solution that is now on its way to widespread hospital implementation.</p><p>“It is this collaboration between technology and medical expertise that makes it possible to address complex issues in healthcare,” Van Mulken said. “Without this cross-fertilization between different disciplines, we would not have been able to achieve this breakthrough.”</p><p>The societal impact of these robotics innovations extends beyond direct patient care. Although the initial investment in surgical robots can be significant, the technology provides potentially significant cost savings in the long run. Shorter operative times, fewer complications, and shorter hospital stays result in more efficient care delivery and lower costs for the healthcare system as a whole.</p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 832px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1729804227935-csm_MUSA3+_+demo_Lenno+van+Dekken-Telegraaf_c684312935.jpg" style="width: 100%px;" class="fr-fic fr-dib"><span class="fr-inner">Demonstration MUSA3, showing the surgeon's controls and screen in the foreground. The instruments, digital microscope and treatment table can be seen in the background. Photo: Lenno van Dekken</span></span></span></p><h3 id="isPasted"><strong>Future</strong></h3><p>Tom van Mulken's research marks an important step in integrating robotics into the medical practice of microsurgery. The potential of this technology is great and may lead to broader applications, not only in reconstructive surgery but also in other surgical specialties.</p><p>As technology continues to develop, the expectation is that more and more hospitals worldwide will embrace these innovations. Van Mulken remains ambitious: “We are only at the beginning. We are currently testing another new generation of the robot in a pilot setup.”</p><p>“That one will support the surgeon even better. The goal remains to provide patients with the best possible care. This technology will take us further. Thereby, the combination with AI will greatly accelerate the further development of robotics for surgery.”</p><hr><p><em>Tom van Mulken's PhD can be viewed via <a href="https://www.youtube.com/live/obwEYxzO_jk?si=JRs8Vdw8qvk12RGe" target="_blank" rel="noreferrer">Maastricht University</a>.</em></p><p><em>His thesis can be read here: <a href="https://cris.maastrichtuniversity.nl/en/publications/robotic-microsurgery-in-plastic-and-reconstructive-surgery-the-jo" target="_blank" rel="noreferrer">Robotic microsurgery in plastic and reconstructive surgery: The journey of creating, introducing and (pre)clinical validation of a new and dedicated robot for microsurgery</a>.</em></p>

Co-founder of TU/e spin-off Microsure, microsurgeon Tom van Mulken, defended his PhD thesis at Maastricht University on October 18th. He studied the safety and capabilities of a surgical support robot for microsurgical procedures.

Thanks to a newly developed surgical robot, reconstructive surgery can be performed more safely and accurately in the future. This is also expected to lead to fewer complications and faster patient recovery.

Precision robot transforms reconstructive microsurgery

<p><strong>In the international Cybathlon competition, people with physical disabilities undertake routine tasks with the aid of assistive technology that can be seamlessly integrated into everyday life. Below, we present three ETH teams that will be putting their innovative solutions to the test at this October’s event.</strong></p><h2 id="isPasted"><strong>Help from a fourlegged friend</strong></h2><p>Developed by the Robotics Systems Lab at ETH&nbsp;Zur­ich, ALMA is a quadrupedal robot equipped with a range of sensors and a robotic arm. Unlike other entries in the Cybathlon discipline for assistive robots, all of which are attached to a wheelchair, ALMA moves autonomously on its own four legs, controlled by paraplegic pilot Sammy Kunz via a quadstick – a type of mouth-operated joystick. Deploying the robot as a separate system provides greater mobility, say team managers Carmen Scheidemann and Andrei Cramariuc. “But our biggest asset is also our biggest liability,” Scheidemann explains. “Because we have to ensure that ALMA moves safely without bumping into any objects.” In competition, the team has ten minutes to complete ten everyday tasks. For example, the pilot must use the robot to open a door and then close it behind them, or to pick up an apple and hold it in such a way that the pilot can take a bite. The quadstick used with ALMA features various tubes. By blowing or sucking, the pilot is able to control the different axes of the robot: either its quadrupedal platform or its gripping arm.</p><p>“At a preliminary event in February, we had eight minutes to complete four tasks,” says Scheidemann. “In the end, we needed just over six.” The team is therefore confident about achieving a good score at the upcoming championship. In preparation for October’s event, various refinements to ALMA have been made in close cooperation with Kunz. Most of these involved enhancing the controls so that Kunz can operate the robot with as little practice as possible. “We suggest an improvement, and Sammy gives us feedback on what works for him and what doesn’t,” explains Scheidemann. “Then we make the necessary modifications.” Whereas 15 hours of practice were required before the preliminary event in February, improvements to the control system have now drastically reduced preparation times.</p><p>Both managers have hugely enjoyed working with Kunz. “It’s really fulfilling to be working on a project that has the potential to bring about such a major improvement in the day-to-day lives of people with disabilities,” says Cramariuc. ANYmal robots, which provide the quadrupedal platform for ALMA, are already in use for a variety of industrial jobs, including the inspection of oil rigs. The current challenge is to deploy assistive robots not only in controlled envir­onments but also in everyday situations. The team will continue to refine ALMA. “But it will be a good few years before the platform is ready for market,” Scheidemann cautions. “We’re still very much at the experimental stage.”</p><p><a href="https://cybathlon.ethz.ch/en/teams/rsl" target="_blank" id="isPasted">To the RSL team</a></p><h2 id="isPasted"><strong>Cameras and a vibrating belt</strong></h2><p>Pressing the right doorbell, finding a free seat and navigating an area containing obstacles of various heights are just some of the challenges that blind pilot Lukas Hendry will face in the Vision Assist­ance Race at the Cybathlon. Technical support comes from the Sight Guide team, which will guide Hendry using data from two cameras strapped to his chest. Patrick Pfreundschuh, one of the team managers, describes how the technology works: “We use one camera for positioning – that is, to tell us where Lukas is and where he’s heading. The other is a depth camera that takes 3D measurements of the surrounding area.” There’s also a third camera which the pilot holds in his hand to assist with tasks that require objects to be examined in more detail. All three cameras transmit information to a small, lightweight computer that Hendry carries on his back. The computer crunches the data and sends Hendry corresponding instructions via an audio signal. Finding a system with enough computing power was surprisingly difficult, says Pfreundschuh: “When your pilot is in the race, you need to be processing the input as quickly as possible. Otherwise, he might collide with an obstacle, which is obviously something we want to avoid!” The Sight Guide team is hopeful about making further improvements before the Cybathlon, such as making the audio signals that convey the instructions more easily understandable. In addition to the computer and cameras, Hendry also wears a special vibrating belt that tells him in which direction to move. “We don’t want to say exactly how this belt works, because it’s what gives us our competitive edge!” says Pfreundschuh with a smile.</p><p>The Sight Guide team consists of doctoral candidates and students from the Autonomous Systems Lab at ETH Zurich, the Robotics and Perception Group at the University of Zurich and the Institute for Mechatronic Systems at Zurich University of Applied Sciences (ZHAW). For the doctoral students, the Cybathlon is both inspiring and enjoyable, which is why they are happy to work on the project in their spare time. Every month or two, they meet up with Hendry to perform mock-ups of the tasks they will face in the Cybathlon. Hendry then supplies feedback – for example, on how fast he receives the instructions – and many of the tweaks he suggests can be applied on the spot. Working with the pilot is one of the things that makes this project so special, says Pfreundschuh: “It’s great to see Lukas sailing through tasks that would be impossible for him without our technology. It makes me happy and proud to see the benefits we can provide for blind people simply by putting theory into practice.” The goal is to continue improving the technology once the Cybathlon is over – and Pfreundschuh hopes to find a new generation of students willing to take the reins.</p><p><a href="https://sightguide.tech/" target="_blank" id="isPasted">To the sightguide team</a></p><h2 id="isPasted"><strong>Sensing the ground while wearing prosthesis</strong></h2><p>A key drawback of a prosthetic leg is that wearers are unable to feel the ground beneath their foot. The absence of sensory feedback on where their foot is positioned and how firmly it is touching the floor makes it difficult to walk, especially on uneven terrain or when climbing stairs. This is the main reason many patients decide against a prosthesis. But it doesn’t have to be this way, as Stefan Poth has discovered since becoming a pilot in the Cybathlon. He is taking part in the competition with his own prosthetic leg, which has been fitted with a special insole in the shoe. Developed by the NeuroLegs team, this insole is equipped with sensors that gather information on what the researchers call the foot-ground interaction. This includes feedback on whether Poth’s weight is on the toe, middle part or heel of his prosthetic foot. Data on where he is stepping is sent to a microprocessor attached to his waist. The computer processes the data and converts it into electrical stimulation by activating electrodes on an elastic belt that Poth wears around his leg stump. “Depending on where Stefan is stepping, electrical stimulation is applied in real time to either the front, side or back of the stump to replicate the sensation that would normally be perceived in the foot,” says Noemi Gozzi, co-manager of the NeuroLegs team.</p><p>Poth’s team for the leg prosthesis race is made up of students from the Neuroengineering Lab at ETH Zurich. Affiliated with the Department of Health Sciences and Technology, the lab is headed by ETH professor Stanisa Raspopovic. This year’s team is building on the valuable experience gained in the previous Cybathlon four years ago. “Instead of starting from scratch, we’ve actually been able to improve our technology this year. For example, we’ve made it a lot more user­friendly,” says Valerio Aurucci, the second of the team’s two managers. The belt Poth wears around his leg stump was developed by this year’s team to avoid having to attach electrodes to his skin one by one, which has also made the system more reliable.</p><p>Gozzi emphasises how rewarding it is to see their research being put into practice: “We’re trying to develop systems that will make people’s day-to-day lives easier. Stefan’s reaction when he felt a sensation from his foot for the first time was something very special – and it certainly made up for all those hours in the lab!” The Neuroengineering Lab is one of the leading research groups working on peripheral nerve stimulation, and Aurucci sees<br>major benefits in the innovative solution they have developed: “The biggest advantage is that our system can be used with any prosthesis.” Getting to a market-ready product will require more development and additional safety features. The two team managers – both of whom are doing their doctorate at ETH – are therefore carefully considering their next step. Should they stick to research and hand over NeuroLegs to the next generation, or take the plunge into business by setting up a spin-off? The future is theirs to decide.</p><p><a target="_blank"></a></p><p><a href="https://cybathlon.ethz.ch/en/teams/neuro-legs" target="_blank">To the NeuroLegs team</a></p>

Helping to open doors: Cybathlon pilot Sammy Kunz uses his mouth to steer the assistance robot, while Carmen Scheidemann from the Robotics Systems Lab monitors the test run. Come October, the pressure will be on. (Photograph: Markus Bertschi / ETH Zurich)

In the international Cybathlon competition, people with physical disabilities undertake routine tasks with the aid of assistive tech that can be seamlessly integrated into everyday life. Here are three ETH teams that will be putting their innovative solutions to the test at this October’s event.

How four-legged robots and smart belts help people overcome everyday barriers

<div data-breakout="normal" id="isPasted"><p dir="auto">How can we avoid repetitive tasks that slow down the production line? What innovative solution can accelerate production processes? A cobot might be the solution we're seeking. But what precisely is a cobot, and how can it benefit a business?</p></div><div data-breakout="normal"><p dir="auto">In this guide, we'll comprehensively address these questions. We'll delve into what cobots are, their various types, how they compare to industrial robots, their benefits, and more to assist you in understanding whether they might represent the future of technology.</p></div><div data-breakout="normal"><p dir="auto">Let's dive in!</p></div><div data-breakout="normal"><h2 dir="auto">What Is a Cobot?</h2></div><div data-breakout="normal"><p dir="auto">As the name implies, a cobot, co-bot, or collaborative robot is designed to work hand-in-hand with humans within a shared space.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">Unlike traditional robots that require separate operation areas, cobots are built with advanced sensors to safely collaborate with humans. They're also programmed to work at lower speeds and with decreased torque strength, enhancing their safety for use alongside humans.</p></div><div data-breakout="normal"><p dir="auto">These qualities mean they can assist workers with tasks ranging from simple material handling to complex assembly processes, boosting productivity while maintaining safety.</p><p dir="auto"><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzI2NDc1MDc2ODMwLThjMWI0Y19jNzYxNDcxNWE0MTM0ZjYxYjQ0YzNjY2Y5OWIwMjc5OH5tdjIgKDEpLndlYnAiLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 100%px;" class="fr-fic fr-dib"></p><div data-breakout="normal" id="isPasted"><h2 dir="auto">Types of Cobots</h2></div><div data-breakout="normal"><p dir="auto">There's no one-size-fits-all cobot. There are different types of co-bots for different purposes. According to the International Organization for Standardization (ISO) <a target="_blank" href="https://www.iso.org/obp/ui/#iso:std:iso:10218:-2:ed-1:v1:en" rel="noopener" data-hook="WebLink"><u>10218 standards</u></a>, there are four types of collaborative robots. Here's an overview of each type:</p></div><div data-breakout="normal"><h3 dir="auto">Power and Force Limiting Cobots</h3></div><div data-breakout="normal"><p dir="auto">These are perhaps the most popular and ubiquitous collaborative robots. They are designed with built-in sensors to detect human contact and apply force limits to prevent injury. This trait makes them ideal for direct interaction tasks, like assembly and light material handling.These cobots come with a variety of <a target="_blank" href="https://www.botasys.com/post/choosing-the-right-force-torque-sensor-external-and-built-in-options-compared" rel="noopener" data-hook="WebLink"><u>sensing technologies&nbsp;</u></a></p></div><div data-breakout="normal"><h3 dir="auto">Safety Monitored Stop Cobots</h3></div><div data-breakout="normal"><p dir="auto">These sophisticated collaborative robots can stop operations immediately when they detect human presence within a specified area. The worker can reactivate the cobot's functions simply by pressing a button. This feature makes these cobots perfect for tasks that require minimal human intervention.</p></div><div data-breakout="normal"><h3 dir="auto">Speed and Separation Monitoring Cobots</h3></div><div data-breakout="normal"><p dir="auto">These cobots use advanced vision systems to adjust their speed or stop based on the proximity of human workers. This characteristic makes them ideal for tasks that require controlled movement near humans, like welding.</p></div><div data-breakout="normal"><h3 dir="auto">Hand Guided Cobots</h3></div><div data-breakout="normal"><p dir="auto">As the name suggests, hand-guided cobots allow workers to control their movements manually with a handheld device. This quality makes them perfect for meticulous tasks like product customization.&nbsp;</p></div><div data-breakout="normal" id="isPasted"><h2 dir="auto">Collaborative Robots Vs. Industrial Robots: Key Differences</h2></div><div data-breakout="normal"><p dir="auto">Collaborative robots share several similarities with industrial robots. However, the two robots aren't quite the same. Let's explore the key differences between the two robots to help you make an informed decision on which one to choose:</p></div><div data-breakout="normal"><h3 dir="auto">Purpose</h3></div><div data-breakout="normal"><p dir="auto">Industrial robots are designed for independent, high-volume tasks, such as heavy material handling, welding, or large-scale painting. On the other hand, cobots work alongside humans, assisting with repetitive tasks like packaging, quality control, or material handling in collaborative workspaces.</p></div><div data-breakout="normal"><h3 dir="auto">Safety</h3></div><div data-breakout="normal"><p dir="auto">Given their power and speed, industrial robots are often placed in cages or other confined areas to keep workers safe. Conversely, with their built-in safety features, cobots operate safely near humans, eliminating the need for cages.&nbsp;</p></div><div data-breakout="normal"><h3 dir="auto">Ease of Programming&nbsp;</h3></div><div data-breakout="normal"><p dir="auto">Due to their complexity, industrial robots typically require engineers to set up and program. With their user-friendly interfaces and intuitive programming, cobots require minimal programming knowledge to set up.</p></div><div data-breakout="normal"><h3 dir="auto">Cost</h3></div><div data-breakout="normal"><p dir="auto">With their high initial costs and infrastructure requirements, industrial robots are pretty costly. With their lower upfront costs and minimal infrastructure requirements, cobots are generally more affordable, making them an enticing option for small and medium-sized businesses.</p></div><div data-breakout="normal"><div dir="auto"><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzI2NDc1MjQ1NzUyLThjMWI0Y183YmI3ZTgxMjc1YzI0Njg5OGJjMGFiNmVmNWU4MDU1Nn5tdjIuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib"></div><div data-breakout="normal" id="isPasted"><h2 dir="auto">Programming a Cobot</h2></div><div data-breakout="normal"><p dir="auto">Programming industrial robots require in-depth knowledge of programming languages like C++, Python, or Java. However, industrial collaborative robots require little to no programming experience to set up. So, they're relatively simple to set up.</p></div><div data-breakout="normal"><p dir="auto">Most cobots have intuitive graphical interfaces (GUIs) or teach pendants. These tools allow workers to program the robot by simply moving its arm to the desired positions and recording these movements. It's like guiding a friend's hand — it's that straightforward.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">However, for more complex or meticulous tasks, cobots also support more advanced programming via proprietary or open-source software platforms. These platforms often feature drag-and-drop builders for coding, making it easier for workers to define more complicated tasks or integrate the cobot with other machines on the production line.</p></div><div data-breakout="normal"><p dir="auto">This user-friendly nature of cobots makes them easy to deploy quickly. Additionally, it makes them ideal for small and medium-sized businesses that may not have the technical personnel for robotic programming.</p></div><div data-breakout="normal"><h2 dir="auto">Applications of Cobots</h2></div><div data-breakout="normal"><p dir="auto">Collaborative robots have a variety of applications, particularly because of their exceptional versatility. Here are some common use cases of cobots:</p></div><div data-breakout="normal"><h3 dir="auto">Assembly</h3></div><div data-breakout="normal"><p dir="auto">Cobots excel in assembly tasks, like screwing, gluing, and insertion, where precision and consistency are critical. They can work alongside human workers, assembling parts with incredible accuracy. A critical component for reliable assembly is the<a target="_blank" href="https://www.botasys.com/post/force-torque-sensor" rel="noopener" data-hook="WebLink"><u>&nbsp;force torque sensing.</u></a></p></div><div data-breakout="normal"><h3 dir="auto">Packaging</h3></div><div data-breakout="normal"><p dir="auto">Cobots are excellent at repetitive tasks like <a target="_blank" href="https://www.botasys.com/applications/palletizing-packing-robots" rel="noopener" data-hook="WebLink"><u>packaging</u></a>, as they can pack goods faster and more efficiently than humans. Similarly, they're adept at palletizing, as they can stack products in predefined patterns, saving space and reducing labor costs.</p></div><div data-breakout="normal"><h3 dir="auto">Machine Tending</h3></div><div data-breakout="normal"><p dir="auto">Cobots can operate machinery and load and unload parts, freeing up your human workforce for more complicated tasks.</p></div><div data-breakout="normal"><h3 dir="auto">Quality Inspection</h3></div><div data-breakout="normal"><p dir="auto">Thanks to their sophisticated sensors and cameras, collaborative robots can conduct thorough inspections of products, ensuring they have no defects.</p></div><div data-breakout="normal"><h3 dir="auto">Material Handling</h3></div><div data-breakout="normal"><p dir="auto">Cobots can safely transport materials and products from place to place, eliminating the need for human workers to lift and transport items manually.&nbsp;</p></div><div data-breakout="normal"><h3 dir="auto">Welding</h3></div><div data-breakout="normal"><p dir="auto">Cobots can perform complex <a target="_blank" href="https://www.botasys.com/applications/welding-robots" rel="noopener" data-hook="WebLink"><u>welding</u></a> tasks like spot or arc welding with exceptional speed and precision.</p><p dir="auto"><img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzI2NDc1MzEyMDUxLThjMWI0Y19jMjIwNDRlNjFiZmY0MjUzYTM4MGJmZDYwNmY1MTk2OX5tdjIud2VicCIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6OTUwLCJmaXQiOiJjb3ZlciJ9fX0=" style="width: 100%px;" class="fr-fic fr-dib"></p><div data-breakout="normal" id="isPasted"><h2 dir="auto">Industries That Use Cobots</h2></div><div data-breakout="normal"><p dir="auto">Cobots have been the unsung heroes in the <a target="_blank" href="https://www.botasys.com/industries/manufacturing-automation" rel="noopener" data-hook="WebLink"><u>manufacturing industry</u></a> for years — working diligently alongside human workers to perform various tasks such as assembly, material handling, and machine tending.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">However, besides the manufacturing industry, here are some other industries where collaborative robots play an integral role:</p></div><div data-breakout="normal"><h3 dir="auto">Automotive Industry</h3></div><div data-breakout="normal"><p dir="auto">Automakers use cobots for various tasks, including assembly, painting, and quality control. Cobots can adapt to different vehicle models and configurations, making them perfect for dynamic automotive production lines.</p></div><div data-breakout="normal"><h3 dir="auto">Pharmaceutical Industry</h3></div><div data-breakout="normal"><p dir="auto">Collaborative robots excel at performing tasks like packaging and quality control. This characteristic makes them suitable for the<a target="_blank" href="https://www.botasys.com/industries/medicine-healthcare" rel="noopener" data-hook="WebLink">&nbsp;</a><a target="_blank" href="https://www.botasys.com/industries/medicine-healthcare" rel="noopener" data-hook="WebLink"><u>healthcare industry</u></a>, where consistency is critical to prevent contamination.</p></div><div data-breakout="normal"><h3 dir="auto">Electronics Industry</h3></div><div data-breakout="normal"><p dir="auto">Workers in the electronics industry often work with tiny components. Cobots are great at assembling, testing, and handling tiny parts, minimizing human error.</p></div><div data-breakout="normal"><h3 dir="auto">Food and Beverage Industry</h3></div><div data-breakout="normal"><p dir="auto">In the food and beverage industry, collaborative robots are used in packaging, sorting, and handling, minimizing the risk of contamination.</p></div><div data-breakout="normal"><h3 dir="auto">Plastics Industry</h3></div><div data-breakout="normal"><p dir="auto">In the plastics industry, where production typically involves creating a diverse range of products in small batches, automation has been challenging due to the dynamic nature of manufacturing processes.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">Collaborative robots, with their adaptability, have provided a solution, making automation simple and efficient even in constantly evolving production environments.</p><p dir="auto"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1726475387060-8c1b4c_a7012b579c5543f8b5fb9c500f0e6654%7Emv2.webp" style="width: 100%px;" class="fr-fic fr-dib"></p><div data-breakout="normal" id="isPasted"><h2 dir="auto"><strong>Pros of Cobots</strong></h2></div><div data-breakout="normal"><p dir="auto">Collaborative robots offer a variety of benefits to businesses across multiple industries. Some of these benefits include:</p></div><div data-breakout="normal"><h3 dir="auto">Enhanced Productivity</h3></div><div data-breakout="normal"><p dir="auto">Cobots are tireless workers. They handle mundane tasks with precision, allowing human workers to focus on higher-level tasks.</p></div><div data-breakout="normal"><h3 dir="auto">Flexibility</h3></div><div data-breakout="normal"><p dir="auto">Cobots are renowned for their adaptability. They can easily switch between tasks with minimal downtime, making them perfect for dynamic production environments. Whether it's assembly, machine tending, or quality control, they can adjust swiftly to meet your changing needs.</p></div><div data-breakout="normal"><h3 dir="auto">Enhanced Safety</h3></div><div data-breakout="normal"><p dir="auto">Collaborative robots have built-in safety features like sensors to minimize workplace accidents. Their presence means risky tasks like lifting heavy materials can be offloaded, enhancing overall safety and worker well-being.</p></div><div data-breakout="normal"><h3 dir="auto">Ease of Use</h3></div><div data-breakout="normal"><p dir="auto">Programming a cobot doesn't require advanced coding skills. They often boast intuitive interfaces and drag-and-drop builders, making them accessible even for non-technical users. Ideal for SMEs that don’t have the financial capacity for a industrial robot installation.</p></div><div data-breakout="normal"><h3 dir="auto">Cost-Effective</h3></div><div data-breakout="normal"><p dir="auto">Cobots cost less to purchase upfront and maintain than industrial robots, making them a cost-effective solution.</p></div><div data-breakout="normal"><h3 dir="auto">Enhanced Quality</h3></div><div data-breakout="normal"><p dir="auto">Collaborative robots are nearly infallible, unlike humans. Their unwavering precision minimizes defects, improving overall product quality.</p></div><div data-breakout="normal"><h2 dir="auto">Cons of Cobots</h2></div><div data-breakout="normal"><p dir="auto">While cobots offer numerous advantages, they aren't flawless. Here are some of their downsides:</p></div><div data-breakout="normal"><h3 dir="auto">Limited Payload Capacity and Speed</h3></div><div data-breakout="normal"><p dir="auto">Collaborative robots are designed for light tasks and can't match the payload capacity or speed of traditional robots, making them unsuitable for heavy-duty tasks and high-volume production lines.</p></div><div data-breakout="normal"><h3 dir="auto">Slight Learning Curve</h3></div><div data-breakout="normal"><p dir="auto">Although collaborative robots are easier to program than industrial ones, there's still a learning curve involved in integrating them seamlessly into your workflow. So, be prepared to invest time and resources to train your team.</p></div><div data-breakout="normal"><h2 dir="auto">Automate Your Operations With Cobots Today</h2></div><div data-breakout="normal"><p dir="auto">Cobots can be a game-changer for a business, particularly for small or medium-sized enterprises that could benefit from automation.&nbsp;</p></div><div data-breakout="normal"><p dir="auto">By implementing cobots, you can boost productivity, enhance product quality, and increase production capacity, which could improve your bottom line.&nbsp;</p></div><div type="paragraph" data-hook="rcv-block174"><br></div><div data-breakout="normal"><div dir="auto"><br></div></div></div></div></div></div>

In this guide, we'll comprehensively address these questions. We'll delve into what cobots are, their various types, how they compare to industrial robots, their benefits, and more to assist you in understanding whether they might represent the future of technology.

What is a Cobot? The Ultimate Collaborative Robot Guide

<section id="isPasted"><p>Texas A&amp;M University is joining a new National Science Foundation (NSF) Engineering Research Center (ERC), led by Northwestern University, seeking to develop robots capable of enhancing human labor.&nbsp;</p><p>A central goal of the Human AugmentatioN via Dexterity (HAND) center is to make robotic assistance accessible and applicable to a wide range of physical actions through an engineered system of dexterous robotic hands, AI-powered fine motor skills, human interface, as well as developing the workforce and training for the future.</p><p>The five-year, $26 million grant also includes Carnegie-Mellon University and Florida A&amp;M University, with faculty support from Syracuse University, the University of Wisconsin-Madison and the Massachusetts Institute of Technology. The center’s NSF grant has the potential to be renewed for another $26 million for an additional five years. Founded in 1985, the NSF ERC program supports U.S. universities conducting convergent research, education and technology translation aimed at creating substantial societal impacts.&nbsp;</p><p>“We are excited to be a part of this groundbreaking initiative that will redefine the future of work and push the boundaries of technology to make a tangible impact,” said Dr. Robert H. Bishop, vice chancellor and dean for Texas A&amp;M Engineering. “At Texas A&amp;M, we believe in harnessing innovation to solve pressing problems and improve lives.”</p></section><blockquote><p>We are excited to be a part of this groundbreaking initiative that will redefine the future of work and push the boundaries of technology to make a tangible impact. At Texas A&amp;M, we believe in harnessing innovation to solve pressing problems and improve lives.</p><p><cite>- Dr. Robert H. Bishop</cite></p></blockquote><section><p>Dr. Cynthia Hipwell, Oscar S. Wyatt, Jr. ’45 Chair II Professor in the J. Mike Walker ’66 Department of Mechanical Engineering, will serve as a deputy director for the HAND center.&nbsp;</p><p>Hipwell said that current robotic tools typically require specialized expertise and an expensive integration process and thus are limited to high-volume, highly repeatable operations. The center’s approach in creating robotics that adaptably perform many different tasks and are easy for workers to use could provide affordable support to address labor shortages in manufacturing and caregiving, as well as food processing, handling precious or dangerous materials and more.</p><p>“Our vision is that it will be like the transition from mainframe computers used by specialized programmers to the arrival of the Apple Macintosh or PC [personal computer] as a tool that everybody could use,” said Hipwell. “We have many small and medium enterprises around our country that haven't been able to benefit from automation technology. We want to create something that workers can use as a tool to complete their work. That's really our vision — democratizing access to robotics.”</p><p>To achieve the goal of providing a practical and easily accessible tool, researchers have divided their work into three main areas:</p><ul><li>Hands: sensing, actuation, and design</li><li>Intelligent dexterity: simulation, representation, and control</li><li>Human interface: multimodal interface, no-code programming, and social/legal/industrial studies</li></ul><p>The center will also develop workforce training materials and an intuitive training interface enabling human operators of all education levels to teach the robots how to perform their necessary tasks.</p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 832px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1725498968571-News-COE-ActualRobotHands-23August2024.jpg" style="width: 100%px;" class="fr-fic fr-dib"><span class="fr-inner">An early prototype of robotic hands soldering. | Image:&nbsp;<cite id="isPasted">Courtesy of Dr. Cynthia Hipwell</cite></span></span></span></p><p id="isPasted">“The idea is that these tools could be something that any of us could use,” said Hipwell. “This could be something that could help a worker with physical work, or it could help someone stay in their home longer because they have physical assistance with some of their tasks. It could even be brought into areas where the work is dangerous and offer a way to help someone do physical work less dangerously.”</p><p>The HAND center brings together experts in various fields, including materials, manufacturing, manipulation, soft robotics, artificial intelligence, machine perception, modeling, haptics, human-robot interaction, participatory design and research, team science, education, law and the social sciences.</p><p>“To make a breakthrough in this area, you can't just move one aspect of it forward — just actuators or just control algorithms or just interface mechanisms. I think making a breakthrough requires this coordinated system approach,” said Hipwell. “We have the opportunity with this system-focused effort to make a much larger impact than we would as individual researchers working alone.”</p><hr><p>In addition to Hipwell, several Texas A&amp;M researchers will contribute to the center’s focus areas. <a href="https://cte.tamu.edu/who-we-are/our-team/debra-fowler" rel="noopener" target="_blank">Dr. Debra Fowler</a>, executive director of the Center for Teaching Excellence, will lead overall workforce development programs for the center, leading the creation of programs of study for future leaders in the field and programs for technicians, workers, and K-12 and community college outreach. <a href="https://engineering.tamu.edu/mechanical/profiles/ambrose-robert.html" rel="noopener" target="_blank">Dr. Robert Ambrose</a> will lead the High Consequence Materials Handling Testbed, which will help the center partner with collaborators such as NASA and Los Alamos National Laboratory on specific applications of HAND technology. Drs. <a href="https://engineering.tamu.edu/mechanical/profiles/friesen-rebecca.html" rel="noopener" target="_blank">Rebecca Friesen</a> and <a href="https://engineering.tamu.edu/biomedical/profiles/ware-taylor.html" rel="noopener" target="_blank">Taylor Ware</a> will contribute to the human interface and hands research areas, and<a href="https://engineering.tamu.edu/etid/profiles/gharib-mohamed.html" rel="noopener" target="_blank">&nbsp;Dr. Mohamed Gharib</a> will lead unique K-12 and community college outreach programs.</p></section>

Image: Rachel Barton/Texas A&M Engineering

Texas A&M University joins a Northwestern University-led Engineering Research Center to bring highly skilled, affordable robotic assistance to the workforce and beyond.

Researchers Team Up to Advance Robotic Dexterity

<section id="isPasted"><p><strong>The European Championship is still in full swing but, at TU Eindhoven, they are already hard at work on the next ‘soccer tournament’, the RoboCup 2024 from July 17-21 in Eindhoven. This is the world championship for robotics and involves fully autonomous robots that play soccer matches, perform household tasks or locate difficult-to-reach places as part of rescue work.</strong></p></section><section tabindex="-1"><p>Thousands of people are expected to visit Eindhoven for RoboCup 2024, the world’s largest competition in robotics and AI. The best teams from around the world will compete for the world title in various robot competitions.</p><p id="isPasted">Alongside René van de Molengraft, Professor of Robotics and co-founder of the successful TU/e team (and current robot soccer world champion) Tech United, we look ahead to the robot soccer tournament.</p><p>A conversation about the latest wonders we can see there, the challenges on the way to achieving the grand goal of defeating human soccer players by 2050, and why soccer robots – and robots in general – perform even better when they are lazy.</p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 790px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1721776291270-csm_51632710421_b5699b11ea_o_b7131df8d1.jpg" style="width: 100%px;" class="fr-fic fr-dib"><span class="fr-inner">Tech United’s soccer robots, with the goalkeeper on the left and a player on the right. In blue, you can see small omni wheels, which can roll both straight ahead and sideways. Photo: Bart van Overbeeke</span></span></span></p><section tabindex="-1" id="isPasted"><h3><strong>Tech United team</strong></h3><p>The soccer robots of TU Eindhoven’s team, Tech United, compete in the Middle Size League (MSL), the most spectacular robot soccer. Their healthcare robot, HERO, takes part in the @Home league.</p><p>Soccer robots are attracting a lot of attention, especially in the MSL. Using a real soccer ball, they play five-on-five matches in two 15-minute halves on an 18 x 12-meter field. They are programmed in advance but, once the whistle blows, they play soccer completely autonomously and humans are simply spectators.</p><p>They look like a sort of moving traffic cone on three omni wheels. These wheels cannot steer but can passively roll sideways. Thanks to these wheels, the robots are highly maneuverable and reliable.</p></section><section tabindex="-1"><h3><strong>The latest wonders</strong></h3><p>RoboCup primarily serves to stimulate the development of technology in mechatronics, computer science, electronics and AI, among other fields, with competition as the drive. After each tournament, the knowledge and progress are therefore shared with all participants. So, Tech United will have to come up with something new this year to go for its eighth (!) world title.</p><p>“We’re introducing two new elements this year,” says Van de Molengraft. “The first improvement concerns the wheels. This year, we have a player with three steerable wheels. This allows the robot to accelerate and brake much faster. For now, it will be used as a substitute to see if the robot can handle an entire tournament.”</p><p>“The other improvement is invisible as it relates to the software. We have completely recreated old code from the very beginning and have adapted it to the rest of the code. This code improves the robots’ movements and therefore basically all soccer actions.”</p><p><span contenteditable="false" draggable="true" class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable"><iframe width="640" height="360" src="https://www.youtube.com/embed/cfx4IONMwSU?&amp;wmode=opaque&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe></span><em>In this episode of Tiki Taka Touzani, presentor Soufiane Touzani and soccer player Ismael Saibari (PSV) visit team Tech United and show that humans can still play the robots out now. Source: NPO3 / Tiki Taka Touzani</em></p><h3 id="isPasted"><strong>Defeating human soccer players</strong></h3><p>Every few years, the RoboCup organization, in which Van de Molengraft is closely involved, draws up new rules for the various leagues. In doing so, they encourage innovations to get closer to the dot on the horizon: defeating a human soccer team by 2050. What will the next challenge be on the way to 2050?</p><blockquote><p><strong><em>We need the switch from wheels to legs to win against people.</em></strong></p><p><em>René van de Molengraft, Professor Robotics</em></p></blockquote><p>“I’m thinking of the switch from wheels to legs. We will have to do that because we really cannot compete against humans using wheels yet. For that, we need to allow games with multi-legged robots in the MSL. That would be an enormous new challenge for Tech United,” he explains.</p><p>“Of course, you will then see a huge drop-off in match results,” says Van de Molengraft. “But eventually, the robots on legs are going to win out over those on wheels. I’m really looking forward to that!”</p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 790px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1721776377105-csm_51633359139_8465ebf61b_o_3b5396a5b7.jpg" style="width: 100%px;" class="fr-fic fr-dib"><span class="fr-inner">Tech United's @HOME care robot picks up a cup of tea. Photo: Bart van Overbeeke</span></span></span></p><h3 id="isPasted"><strong>Practical challenges</strong></h3><p>In addition to the soccer leagues, the RoboCup has other categories in which to compete, such as autonomous healthcare robots and rescue robots. For example, Tech United is participating in the @Home league with their healthcare robot HERO.</p><p>Within this competition, the focus lies in the development of robots that can provide service and assistance in home or care situations. In the future, the hope is that this will enable elderly people to live at home for longer, for example. Here too, the team is mainly a spectator during the matches.</p><blockquote><p><strong>At the RoboCup, practical challenges are at the center of the care and rescue leagues.</strong></p><p>René van de Molengraft, Professor Robotics</p></blockquote><p>“You can see that highly practical challenges are at the center of the other leagues, such as picking up a cup of tea. The care robot has to know how big the cup is and how full it is, but also what material such a cup is made of. A plastic cup is easily crushed, resulting in hot tea everywhere. I see significant progress there, although the step to practice is still sizeable.”</p><p>“It’s a different story for rescue robots. Robots are already being deployed in rescue work in which humans are difficult to reach or where it is too dangerous. Examples include the disaster at Fukushima or the earthquakes in Turkey and Syria.”</p><p>“It’s really great to see rescue robots finding living people in incredibly difficult conditions, albeit usually still requiring a human operator to remotely control the robot.”</p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 790px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1721776418415-csm_51632932133_5d5131f4ce_o_f70bccc248.jpg" style="width: 100%px;" class="fr-fic fr-dib"><span class="fr-inner">Close-up of the part that the soccer robot uses to accept the ball and shoot it away. Photo: Bart van Overbeeke</span></span></span></p><h3 id="isPasted"><strong>At the heart of the research</strong></h3><p>The TU/e team Tech United has been around for almost twenty years now. Van de Molengraft was involved in the foundation of the RoboCup soccer team, taking inspiration from Philips’ then-successful team. A little later, in 2009, followed the start of research into autonomous robotics at TU/e with the RoboEarth<a href="https://www.tue.nl/en/research/research-institutes/robotics-research/projects/roboearth" target="_blank">&nbsp;project</a>, which had European funding.</p><p>“After that, we started carrying out more and more robotics projects and became a real research group. In 2019, as principal investigator<em>,&nbsp;</em>I was able to start my own robotics group,” he says.</p><p>“We began with five people and are now a real section with about fifty employees and a number of robotics courses in the Mechanical Engineering bachelor’s program. And, starting next academic year, we will also have our own Robotics master’s track.”</p><p>All of that research directly benefits the Tech United team as, in addition to students, the team consists of PhD candidates and staff.</p><h3 id="isPasted"><strong>Intelligent laziness</strong></h3><p>As of this month, Van de Molengraft may call himself a Professor of Lazy Robotics. By ‘lazy robots’, he means robots that intelligently recognize which information they can safely ignore. “Normal robots, such as self-driving cars, consider all of the information around them to be equally important. It doesn’t work that way with humans,” explains Van de Molengraft.</p><p>“Humans are perfectly capable of ignoring, for instance, visual information that is not important to a task.”</p><p>“Imagine yourself on a bicycle. You perceive all of the information that you do not require for safe participation in traffic, but you don’t store that information. That person walking out of the supermarket you’re cycling past: unimportant!”</p><p>“A self-driving car cannot do that yet. It has 20 cameras running simultaneously, viewing and analyzing each image. Everything is equally important, which takes a lot of computing power and a lot of energy. That needs to be improved.”</p><p><span class="fr-img-caption fr-fic fr-dib" style="width: 790px;"><span class="fr-img-wrap"><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1721776461208-csm_52217918068_0eded10aec_k_e581fd5b89.jpg" style="width: 100%px;" class="fr-fic fr-dib"><span class="fr-inner">Tech United robots chase the ball. Photo: Tech United</span></span></span></p><p id="isPasted">He gives another example: “We humans sit down or lean on a table when we don’t need to move. That costs us less energy. We want the same for robots. They have to become ‘intelligently lazy’, so to speak, and be able to assess which information is highly important for safety or their task and then focus on that.”</p><p>“But we still have a lot of work to do to get robots to be as intelligently ‘lazy’ as humans are, both in terms of software and hardware. And that’s what we are working on at TU/e.”</p><h3><strong>Lazy soccer robots</strong></h3><p>Van de Molengraft laughs at the question of whether the best soccer robots should therefore be lazy. “Yes, that would certainly help. They wouldn’t always have to drive to the right spot down to the millimeter, for example. They only need to do that when receiving and shooting the ball.”</p><p>“When a robot is simply moving freely, a few centimeters don’t really matter. We could make some gains there or do research on that. It does require some real rethinking on our part, but that’s what makes it such a great challenge that, to this day, never bores.”</p></section></section>

Tech United is the defending champion in the Middle Size League of the RoboCup, the most spectacular robot soccer. They have already been the world champion seven times. Photo: Bart van Overbeeke

Alongside René van de Molengraft, Professor of Lazy Robotics and founder of Tech United, we dive into the technology behind the RoboCup.

Why smart robots should be as lazy as possible

<p id="isPasted"><span data-contrast="none" lang="EN-US">Hidden occupational health risks impact both employees and businesses across sectors such as manufacturing, logistics, retail, and construction. By addressing these risks early and promoting safer working conditions, companies can achieve a 46% increase in efficiency!&nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p><p><span data-contrast="none" lang="EN-US">To discuss the critical role of safe work environments, Xsens is hosting a crash course webinar series that consists of two chapters. The first chapter,&nbsp;</span><a href="https://www.movella.com/resources/live-stream/workplace-ergonomics-maximising-workplace-health-and-efficiency" target="_blank" rel="noreferrer noopener"><span data-contrast="none" lang="EN-US"><span data-ccp-charstyle="Hyperlink">Workplace Ergonomics: Maximize Employee Well-being and Productivity</span></span></a><span data-contrast="none" lang="EN-US">, was held on April 30, and you can&nbsp;</span><span data-contrast="none" lang="EN-US">now&nbsp;</span><span data-contrast="none" lang="EN-US"><a href="https://bit.ly/3W7ePEn" target="_blank" rel="noopener noreferrer">register for the second session</a></span><span data-contrast="none" lang="EN-US">, which takes place on July 9.&nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p><p><span data-contrast="none" lang="EN-US"><span contenteditable="false" draggable="true" class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable"><iframe width="640" height="360" src="https://www.youtube.com/embed/NxUrHnd9xmQ?&amp;wmode=opaque&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"><span class="fr-mk" style="display: none;">&nbsp;</span><span class="fr-mk" style="display: none;">&nbsp;</span></iframe></span>&nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p><p><span data-contrast="none" lang="EN-US">Here are the topics we discussed in the first chapter: &nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p><ol start="1"><li data-leveltext="%1." data-font="Aptos" data-listid="1" data-list-defn-props='{"335552541":0,"335559685":720,"335559991":360,"469769242":[65533,0],"469777803":"left","469777804":"%1.","469777815":"hybridMultilevel"}' data-aria-posinset="1" data-aria-level="1"><p><span data-contrast="none" lang="EN-US">What is workplace ergonomics, and how does it impact occupational health and safety?&nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p></li></ol><p><span data-contrast="none" lang="EN-US">Workplace ergonomics is a critical aspect of occupational health &amp; safety. It involves tailoring workspaces and processes in line with human physical and cognitive abilities. It aims to reduce the risk of musculoskeletal disorders (MSDs) and enhance a facility's safety and productivity. Poor ergonomics can lead to significant financial impacts, including high injury costs and operational disruptions. On average, workplace injuries cost businesses over $20,000 per incident and result in about 20 days (about 3 weeks) of lost work time.&nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p><ol start="2"><li data-leveltext="%1." data-font="Aptos" data-listid="1" data-list-defn-props='{"335552541":0,"335559685":720,"335559991":360,"469769242":[65533,0],"469777803":"left","469777804":"%1.","469777815":"hybridMultilevel"}' data-aria-posinset="2" data-aria-level="1"><p><span data-contrast="none" lang="EN-US">Why is workplace ergonomics so important for organizations? &nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p></li></ol><p><span data-contrast="none" lang="EN-US">Poor ergonomics in workplaces can result in high injury costs and challenges in maintaining operational continuity. Furthermore, companies need to abide by international standards, such as ISO, OSHA, and EN norms, that serve as objective tools for ergonomic assessments and imply legal consequences for non-compliant facilities.&nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p><ol start="3"><li data-leveltext="%1." data-font="Aptos" data-listid="1" data-list-defn-props='{"335552541":0,"335559685":720,"335559991":360,"469769242":[65533,0],"469777803":"left","469777804":"%1.","469777815":"hybridMultilevel"}' data-aria-posinset="3" data-aria-level="1"><p><span data-contrast="none" lang="EN-US">What are some of the different ergonomic assessment methods and tools often used by organizations?&nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335551550":1,"335551620":1,"335559685":720,"335559737":0,"335559738":0,"335559739":0,"335559740":279,"335559991":360}'>&nbsp;</span></p></li></ol><p><span data-contrast="none" lang="EN-US">There are several options for conducting ergonomic assessment today:</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p><ul><li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props='{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}' data-aria-posinset="1" data-aria-level="1"><p><span data-contrast="none" lang="EN-US">Traditional ergonomic assessments rely on manual methods such as checklists and video recordings to observe worker postures and movements based on international standards such as ISO and OSHA.&nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p></li><li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props='{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}' data-aria-posinset="2" data-aria-level="1"><p><span data-contrast="none" lang="EN-US">Advanced software tools, including Siemens Process Simulate and CATIA, offer digital workspace design and ergonomic assessment capabilities.&nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p></li><li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props='{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}' data-aria-posinset="3" data-aria-level="1"><p><span data-contrast="none" lang="EN-US">AI-powered video analysis tools automate assessments by tracking joint angles and movements but may not fully capture dynamic work environments.&nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p></li><li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props='{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}' data-aria-posinset="4" data-aria-level="1"><p><span data-contrast="none" lang="EN-US">Motion capture, allowing for rapid data collection and&nbsp;objective&nbsp;analysis, offers a quick return on investment by reducing injury rates and associated costs.</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p></li></ul><p><span data-contrast="none" lang="EN-US">Prioritizing improved ergonomics can profoundly impact worker well-being and satisfaction. Businesses can lower costs and boost productivity by reducing injuries and creating safer work environments. &nbsp;&nbsp;</span><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p><p><span data-contrast="none" lang="EN-US">Do not miss the second chapter of our webinar series, where we will talk about the role of motion capture in promoting occupational health &amp; safety, real-life use cases, and ROI! Register today:&nbsp;</span><a href="https://bit.ly/3W7ePEn" target="_blank" rel="noopener noreferrer">https://bit.ly/3W7ePEn</a></p><p><span data-ccp-props='{"134233117":false,"134233118":false,"201341983":0,"335559738":0,"335559739":0,"335559740":279}'>&nbsp;</span></p><p><span data-ccp-props='{"201341983":0,"335559739":160,"335559740":279}'>&nbsp;</span></p>

A woman wearing Xsens Awinda suit sorting our fruits in the supermarket environment. The pose analytics are visualized using Scalefit

Improved occupational health and safety can enhance productivity by 46% and boost employee well-being. To address these opportunities, Xsens is launching a crash course on topics like injury risk reduction, regulation compliance, and the positive influence of safer workspaces.

A crash course on occupational health & safety: safer workplaces for improved productivity

<p id="isPasted">Humanoid robots are designed to resemble and mimic human actions and interactions, placing them as a bridge forming collaborations between humans and machines. Their human-like appearance and movements create a sense of relatability and approachability not typically seen in traditional industrial robots. This "personal appeal" has sparked increased interest in developing humanoid robots for diverse applications, such as healthcare, customer service, education, and even space exploration - where human characteristics such as empathy, decision-making making, and personality are deemed valuable.&nbsp;</p><p>This article provides insights into four of the leading humanoid robot projects from around the world.&nbsp;</p><h2>Selection Rationale</h2><p>The humanoid robots selected in this comparison represent the pinnacle of the current state of humanoid robotic technology. Each robot was selected based on its unique contributions to its field, ranging from technical capabilities to broadest application.&nbsp;</p><p>Each selected robot is also in full production and either available for purchase or being used by their creators in real-time applications.&nbsp;</p><h2>Optimus by Tesla</h2><p>Also known as Tesla Bot, this general-purpose, bipedal, autonomous humanoid robot was created to perform unsafe, repetitive, or boring tasks. The company announced the robot's development in August 2021 and showed the prototype in 2022. Tesla's CEO, Elon Musk, claimed that Optimus will eventually be able to do "anything that humans don’t want to do."</p><p>Tesla's Optimus can sort colored blocks by color, locate its limbs in space, do some yoga, and even poach an egg. In December 2023, Musk released a video showing an Optimus Generation 2 walking and dancing. The new robot features a slimmer figure and sleeker, more precise movements.&nbsp;</p><p>The robot is planned to measure 5 ft 8 in (173 cm) tall and weigh 125 lb (57 kg), and it will be controlled by the same AI system that Tesla uses in its cars. With a carrying capacity of 45 lb (20 kg), it can provide manufacturing assistance, and Musk has already commented that the robots will be utilized in Tesla’s car factories by the end of 2024 to enhance the factory's efficiency and significantly reduce production costs.&nbsp;</p><p id="isPasted">The first commercial units of Tesla's Optimus will launch in 2025.</p><p><span class="fr-img-caption fr-fic fr-dii" style="width: 780px;"><span class="fr-img-wrap"><img width="624" src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1719036519097-1719036519097.png" class="fr-fic fr-dii" style="width: 778px;"><span class="fr-inner"><em id="isPasted">Optimus, by Tesla, promises to be the future of automation in manufacturing. Credit:&nbsp;</em><a href="https://www.tesla.com/en_eu/AI" target="_blank"><em>Tesla</em></a></span></span></span></p><h2>Atlas by Boston Dynamics</h2><p>Atlas, engineered by leading robotic company Boston Dynamics, represents a huge leap forward for robotic mobility and adaptability. Debuting on July 11, 2013, Atlas was designed to traverse and interact with its surroundings with a fluidity and precision reminiscent of human motion. Constructed with robust plastics, titanium, and aluminum 3D printed parts, Atlas was originally &nbsp; driven by powerful hydraulic actuators, but now, the company has announced a fully electric robot. In widely shared videos, Atlas has demonstrated a broad spectrum of physical prowess, including running, leaping, and executing backflips easily. These types of motion are difficult as they require the robot to self-correct and consider environmental factors.&nbsp;</p><p>Atlas uses a comprehensive sensor network powered by AI to facilitate meticulous navigation and the proficient completion of multifaceted tasks across diverse landscapes. Such capabilities mean Atlas may have a future in scenarios such as search and rescue or fire management, where its agility and adaptability can be leveraged to great effect.&nbsp;</p><p>After being acquired by &nbsp;Hyundai in 2021, the focus will be testing and iterating Atlas applications in manufacturing environments. The company promises that the electric version of Atlas is stronger and has a broader range of motion than previous models.&nbsp;</p><p><span contenteditable="false" draggable="true" class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable"><iframe width="640" height="360" src="https://www.youtube.com/embed/-e1_QhJ1EhQ?&amp;wmode=opaque&amp;rel=0&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe></span><br></p><h2>NAO by Aldebaran</h2><p>NAO is an autonomous, programmable humanoid robot originally developed by Aldebaran Robotics. SoftBank Robotics acquired the French company in 2015 and released NAO 3. In July 2022, the company was rebranded Aldebaran again.</p><p>Nao is available as a research robot for schools, colleges and universities to teach programming as well as conducting research into human-robot interactions. Over 5,000 Nao robots are used in 200+ educational and research institutions in 70 countries. The robots are also used in healthcare scenarios, such as care homes.</p><p>NAO6, the latest version, features 25 degrees of freedom and an inertial measurement unit with an accelerometer, gyroscope, and four ultrasonic sensors that support NAO with stability and movement. The robots are also equipped with seven touch sensors to perceive their environment and their speech recognition is available in 20 languages. The robot also has 5G capabilities.</p><p>&nbsp;</p><p><span class="fr-img-caption fr-fic fr-dii" style="width: 780px;"><span class="fr-img-wrap"><img border="0" width="624" src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1719036519109-1719036519109.png" class="fr-fic fr-dii"><span class="fr-inner"><em id="isPasted">From supporting the education of autistic children to helping train International Space Station astronauts and assisting elderly patients in care homes, NAO robots have been integrated into education and healthcare applications. Credit:&nbsp;</em><a href="https://www.aldebaran.com/de/nao" target="_blank"><em>Aldebaran</em></a></span></span></span></p><h2>Ameca by Engineered Arts</h2><p>Ameca, first developed by Engineered Arts in February 2021, is currently the most advanced human-shaped robot in the market, developed specifically for human-robot interaction. They are modular, upgradable, and easy to develop upon.</p><p>With embedded microphones, binocular eye-mounted cameras, a chest camera, &nbsp;and facial recognition software, Ameca's interactions with the public work by GPT-3 or human telepresence. It also has motorized arms, fingers, neck, and facial features on grey rubber skin, designed to appear genderless. Engineered Arts has developed their own hardware, based on proprietory research into humanoid robotics, and built with their Mesmer technology, a system focused on powerful, cost-effective, and realistic humanoid robots.</p><p>Ameca is currently associated with the Museum of the Future in Dubai (UEA), where people can interact with it.&nbsp;</p><p><span contenteditable="false" draggable="true" class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable"><iframe width="640" height="360" src="https://player.vimeo.com/video/651929733" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe></span><br></p><h2>Technology Overview&nbsp;</h2><p>&nbsp;</p><table border="1" cellspacing="0" cellpadding="0" width="632"><tbody><tr><td width="12.341772151898734%" valign="bottom"><p><strong>Robot</strong></p></td><td width="13.291139240506329%" valign="bottom"><p><strong>Company/Creator</strong></p></td><td width="11.550632911392405%" valign="bottom"><p><strong>Vision &amp; Goal</strong></p></td><td width="13.132911392405063%" valign="bottom"><p><strong>Materials</strong></p></td><td width="17.088607594936708%" valign="bottom"><p><strong>AI Capabilities &amp; Technology</strong></p></td><td width="16.139240506329113%" valign="bottom"><p><strong>Applications</strong></p></td><td width="16.455696202531644%" valign="bottom"><p><strong>Command &amp; Agility</strong></p></td></tr><tr><td width="12.341772151898734%"><p>Optimus</p></td><td width="13.291139240506329%"><p>Tesla&nbsp;</p></td><td width="11.550632911392405%"><p>Replace humans in manufacturing operations for repetitive and dangerous tasks</p></td><td width="13.132911392405063%"><p>Polyether Ether Ketone (PEEK)</p></td><td width="17.088607594936708%"><p>Tesla-designed actuators and sensors</p></td><td width="16.139240506329113%"><p>Manufacturing support and training</p></td><td width="16.455696202531644%"><p>Carrying capacity of 20kg, can dance, boil eggs, do squats</p></td></tr><tr><td width="12.341772151898734%"><p>Atlas</p></td><td width="13.291139240506329%"><p>Boston Dynamics</p></td><td width="11.550632911392405%"><p>Navigate and manipulate environments with human-like agility</p></td><td width="13.132911392405063%"><p>Titanium and aluminum&nbsp;</p></td><td width="17.088607594936708%"><p>Precise navigation, execution of complex tasks in varied terrains</p></td><td width="16.139240506329113%"><p>Search and rescue, exploration, logistics</p></td><td width="16.455696202531644%"><p>Responsive to commands, capable of running, jumping, performing backflips</p></td></tr><tr><td width="12.341772151898734%"><p>NAO</p></td><td width="13.291139240506329%"><p>Aldebaran</p></td><td width="11.550632911392405%"><p>Human interaction and educational support</p></td><td width="13.132911392405063%"><p>Polycarbonate-ABS plastic, polyamide, and carbon-fiber-reinforced thermoplastic</p></td><td width="17.088607594936708%"><p>Conversational AI, personalized interaction based on facial recognition, collect information&nbsp;</p></td><td width="16.139240506329113%"><p>Education, research, healthcare</p></td><td width="16.455696202531644%"><p>Walk, dance, speak, and recognize faces and objects</p></td></tr><tr><td width="12.341772151898734%"><p>Ameca</p></td><td width="13.291139240506329%"><p>Engineered Arts</p></td><td width="11.550632911392405%"><p>Development platform for testing AI and machine learning systems</p></td><td width="13.132911392405063%"><p>Mesmer technology</p></td><td width="17.088607594936708%"><p>Process complex data, recognize faces, comprehend speech, and adapt to different scenarios</p></td><td width="16.139240506329113%"><p>Human interaction, a platform for developing AI</p></td><td width="16.455696202531644%"><p>Advanced facial expression and human-like interactions</p></td></tr></tbody></table><p>&nbsp;</p><h2>Conclusion: The Pioneers of Humanoid Robotics - A Unified Perspective</h2><p>The exploration of Optimus, Atlas, NAO, and Ameca highlights the remarkable journey and achievements in humanoid robotics. Each robot, distinct in its capabilities and applications, contributes uniquely to the field. From Ameca's social interactions to Atlas's agility, NAO's educational support, and Optimus's manufacturing utility, these pioneers embody the diverse potential of robotics.</p><p>Their materiality and design philosophies are tailored to specific applications, showcasing innovation in construction and functionality. The AI and technological advancements across these robots cover a broad spectrum, enabling them to perform tasks ranging from basic interactions to complex, autonomous problem-solving. Their deployment in healthcare, customer service, manufacturing exploration, and emergency response illustrates the expanding role of robotics in meeting intricate human needs.</p><p>The integration of sophisticated command systems and remarkable agility demonstrates the evolving interface between humans and machines, pushing the boundaries of what humanoid robots can achieve. This unified perspective underlines the transformative impact of humanoid robotics, promising a future where their presence becomes an integral part of daily life and complex problem-solving across various sectors.</p>

Exploring innovations, capabilities, and the future of robotic companions

A quick engineering comparison of cutting-edge humanoid robots

In this episode, we discuss how MIT researchers are making great strides in developing better robotic hands by focusing on an often overlooked component: the palm.

Podcast: Talk to The Hand: Meet The Robots With a Human Touch

<p id="isPasted">This article was discussed in our <a href="https://www.wevolver.com/profile/the.next.byte" rel="noopener noreferrer" target="_blank">Next Byte podcast</a>.&nbsp;</p><p><span contenteditable="false" draggable="true" class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable"><iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless="" src="https://player.simplecast.com/deaf3bb7-ff61-48d1-ad11-30ae0112d53e?dark=false" class="fr-draggable" data-gtm-yt-inspected-23="true" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe></span><br></p><p>The full article will continue below.</p><hr><p dir="ltr" id="isPasted">“I'll have you eating out of the palm of my hand” is an unlikely utterance you'll hear from a robot. Why? Most of them don't have palms.</p><p dir="ltr">If you have kept up with the protean field, gripping and grasping more like humans has been an ongoing Herculean effort. Now, a new robotic hand design developed in MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) has rethought the oft-overlooked palm. The new design uses advanced sensors for a highly sensitive touch, helping the “extremity” handle objects with more detailed and delicate precision.</p><p dir="ltr"><a href="https://arxiv.org/pdf/2404.08227" target="_blank">GelPalm</a> has a gel-based, flexible sensor embedded in the palm, drawing inspiration from the soft, deformable nature of human hands. The sensor uses a special color illumination tech that uses red, green, and blue LEDs to light an object, and a camera to capture reflections. This mixture generates detailed 3D surface models for precise robotic interactions.</p><p dir="ltr"><span contenteditable="false" draggable="true" class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable"><iframe width="640" height="360" src="https://www.youtube.com/embed/5S9dZQv5qAc?&amp;wmode=opaque&amp;rel=0&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true" data-gtm-yt-inspected-23="true" id="894047451" title="Robotic palm mimics human touch"><span class="fr-mk" style="display: none;">&nbsp;</span></iframe></span><em>GelPalm. Video: MIT CSAIL</em></p><p dir="ltr" id="isPasted">And what would the palm be without its facilitative fingers? The team also developed some robotic phalanges, called ROMEO (“RObotic Modular Endoskeleton Optical”), with flexible materials and similar sensing technology as the palm. The fingers have something called “passive compliance,” which is when a robot can adjust to forces naturally, without needing motors or extra control. This in turn helps with the larger objective: increasing the surface area in contact with objects so they can be fully enveloped. Manufactured as single, monolithic structures via 3D printing, the finger designs are a cost-effective production.</p><p dir="ltr">Beyond improved dexterity, GelPalm offers safer interaction with objects, something that’s especially handy for potential applications like human-robot collaboration, prosthetics, or robotic hands with human-like sensing for biomedical uses.</p><p dir="ltr">Many previous robotic designs have typically focused on enhancing finger dexterity. Liu's approach shifts the focus to create a more human-like, versatile end effector that interacts more naturally with objects and performs a broader range of tasks.&nbsp;</p><p dir="ltr">“We draw inspiration from human hands, which have rigid bones surrounded by soft, compliant tissue,” says recent MIT graduate Sandra Q. Liu SM ’20, PhD ’24, the lead designer of GelPalm, who developed the system as a CSAIL affiliate and PhD student in mechanical engineering. “By combining rigid structures with deformable, compliant materials, we can better achieve that same adaptive talent as our skillful hands. A major advantage is that we don't need extra motors or mechanisms to actuate the palm's deformation — the inherent compliance allows it to automatically conform around objects, just like our human palms do so dexterously.”</p><p dir="ltr">The researchers put the palm design to the test. Liu compared the tactile sensing performance of two different illumination systems — blue LEDs versus white LEDs — integrated into the ROMEO fingers. “Both yielded similar high-quality 3D tactile reconstructions when pressing objects into the gel surfaces,” says Liu.</p><p dir="ltr">But the critical experiment, she says, was to examine how well the different palm configurations could envelop and stably grasp objects. The team got hands-on, literally slathering plastic shapes in paint and pressing them against four palm types: rigid, structurally compliant, gel compliant, and their dual compliant design. “Visually, and by analyzing the painted surface area contacts, it was clear having both structural and material compliance in the palm provided significantly more grip than the others,” says Liu. “It's an elegant way to maximize the palm's role in achieving stable grasps.”</p><p dir="ltr">One notable limitation is the challenge of integrating sufficient sensory technology within the palm without making it bulky or overly complex. The use of camera-based tactile sensors introduces issues with size and flexibility, the team says, as the current tech doesn't easily allow for extensive coverage without trade-offs in design and functionality. Addressing this could mean developing more flexible materials for mirrors, and enhancing sensor integration to maintain functionality, without compromising practical usability.</p><p dir="ltr">“The palm is almost completely overlooked in the development of most robotic hands,” says Columbia University Associate Professor Matei Ciocarlie, who wasn’t involved in the paper. “This work is remarkable because it introduces a purposefully designed, useful palm that combines two key features, articulation and sensing, whereas most robot palms lack either. The human palm is both subtly articulated and highly sensitive, and this work is a relevant innovation in this direction.”</p><p dir="ltr">“I hope we're moving toward more advanced robotic hands that blend soft and rigid elements with tactile sensitivity, ideally within the next five to 10 years. It's a complex field without a clear consensus on the best hand design, which makes this work especially thrilling,” says Liu. “In developing GelPalm and the ROMEO fingers, I focused on modularity and transferability to encourage a wide range of designs. Making this technology low-cost and easy to manufacture allows more people to innovate and explore. As just one lab and one person in this vast field, my dream is that sharing this knowledge could spark advancements and inspire others.”</p><p>Ted Adelson, the John and Dorothy Wilson Professor of Vision Science in the Department of Brain and Cognitive Sciences and CSAIL member, is the senior author on a <a href="https://arxiv.org/pdf/2404.08227" target="_blank">paper describing the work</a>. The research was supported, in part, by the Toyota Research Institute, Amazon Science Hub, and the SINTEF BIFROST project. Liu presented the research at the International Conference on Robotics and Automation (ICRA) earlier this month.</p>

MIT CSAIL student Sandra Q. Liu displays her innovative GelPalm robotic design in her lab workspace. Photo: Michael Grimmett/MIT CSAIL

MIT CSAIL researchers enhance robotic precision with sophisticated tactile sensors in the palm and agile fingers, setting the stage for improvements in human-robot interaction and prosthetic technology.

Robotic palm mimics human touch

<p>At Voltera, we love our test engineering interns. They bring fresh new ideas into our workspace and have a ton of fun exploring with our machines. It’s a privilege to provide mentorship, equipment, and resources to nurture brilliant young minds, and see what they dream up.&nbsp;</p><p>At the beginning of his work term, Dawson Martian — a second-year undergrad studying Mechatronics, Robotics, and Automation Engineering at the University of Waterloo — came up with a project idea that would put both the <a href="http://voltera.io/v-one" target="_blank">V-One</a> and <a href="http://voltera.io/nova" target="_blank">NOVA</a> to the test: Designing and building a robot hand that would mimic the movements of an operator wearing a control glove.</p><p>Dawson had been working on a different project at the time, designing a light-up glove using stretchable ink and thermoplastic polyurethane<strong>&nbsp;</strong>(TPU). “I noticed when the glove was put on and powered, the brightness of the LEDs would vary depending on whether the user’s hand was opened or closed,” he recalled. “This got me thinking about how the lights were dimming due to the resistance of the traces increasing whenever they were stretched, essentially the traces were acting as strain gauges,” he said. “From there I realized I could take advantage of this property and use this varying resistance to control a machine or program…what better way to show this unique property than by having a robotic hand mimic my movements?”</p><p>So, Dawson got to work. He started by building a robotic hand with movable fingers. The hand components were 3D-printed using non-flexible filament, the joints were made with TPU, and then assembled. He ran the wire up the fingers and connected these to servos. These would operate as tendons, so the hand could move. He connected the servos to an Arduino™ with a custom breakout board — which he made using the V-One.&nbsp;</p><p>For the control glove, Dawson printed strain gauges onto TPU using NOVA and heat-pressed the strain gauges onto a fabric glove using a t-shirt press. Dawson wired a second Arduino and custom breakout board to the traces on the control glove using a conductive adhesive and mounted the board to a wrist strap.&nbsp;</p><p>The two boards communicate via Bluetooth® transceivers, so if all worked as it should, the board on the control glove would measure resistance in the strain gauges, then transmit movement instructions to the second board. This information would control the actuators of the robotic hand.&nbsp;</p><p>Of course, nothing goes <em>exactly&nbsp;</em>as planned, and Dawson hit a bit of a snag when he was designing the strain gauges. But, let’s rewind for a minute.&nbsp;</p><h2><strong>What is a strain gauge, anyway?</strong></h2><p>“A strange gauge is essentially just a resistor whose resistance value varies with changes in strain — being stretched, bent, or compressed,” Dawson explained. “You can think of it as a stretchable pipe with water running through it. As you stretch the pipe, it becomes longer but also narrower, restricting the flow”.&nbsp;</p><p>Now, apply this same principle to the traces in the control glove, which are made with stretchable conductive ink. As the traces stretch, they become longer and narrower, restricting the flow of electricity — it changes the resistance. The accompanying transmitter board interprets this change in resistance, and that information can then be used to control other devices — like the robotic hand.&nbsp;</p><p>Dawson’s biggest hurdle was designing the strain gauges for the control glove — finding the optimal procedure that would allow the gauges to fully stretch without losing conductivity completely, but still have a measurable change in resistance. In the end, he found that thicker traces resulted in more consistent continuity while stretching.&nbsp;</p><p><br></p><p><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1704362901155-6373badbe9c8bd5af2c5faf5_Robot+Glove_1_optimized.gif" style="width: 300px;" class="fr-fic fr-dib"></p><p><br></p><h2 id="isPasted"><strong>Imagine the possibilities</strong></h2><p>Stretchable conductive ink gives you the ability to create a strain gauge on almost any stretchable material, and that has incredible potential to drive innovation. Industries across the board, from manufacturing to healthcare to wearable technology, are on the threshold of major change, thanks to the emerging field of&nbsp;<a href="https://www.idtechex.com/en/research-article/flexible-hybrid-electronics-future-of-flexible-printed-circuit-boards/20603" target="_blank">flexible hybrid electronics</a>.&nbsp;</p><p>Over the course of just&nbsp;<em>two months</em>, Dawson was able to successfully design and build a fully-functional robotic hand that mimics the movements of an operator wearing a control glove. Imagine what could be accomplished by seasoned researchers and engineers.</p><p>When asked about the potential applications for this kind of technology, Dawson lit up. “Why stop at just a hand? Why not use this technology to have a whole arm that mimics my own? Possibly even a full robot that mirrors my every move, and the majority of that could be achieved using similar techniques that were used for just the hand,” Dawson exclaimed. “The most exciting thing for me was the realization of the true possibilities that NOVA brings to the world of stretchable and flexible electronics”.</p><p>This technology could have life-altering and transformative potential in industries across the board — from biomedical applications and wearables to prosthetics. “I could see this technology being used in workplaces that present a high risk of injury, but still require the delicate handling of a human. For instance, if some work needs to be done on a machine but the area is radioactive or unsafe, the worker could remotely control this hand to perform the task, while staying in a safe location.” Dawson said. “This project could also be scaled up or down in size to meet specific requirements, for instance, you could have a small robotic hand do work inside a machine, in spaces where a human could not fit, being controlled by an operator outside the machine”.&nbsp;</p><p>You can read the finer details of Dawson’s work with&nbsp;<a href="https://uploads-ssl.webflow.com/6334888a34bfac03b46aa715/6362829f808f8037c5b5e9d9_NOVA-0094%20-%20Robot%20Glove%20Case%20Study_FINAL%20(4).pdf" target="_blank" data-lf-fd-inspected-kn9eq4roawkarlvp="true">NOVA</a> and the&nbsp;<a href="https://uploads-ssl.webflow.com/6334888a34bfac03b46aa715/636282bb3c1c464ccd273de1_VONE-0001%20-%20Robot%20Glove%20Case%20Study_FINAL%20(3).pdf" target="_blank" data-lf-fd-inspected-kn9eq4roawkarlvp="true">V-One</a> by checking out&nbsp;<a href="https://uploads-ssl.webflow.com/6334888a34bfac03b46aa715/6554cb7c0b836d9be99ef8fa_2022_NOVA%20robot%20glove%20case%20study.pdf" target="_blank" data-lf-fd-inspected-kn9eq4roawkarlvp="true">case studies</a> on this project.</p>

Dawson Martian — a second-year undergrad at the University of Waterloo — came up with a project idea that would put both the V-One and NOVA to the test: Designing and building a robot hand that would mimic the movements of an operator wearing a control glove.

Building a Remote Controlled Robotic Hand with Strain Gauges

<p id="isPasted">The recent advances in Large Language Models (LLM) have made a lot of noise recently – everybody is using ChatGPT. Robotics is no exception; there has been a lot of talk about how to integrate them in various kind of robotic use cases; in this article, we will talk about their applications to social robots like NAO and Pepper.&nbsp;</p><h2>Social Robots? &nbsp;</h2><p>Social robots are designed to be used in a places, interacting with people, and as such are a natural fit for conversation-oriented language models. But they have been used for years before that, and the field of human-robot interaction is well-developed.&nbsp;</p><p>Compared to a GUI chat interface like ChatGPT, social robots have to deal with extra uncertainty linked to speech recognition (the input the langauge model received might not be what the user intended to say), and handling several users speaking, some of which might not even intend to speak to the robot.&nbsp;</p><h2>Improving what the robot understands&nbsp;</h2><p>One advantage LLMs have is in understanding open-ended instructions. There are several challenges in understanding voice commands:&nbsp;</p><ol><li><strong>Speech recognition</strong>: turning the raw sounds into text; how effective this is is going to depend of how the user speaks (accents, slurred speech, volume, clarity of enunciation), the characteristics of the microphone, surrounding sound, etc.&nbsp;</li><li><strong>Variety of expressions</strong>: In practice, people have a huge variety of ways of expressing even simple things (For example: "I'm looking for an ATM", "Would you show me the nearest ATM?", "Is there an ATM around here?", "Where's the nearest ATM?","Do you know where I can withdraw some money?", "Where can I withdraw cash around here?", "Is there an ATM in this building?" etc.); and handling all of those properly usually requires some bespoke customisation via a dialogue engine like dialogflow or qichat.&nbsp;</li><li><strong>Context</strong>: In addition to the explicit information contains in a question like the ATM example above, some information comes from what was previously discussed ("How much does one cost?" "How can I get there?"), or from gestures such as pointing ("Is it that way?" "What's that?"); keeping track of that information usually requires more bespoke logic related to keeping track of users.&nbsp;</li></ol><p>These are all challenges that could be handled previously with some work; but LLMs introduced a great increase in quality: they can be very good at handling a wide variety of expressions out of the box. They are also very good at taking into account any context included in the conversation log (typically sent alongside the prompt); this usually includes previous conversation but (with a bit more work) can include any information that can be infered from the sensors (for example, by using an object recognition model to turn what the robot sees into a text description).&nbsp;</p><p>One more surprising improvement when using LLMs is on speech recognitions – more specifically, even if there are mistakes in the speech recognition (that can be misheard words, but also homophones like their/there/they're), the LLM will often use context and common sense to handle the input appropriately anyway, giving the impression of a robot that hears better.&nbsp;</p><h2>Improving how the robot answers&nbsp;</h2><p>One obvious output is Speech, and plugged into a speech-to-text engine, a LLM can easily create a conversational robot.&nbsp;</p><p>However, this brings a few new issues:&nbsp;</p><ul><li>One notorious ones is hallucinations, a problem that's far from solved for LLMs. The robot can understand a wider variety of inputs, his answers to those might be confident but highly inaccurate – if there's a word he doesn't understand, he might decide to invent a fanciful product description; if an unfamiliar name is given, he might make someone up. This can be mitigated, but at the risk of making the robot repetitive or boring – it's a fine balance, and it might depend on the use case.&nbsp;</li><li>A less obvious one is speech that's too verbose. If ChatGPT talks too much, the user can just skim the paragraphs; but a speaking robot takes time and can be much more annoying. This can be improved with better prompting, with pretraining etc. as well as UX tweaks (e.g. a way of interrupting the robot) but requires careful attention. More generally, the LLM's output might sometimes not be as good quality as hand-crafted one.&nbsp;</li></ul><p>However, a robot is more than a smart speaker – it might have arms, wheels, etc. and the LLM can be made to control those, either directly or from a library of presets (e.g. navigation waypoints) - in effect, the output of the LLM is not just speech but actions.&nbsp;</p><h2>How to deal with it the best&nbsp;</h2><p>How to deal with hallucinations and other problems may depend of the use case:&nbsp;</p><ul><li>For entertainment purposes, the hallucinations may not be a problem, and can even be part of the fun, as long as that is well-presented to the user.&nbsp;</li><li>For information purposes, a choice needs to be made between using LLM output and risking hallucinations, or using fixed, well-prepared outputs.&nbsp;</li><li>One should also keep in mind other non-speech actions and see how many of those can be controlled by the LLM.&nbsp;</li></ul><p>Apart from the technical performance on input and output, the largest strengths of LLMs is flexibility – adapting the robot to a new use case, or to a specific context for a new use case, can be as simple as editing a prompt, and produces a behavior of decent quality.&nbsp;</p><p>This allows for much quicker iterations. &nbsp;</p><h2>Further directions&nbsp;</h2><p>In robotics (social or not) and elsewhere, engineers, researchers and tinkerers all over the world are experimenting with interesting ways to use LLMs. We've covered a few we have experience with here, but there are many more directions that could be applicable, such as:&nbsp;</p><ul><li>integrating vision models to plug it with what the robot sees, to make it even more aware of the context&nbsp;</li><li>making the robot proactively decide what to do (not just respond to what he heard, but decide to e.g. walk up to such-and-such a person and engage conversation)&nbsp;</li><li>giving the robot a long-time memory&nbsp;</li></ul><p>LLMs offer great possibilities for social robots if used well, and it will be interesting to observe how the field evolves in the coming years – in the coming months even.&nbsp;</p>

A Pepper robot showing a ChatGPt-type dialogue

Lessons learnt from integrating ChatGPT in Pepper and NAO

Bringing the LLM revolution to social robots

<p><span contenteditable="false" draggable="true" class="fr-video fr-deletable fr-fvc fr-dvb fr-draggable"><iframe src="https://www.youtube.com/embed/-0n_MFLKD3M?autoplay=1&amp;mute=1&amp;wmode=opaque" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true" style="width: 766px; height: 432px;"></iframe></span><br></p><p id="isPasted">It is reported that Unitree took the lead in delving into industry applications as early as 2017. As a leading force in the industry, Unitree industrial quadruped robot brought by Unitree has been upgraded on the basis of the B1 with a full range of upgrades, including the comprehensive capacity of load, range, motion capability, speed, etc., which is 2 to 3 times that of existing quadruped robots in the world, enabling it to play a role in more application scenarios.</p><p>&nbsp;</p><p><strong>1. The fastest running industrial-grade quadruped robot</strong></p><p>B2 has a significant improvement in speed, with a running speed of more than 6m/s to become the fastest known industrial-grade quadruped robot on the market. At the same time with the maximum jumping distance of up to 1.6m, can be more efficient and flexible for the industry application empowerment.</p><p>&nbsp;<img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1700640716066-Unitree+B2-5.jpg" style="width: 766px;" class="fr-fic fr-dib"></p><p><strong>2. Continuous load increased by 100%, endurance soared by 200</strong></p><p>B2's maximum standing load capacity reaches 120kg, continuous walking load is more than 40kg&nbsp;with an increase of 100%; 20kg load continuous walking is more than 4 hours with more than 15km mileage, and endurance is increased by 200%; unloaded continuous walking endurance is more than 5 hours&nbsp;with&nbsp;more than 20km mileage. This means that B2 is able to carry heavy loads, perform delivery tasks or work continuously for long periods of time.</p><p>&nbsp;</p><p><strong>3. Powerful joint performance increased by 170% with 360N.m strong torque</strong></p><p>With a peak torque of 360N.m, a 170% increase in performance, B2 providing greater flexibility and stability for industrial operations. In addition, B2 demonstrates excellent continuous stair climbing ability, effortlessly scaling mountains; while climbing, it still has the ultimate stability and balance. &nbsp;</p><p>&nbsp;<img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1700640731981-Unitree+B2-6.jpg" style="width: 766px;" class="fr-fic fr-dib"></p><p><strong>4. Stable and strong, all-round to deal with diverse environments</strong></p><p>B2 has superb obstacle-crossing ability and can easily cross various obstacles such as messy woodpiles and 40cm high platforms, providing an excellent solution for dealing with complex environments. In addition, B2 also has all-terrain adaptability, and can walk stably in slippery or extreme terrain.</p><p>&nbsp;</p><p><strong>5. Depth perception to cope with various complex challenges</strong></p><p>In terms of perception capability, B2 has been comprehensively upgraded and can be paired with a variety of sensors, including 3D LIDAR, depth cameras and optical cameras. The synergistic work of these sensors enables Unitree robot to understand and adapt to its surroundings better, thus accomplishing various tasks more safely and efficiently.</p><p><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1700640750735-Unitree+B2-7.jpg" style="width: 766px;" class="fr-fic fr-dib">&nbsp;</p><p>Unitree said that B2 industrial quadruped robot will be widely used in various industries, such as industrial automation, power inspection, emergency rescue, industrial inspection, education and research. Its high performance and versatility will enable it to play an important role in these fields, improving work efficiency, reducing labor costs, and lowering risks and dangers.</p><p>&nbsp;</p><p>Unitree has always been committed to promoting the development and application of robotics technology, bringing more advanced and reliable solutions to the industrial field through continuous innovation and improvement. The release of B2 industrial quadruped robot marks Unitree's technological leadership in the industry and is set to further promote the development and application of industrial robots.</p>

Human-Robot Interaction

Profiles