Researchers at the Italian Institute of Technology (IIT) are transforming human-robot collaboration with adaptive interfaces, enabling real-time robot adjustments and safe, seamless interactions.Key takeaways:<ul><li>Real-time adaptation for collaboration:&nbsp;Sirintuna and Ozdamar developed an adaptive collaborative interface (ACI) that allows robots to adjust their actions to the human movement intention in real-time, improving teamwork and efficiency.</li><li>Safety and predictability:&nbsp;Safety protocols and torque-controlled robots reduce risks in human-robot interaction, though unpredictable human behavior remains a challenge.</li><li>Xsens motion capture: The researchers use Xsens for precise, continuous movement data, crucial for interpreting human intentions and enabling seamless robot-human collaboration.</li><li>Future applications:&nbsp;The research has potential in healthcare, emergency response, and home assistance, aiming for robots that adapt intuitively in real-life, unstructured environments.&nbsp;</li></ul>Humans have been working with machines for centuries, and with the ongoing robotics revolution, this collaboration is becoming more equal. Researchers Doganay Sirintuna and Idil Ozdamar from the Italian Institute of Technology (IIT) are at the forefront of this change, investigating how robots can effectively work with humans in tasks such as carrying and delivering objects.&nbsp;The new challenge&nbsp;IIT has been actively researching human-robot collaboration for several years, showcasing robots that can perform a variety of tasks, from assisting in drilling holes to serving cups of coffee. &nbsp;Researchers Doganay Sirintuna and Idil Ozdamar, from the Human-Robot Interfaces and Interaction Laboratory, are developing a framework that allows robots to assist with transporting objects. Their framework, called Adaptive Collaborative Interface (ACI) uses haptic feedback and motion capture data to enable robots to adjust their speed and position for better teamwork with humans.&nbsp;In Ozdamar's study, “<a href="https://arxiv.org/abs/2209.14009" target="_blank" rel="noopener noreferrer">Carrying the Uncarriable: A Deformation-Agnostic and Human-Cooperative Framework for Unwieldy Objects Using Multiple Robots</a>,” a framework is presented for one person and two robots to carry a large, deformable object using flexible straps. In a related study by Sirintuna and Ozdamar, “<a href="https://arxiv.org/abs/2201.10392" target="_blank" rel="noopener noreferrer">Human-Robot Collaborative Carrying of Objects with Unknown Deformation Characteristics</a>,” they explore handling items from flexible ropes to rigid rods. By analyzing human movements and force feedback, robots can detect the deformability of the handled objects and adapt their actions. &nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/Q3sA6YzTaaE?&amp;wmode=opaque&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe>Sirintuna and Ozdamar's research focuses on robots consisting of a base with wheels (mobile manipulators) and a robotic arm with multiple joints (known as collaborative robots or cobots). They explain, "In our setup, we have 9° of freedom, and with wheeled robots, you can perform fast movements. So, we selected an industrial robot to concentrate on collaboration tasks."&nbsp;The choice of Xsens &nbsp;In their work, Sirintuna and Ozdamar rely heavily on <a href="https://www.movella.com/products/motion-capture" target="_blank" rel="noopener noreferrer">Xsens motion capture</a> to collect accurate movement data to guide the robots. Xsens allows the researchers to conduct the experiments with minimal setup—making it a practical choice for laboratory environment. Sirintuna and Ozdamar stress the importance of precise, continuous data when working in close collaboration with humans. They appreciate Xsens’ reliability, noting, “We used Xsens because its data was very continuous, which allowed us to provide a reliable stream of data for the human-robot collaboration. Optical sensors we have tried can experience jumps in position, affecting the performance of our framework.”&nbsp;A key focus of their research is interpreting human intentions through movement data. Xsens provides detailed kinematic data, enabling them to categorize actions such as standing still, pushing, or pulling. Through repeated training, they achieved a 98% accuracy in predicting human movements within just three months. “We label specific joint positions and angles as pushing or pulling and use these as input for our system,” Ozdamar explains. Sirintuna and Ozdamar also developed an algorithm that interprets human’s rotational intent by analyzing torso and hand movements, with the goal of creating robots that assist efficiently in tasks like turning while carrying objects. &nbsp;The research results &nbsp; As a result of applying the adaptive collaborative interface, Sirintuna and Ozdamar found that cobots can handle tasks with higher precision, anticipating human movements in real time and adjusting actions based on nuanced data. With the help of a robot operating under ACI in the research on the different deformable objects, "participants completed the task faster, with less effort and higher effectiveness". In the research with two robots assisting one person with transporting a bulky object using deformable straps, the ACI allowed robots to have faster response and better alignment of the movement and required a lesser force input from the person, making the lifting task easier.&nbsp;The findings underscore the power of applying ACI for human-robot collaboration scenarios and lay a foundation for future research in this area.&nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/ounQmCdYlC4?&amp;wmode=opaque&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe> The future of human-robot collaboration and humanoids&nbsp;Looking ahead, Sirintuna and Ozdamar see their research supporting applications in healthcare, emergency response, and home assistance, as well as enabling robots to become common in public spaces and workplaces to meet needs, for example, in agriculture, affected by climate change. The researchers note that “human-robot teams that leverage human adaptability and decision-making can perform tasks with the flexibility required in unstructured environments.”&nbsp;However, making this robotized future reality requires addressing safety concerns in human-robot collaboration. The research robots are torque-controlled, equipped with soft joints, and programmed to avoid reacting to unexpected high-velocity impacts or large force inputs. Yet, as the researchers point out, for real-world applications, the unpredictability of human behavior remains the greatest challenge. “We design algorithms based on expected movements, but humans often behave in unexpected ways,” says Sirintuna. Ozdamar adds, “We can ensure slightly more safety on the robots’ side than on a person’s because we can predict the robot’s behavior.”&nbsp;Ultimately, Sirintuna and Ozdamar’s work lays a foundation for future robots capable of safe, intuitive collaboration with humans, bringing us closer to a world where robots seamlessly assist in our daily lives.&nbsp;

By Xsens MVN Analyze

IIT Develops Adaptive Collaborative Interface for Safe Human-Robot Interaction with Xsens motion capture

Advancements in <a href="https://www.movella.com/products/motion-capture" target="_blank" rel="noopener noreferrer">motion capture technology</a> are transforming patient rehabilitation, as demonstrated by recent research combining Xsens technology with an innovative real-time biofeedback device. This approach promises to significantly enhance balance control and rehabilitation outcomes for patients with diverse balance and movement challenges.Key takeaways:<ul><li>A new device to improve balance:&nbsp;Dr. Hande Argunsah and PhD candidate Begum Yalcin developed a wearable device with real-time haptic biofeedback that helps patients maintain better balance during physical activities.</li><li>Accurate motion analysis with Xsens:&nbsp;The researchers chose Xsens Awinda to conduct device validation because the system provides precise data for evaluating the effectiveness of balance-improving devices.</li><li>Increased engagement: Using a 3D avatar in therapy sessions improves patient motivation and extends stamina during rehabilitation exercises.</li><li>Broad future research: The technology is being adapted for various conditions, such as Parkinson’s disease, scoliosis, and osteoarthritis research, to refine treatment methods.</li></ul><a href="https://www.emerald.com/insight/content/doi/10.1108/JET-12-2022-0069/full/html" target="_blank" rel="noopener noreferrer">Published</a> in the Journal of Enabling Technologies.Today, patient rehabilitation is becoming more data-driven with the introduction of new technology, such as motion capture, providing precise and detailed patient movement analysis and in-depth insights. The researchers from Acibadem Mehmet Ali Aydinlar University in Istanbul, Turkey, Dr. Hande Argunsah and PhD candidate Begum Yalcin used Xsens motion capture technology to address complex challenges in balance and motion analysis. Their innovative work not only demonstrates the potential of advanced motion capture systems, but also opens up new avenues for improving rehabilitation practices and patient outcomes.Addressing the challengeMedulloblastoma, a type of brain cancer affecting the cerebellum, often results in significant motor impairments, making balance and coordination a daily struggle for patients. Traditional rehabilitation methods may not fully address these issues, underscoring the need for more responsive and adaptive solutions. Recognizing this, Dr. Argunsah and Yalcin embarked on developing a groundbreaking wearable device aimed at monitoring and improving balance in real-time. Their <a href="https://www.emerald.com/insight/content/doi/10.1108/JET-12-2022-0069/full/html" target="_blank" rel="noopener noreferrer">research</a> involved a 16-year-old patient with medulloblastoma. The device, placed on the sternum, tracks balance losses and movement patterns while providing immediate haptic feedback through vibrations, aimed at helping patients correct their movements and improve stability.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzI4MzcwMDExMjUyLU1lZHVsbG9ibGFzdG9tYSByZXNlYXJjaCAxIChlZGl0ZWQpLnBuZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6OTUwLCJmaXQiOiJjb3ZlciJ9fX0=" style="width: 100%px;" class="fr-fic fr-dib">Control participant and patient participant perform the 10-meter walking testTo validate their device, Dr. Argunsah and Yalcin turned to Xsens motion capture technology, provided by the official distributor of Xsens in Turkey, <a href="https://www.sense4motion.com/en/" target="_blank" rel="noopener noreferrer">Sense4Motion</a>. Xsens was instrumental in capturing detailed motion data and assessing the effectiveness of their device.The role of XsensIn the research, <a href="https://www.movella.com/products/motion-capture/xsens-mvn-awinda" target="_blank" rel="noopener noreferrer">Xsens Awinda</a>&nbsp;was used to enable a comprehensive analysis of knee joint kinematics and center of mass orientation. By comparing movement patterns with and without the biofeedback device, Xsens provided a thorough evaluation of the device’s impact on balance and stability.The choice of Xsens for the research was based on several considerations. As Dr. Argunsah explains, "Xsens provides a lot of freedom, so we can take the device anywhere we want. As the data collection can be done anywhere while wearing daily clothing, patients can feel more comfortable. This also allows our students to be present and observe data collection."Dr. Argunsah also emphasized the patient’s positive response to the real-time Xsens 3D avatar, noting that it brings engagement and motivation during the rehabilitation journey." [Patients] are happy, and the 3D avatar captures their attention. During static tests, single leg stance tests, and while sitting with arms extended, the duration that patients can remain in the position increased when they were shown the 3D avatar. As they focused on the avatar, their motivation grew, leading to a significant increase in their stamina throughout the physical therapy session, especially during the single-leg assessment".Key research insightsThe integration of Xsens technology with the novel wearable device brought promising results. The device effectively improved movement patterns, bringing them closer to those observed in control subjects. More importantly, it significantly reduced the frequency of balance losses when biofeedback was provided, highlighting its potential for enhancing patient stability.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzI4MzcwMzY0OTgwLU1lZHVsbG9ibGF0b21hIHJlc2VhcmNoIDIgKGVkaXRlZCkucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib">Medulloblastoma patient performing the 10-meter walking test without biofeedbackLooking AheadDr. Argunsah and her research group are planning to expand their studies to include patients with Parkinson’s disease, scoliosis, and osteoarthritis, alongside other neurological and orthopedic conditions. By leveraging Xsens, they aim to gather extensive data and refine therapeutic interventions, ultimately developing advanced algorithms and treatments to better manage motor impairments and improve rehabilitation processes. Specifically, they aim to improve joint function and mobility in individuals with osteoarthritis by creating an algorithm to identify the severity of the condition.By combining innovative technologies with rigorous research, Dr. Argunsah and her research group are paving the way for more effective treatments and improved quality of life for patients with complex motor challenges.ConclusionThe findings of this research showcase the profound impact that advanced <a href="https://www.movella.com/products/motion-capture" target="_blank" rel="noopener noreferrer">motion capture</a> technology such as Xsens can have on patient rehabilitation. Dr. Argunsah notes that, based on their experience with Xsens, which they have been using since 2019, this technology may be applied effectively in the domains of health and rehabilitation, as well as ergonomics, sports, and animation. &nbsp;

Advancing patient care with real-time balance biofeedback and Xsens analysis

Nestled amidst the quaint towns and rolling hills of England lies the fictional town of Anghenfil, a place where whispers of a long-forgotten legend echo through the cobbled streets. However, the legend is about to become a terrifying reality in Every Legend Ends, a captivating fantasy film written and directed by UK-based filmmaker Ryan Garry.A Monster Awakens, a Hero EmergesThe film delves into the heart-pounding tale of a monstrous entity, slumbering for centuries beneath the earth. When the creature awakens, its rage unleashes a wave of destruction upon the unsuspecting town of Anghenfil. As fear and chaos grip the community, an unlikely hero emerges, determined to confront the beast and protect their home.Garry envisioned the film as a high-concept film, drawing inspiration from the epic grandeur of "The Lord of the Rings" and the action-packed thrills of the Marvel Cinematic Universe. However, achieving this level of visual storytelling presented a significant challenge for an independent production.Xsens Mocap: Breathing Life into the Monster<iframe width="640" height="360" src="https://www.youtube.com/embed/QfXj0KFSUI8?&amp;wmode=opaque&amp;rel=0&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe>Behind the scenes: Xsens mocap brings monster vs. soldier fight to life!Creating a believable monster on screen is no easy feat. It requires careful consideration of both storytelling and technical execution. Garry anticipated challenges in syncing the monster's movements with live-action performers and ensuring realistic and fluid monster movements.Garry turned to&nbsp;<a href="https://www.movella.com/products/motion-capture" target="_blank" rel="noopener noreferrer">motion capture</a>, and Xsens became the secret weapon for bringing the film to life. Xsens offered the freedom to deploy the technology in various environments, a crucial factor considering the film's diverse shooting locations. From the damp and cavernous depths of Crank Caverns to the historic brickwork of the Williamson Tunnels, Xsens' lightweight and portable design allowed for seamless filming without technical limitations.The nature of the production needed efficient use of time and resources. With quick and easy setup, Xsens' self-powered system eliminated the need for bulky generators or cumbersome electrical setups, enabling the crew to work efficiently and capture scenes swiftly, even in remote locations.Unlike optical motion capture that requires separate recordings and post-production adjustments, Xsens allowed for simultaneous capture of the monster and live-action actors on set. This resulted in seamless interaction between the characters, enhancing the film's realism. A prime example is the thrilling fight scene between the monster and an armed response soldier, where Xsens' real-time capabilities eliminated the need for extensive post-production work.Capturing the nuances and complexities of the monster's movements, especially during fast-paced fight scenes, was crucial for creating a believable creature. Xsens mocap's accuracy ensured smooth and natural movements.The system's precision minimized the need for extensive post-production adjustments, saving valuable time and resources. The high-fidelity mocap data ensured the monster's movements appeared natural and believable, significantly contributing to the film's immersive experience.Every Legend Ends stands as a testament to the power of imagination and the ability of Xsens mocap technology to empower independent filmmakers. By embracing this cutting-edge technology, Garry has defied the limitations of independent production and crafted a visually stunning and captivating film, proving that even with limited resources, one can breathe life into a captivating story and create a truly immersive cinematic experience.The film is expected to be released later this year. &nbsp;Here is the trailer:&nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/_fcgLke8mc0?&amp;wmode=opaque&amp;rel=0&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe>

with Xsens motion capture

Breathing Life Into A Legend With Xsens Motion Capture

Hidden occupational health risks impact both employees and businesses across sectors such as manufacturing, logistics, retail, and construction. By addressing these risks early and promoting safer working conditions, companies can achieve a 46% increase in efficiency!&nbsp;&nbsp;To discuss the critical role of safe work environments, Xsens is hosting a crash course webinar series that consists of two chapters. The first chapter,&nbsp;<a href="https://www.movella.com/resources/live-stream/workplace-ergonomics-maximising-workplace-health-and-efficiency" target="_blank" rel="noreferrer noopener">Workplace Ergonomics: Maximize Employee Well-being and Productivity</a>, was held on April 30, and you can&nbsp;now&nbsp;<a href="https://bit.ly/3W7ePEn" target="_blank" rel="noopener noreferrer">register for the second session</a>, which takes place on July 9.&nbsp;&nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/NxUrHnd9xmQ?&amp;wmode=opaque&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true">&nbsp;&nbsp;</iframe>&nbsp;&nbsp;Here are the topics we discussed in the first chapter: &nbsp;&nbsp;<ol start="1"><li data-leveltext="%1." data-font="Aptos" data-listid="1" data-list-defn-props='{"335552541":0,"335559685":720,"335559991":360,"469769242":[65533,0],"469777803":"left","469777804":"%1.","469777815":"hybridMultilevel"}' data-aria-posinset="1" data-aria-level="1">What is workplace ergonomics, and how does it impact occupational health and safety?&nbsp;&nbsp;</li></ol>Workplace ergonomics is a critical aspect of occupational health &amp; safety. It involves tailoring workspaces and processes in line with human physical and cognitive abilities. It aims to reduce the risk of musculoskeletal disorders (MSDs) and enhance a facility's safety and productivity. Poor ergonomics can lead to significant financial impacts, including high injury costs and operational disruptions. On average, workplace injuries cost businesses over $20,000 per incident and result in about 20 days (about 3 weeks) of lost work time.&nbsp;&nbsp;<ol start="2"><li data-leveltext="%1." data-font="Aptos" data-listid="1" data-list-defn-props='{"335552541":0,"335559685":720,"335559991":360,"469769242":[65533,0],"469777803":"left","469777804":"%1.","469777815":"hybridMultilevel"}' data-aria-posinset="2" data-aria-level="1">Why is workplace ergonomics so important for organizations? &nbsp;&nbsp;</li></ol>Poor ergonomics in workplaces can result in high injury costs and challenges in maintaining operational continuity. Furthermore, companies need to abide by international standards, such as ISO, OSHA, and EN norms, that serve as objective tools for ergonomic assessments and imply legal consequences for non-compliant facilities.&nbsp;&nbsp;<ol start="3"><li data-leveltext="%1." data-font="Aptos" data-listid="1" data-list-defn-props='{"335552541":0,"335559685":720,"335559991":360,"469769242":[65533,0],"469777803":"left","469777804":"%1.","469777815":"hybridMultilevel"}' data-aria-posinset="3" data-aria-level="1">What are some of the different ergonomic assessment methods and tools often used by organizations?&nbsp;&nbsp;</li></ol>There are several options for conducting ergonomic assessment today:&nbsp;<ul><li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props='{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}' data-aria-posinset="1" data-aria-level="1">Traditional ergonomic assessments rely on manual methods such as checklists and video recordings to observe worker postures and movements based on international standards such as ISO and OSHA.&nbsp;&nbsp;</li><li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props='{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}' data-aria-posinset="2" data-aria-level="1">Advanced software tools, including Siemens Process Simulate and CATIA, offer digital workspace design and ergonomic assessment capabilities.&nbsp;&nbsp;</li><li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props='{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}' data-aria-posinset="3" data-aria-level="1">AI-powered video analysis tools automate assessments by tracking joint angles and movements but may not fully capture dynamic work environments.&nbsp;&nbsp;</li><li data-leveltext="" data-font="Symbol" data-listid="2" data-list-defn-props='{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}' data-aria-posinset="4" data-aria-level="1">Motion capture, allowing for rapid data collection and&nbsp;objective&nbsp;analysis, offers a quick return on investment by reducing injury rates and associated costs.&nbsp;&nbsp;</li></ul>Prioritizing improved ergonomics can profoundly impact worker well-being and satisfaction. Businesses can lower costs and boost productivity by reducing injuries and creating safer work environments. &nbsp;&nbsp;&nbsp;Do not miss the second chapter of our webinar series, where we will talk about the role of motion capture in promoting occupational health &amp; safety, real-life use cases, and ROI! Register today:&nbsp;<a href="https://bit.ly/3W7ePEn" target="_blank" rel="noopener noreferrer">https://bit.ly/3W7ePEn</a>&nbsp;&nbsp;

A woman wearing Xsens Awinda suit sorting our fruits in the supermarket environment. The pose analytics are visualized using Scalefit

Improved occupational health and safety can enhance productivity by 46% and boost employee well-being. To address these opportunities, Xsens is launching a crash course on topics like injury risk reduction, regulation compliance, and the positive influence of safer workspaces.

A crash course on occupational health & safety: safer workplaces for improved productivity

The ability to analyze human movement in real-world settings, beyond the confines of laboratory environments, is becoming increasingly important. Researchers in various disciplines, particularly sports science and biomechanics, are constantly seeking ways to bridge the gap between controlled lab settings and the complexities of movement in the field. This is where IMU (inertial measurement unit) sensor technology comes into play. Xsens Link, a popular motion capture system that utilizes wearable IMUs, is a valuable tool in this regard. Unlike traditional marker-based systems that restrict movement to lab environments, Xsens Link empowers researchers to capture movement in the field. This allows for a more holistic understanding of how athletes move during real-world activities, providing valuable insights for <a href="https://www.movella.com/applications/research-education/sports-science" target="_blank" rel="noopener noreferrer">sports science</a> and <a href="https://www.movella.com/applications/research-education/biomechanical-research" target="_blank" rel="noopener noreferrer">biomechanical research</a>.Understanding Running Kinematics and Inertial Motion CaptureRunning is a fundamental human movement with countless variations depending on factors like speed, terrain, and individual biomechanics. Analyzing these variations is crucial for various applications. For instance, sports scientists can use kinematic data to evaluate running technique, identify potential injury risks, and optimize training programs. When it comes to analyzing running kinematics, IMU-based motion capture systems such as Xsens Link are gaining traction due to their portability, ease of use, and ability to capture movement in real-world settings. IMUs are small electronic devices containing accelerometers, gyroscopes, and magnetometers that can measure a wearer's acceleration, angular velocity, and magnetic field orientation. By strategically placing these sensors on different body segments Xsens Link can estimate the relative movement between segments and reconstruct 3D joint angles throughout a running motion.Investigating the Reliability of Xsens Link for Running KinematicsA <a href="https://www.mdpi.com/1424-8220/24/3/871" target="_blank" rel="noopener noreferrer">recent study</a> by Daniel Debertin, Anna Wargel and Maurice Mohr from the <a href="https://www.uibk.ac.at/en/isw/" target="_blank" rel="noopener noreferrer">Department of Sport Science at the University of Innsbruck</a> aimed to investigate the reliability of <a href="https://www.movella.com/products/motion-capture/xsens-mvn-link" target="_blank" rel="noopener noreferrer">Xsens Link</a> in estimating lower extremity joint angles during running. The study involved 17 recreational runners who completed running trials wearing Xsens Link suits on both asphalt and woodchip surfaces. The researchers assessed both within-day reliability (comparing runs on the same day) and between-day reliability (comparing runs on different days).The findings of the study revealed valuable insights into the reliability of Xsens in the analysis of running kinematics.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzE2MTg1NTQ4MjAxLVhTZW5zLU91dHNpZGUuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib"> Reliability: A Strength of Xsens Link and considerations for longitudinal studiesThe study demonstrated good to excellent reliability for Xsens Link in estimating joint angles when comparing runs within the same day. This indicates that the system can effectively capture subtle adaptations in running technique that occur during a single running session. For instance, if a researcher wants to investigate how a runner adjusts their hip or knee flexion angles in response to a change in surface from asphalt to woodchip, Xsens Link would be a suitable tool. This ability to capture within-day adaptations highlights the potential of Xsens Link for various applications in sports science, such as:<ul><li id="isPasted">Evaluating the effectiveness of real-time feedback interventions:&nbsp;Trainers can provide runners with real-time feedback on their running form using data captured by Xsens Link. The within-day reliability allows researchers to assess how quickly and effectively runners adapt their form based on this feedback.</li><li>Comparing the effects of different running drills: Researchers can use Xsens Link to compare the impact of various running drills on running mechanics. The ability to capture within-day adaptations ensures that any observed changes in joint angles are likely due to the specific drill and not random variations.</li></ul>While Xsens Link can track changes in sagittal plane angles (flexion/extension) like hip, knee, and ankle angles over time for tracking angles over different days (longitudinal studies), the Xsens Link suit likely lacks reliability, particularly for frontal plane movements. Researchers focusing on frontal plane mechanics might need to consider alternative systems or combine Xsens Link with other technologies.Surface Variations and Trail Running ApplicationsThe researchers also discovered an interesting finding regarding surface variations. While the researchers expected some differences in reliability between running on asphalt and woodchip surfaces, they observed minimal impact. This suggests that Xsens Link can effectively capture reliable kinematic data even on uneven terrain. The researchers themselves expressed surprise at this result, highlighting the need for further investigation into the system's performance on various surfaces commonly encountered in trail running environments.This finding opens doors for exciting possibilities in trail running research. Analyzing running mechanics on trails is crucial for understanding injury risks specific to uneven terrain and developing effective prevention strategies. Traditional marker-based systems are impractical for such settings due to their limited range. Xsens Link, with its portability and ability to capture reliable data on different surfaces, emerges as a valuable tool for researchers in this domain.Future Advancements and ConsiderationsWhile Xsens Link offers significant advantages for real-world running analysis, the study also highlights areas for improvement. The researchers acknowledge limitations, particularly regarding the challenges with frontal plane joint angles (e.g., ankle eversion/inversion). However, they also suggest promising advancements that could address these limitations.It is important to remember that optimal reliability hinges not only on the technology itself but also on careful sensor placement and calibration. Researchers using Xsens Link should ensure they follow the guidelines and established best practices for sensor placement to minimize errors and maximize data quality.When choosing a system, researchers should consider reliability alongside validity (accuracy). Ultimately, the choice of motion capture system depends on the specific needs of the research project. Considering both reliability and validity ensures researchers can draw meaningful conclusions from their kinematic data. Xsens Link represents a significant advancement in wearable motion capture technology, enabling researchers to analyze running mechanics outside the confines of a laboratory. Understanding the system's strengths and limitations will allow researchers to leverage its capabilities to unlock valuable insights into running performance and injury prevention strategies.

with Xsens Link

Reliability Of Xsens Link For Running Kinematics: A Study By University Of Innsbruck

TekFall Supreme, an online multiplayer wrestling game by <a href="https://batstoi.com/" target="_blank" rel="noopener noreferrer">BATS-TOI</a>, with startup roots from New York University, is poised to take the gaming world by storm. Its developers have created an experience that captures the heart and soul of folkstyle and Olympic wrestling, with unparalleled realism pushing the boundaries of the genre. This journey towards achieving such authenticity hinged heavily on the use of Xsens motion capture technology.&nbsp;Born from Passion, Driven by InnovationMario Mercado, a former college wrestler at Syracuse University and coach at NYU, was deeply passionate about wrestling. However, he was also concerned about the prevalence of concussions in the sport, having experienced them himself and witnessing them in wrestlers he coached. This dual experience motivated him to find solutions. He first developed protective headgear to safeguard wrestlers from head injuries. Driven by his desire to further contribute to the sport, he then set his sights on creating a captivating video game, TekFall Supreme, as a way to engage the wrestling community.Turning to Xsens Mocap for Precision, Ease, and EfficiencyJavier Molina, the lead animator and former NYU professor, explained that they initially used an optical system for capturing the wrestlers' movements. However, the close contact and physicality of wrestling often obscured the markers, rendering the data unusable.The team's search for a solution led them to <a href="https://www.movella.com/products/motion-capture?utm_feeditemid=&utm_device=c&utm_term=xsens%20motion%20capture&utm_source=google&utm_medium=ppc&utm_campaign=&hsa_cam=15270117545&hsa_grp=129340473986&hsa_mt=e&hsa_src=g&hsa_ad=561737494793&hsa_acc=1306794700&hsa_net=adwords&hsa_kw=xsens%20motion%20capture&hsa_tgt=aud-765723894364:kwd-374313686157&hsa_ver=3&utm_feeditemid=&utm_device=c&utm_term=xsens%20motion%20capture&utm_source=google&utm_medium=ppc&utm_campaign=3DCA+%7C+Europe+%7C+Search&hsa_cam=15270117545&hsa_grp=129340473986&hsa_mt=e&hsa_src=g&hsa_ad=561737494793&hsa_acc=1306794700&hsa_net=adwords&hsa_kw=xsens%20motion%20capture&hsa_tgt=aud-765723894364:kwd-374313686157&hsa_ver=3&gad_source=1&gclid=Cj0KCQjwqpSwBhClARIsADlZ_TlXWvJA2bMjMDVfcA6WNlO0hFkpK6NAxM4Rdv1jReARn2cxO6U7_rsaAvkuEALw_wcB" target="_blank" rel="noopener noreferrer">Xsens inertial mocap technology</a>. Xsens' advanced system offered several key advantages that proved invaluable for capturing the dynamic nature of wrestling.<ul><li>Ideal for close-contact action:&nbsp;Unlike optical systems that struggle with occluded markers, Xsens mocap excels in capturing accurate motion data for wrestling's dynamic close-contact maneuvers. Its inertial sensors, unlike cameras, track movement without relying on a line of sight, ensuring a smooth and uninterrupted capture process.</li><li>Versatility:&nbsp;Xsens mocap allows for recording data in any environment, free from limitations caused by lighting or magnetic interference. This flexibility was crucial for capturing the wrestling action, which can occur in various settings, not just a controlled studio.</li><li>Exceptional Accuracy and Detail:&nbsp;Xsens delivers exceptionally high-quality data, even during complex maneuvers and intricate grappling sequences. This level of detail allowed the animation team to accurately translate the nuances of wrestling movements, resulting in incredibly lifelike in-game characters.</li><li>Streamlined Workflow:&nbsp;The minimal cleanup required in post-production with Xsens data was a significant advantage. The accuracy and completeness of the captured data saved the animators and game developers valuable time and resources, allowing them to focus on refining the animations and breathing life into the virtual wrestlers.</li></ul>The motion capture and animation pipeline involved the use of two <a href="https://www.movella.com/products/motion-capture/xsens-mvn-link" target="_blank" rel="noopener noreferrer">Xsens Link mocap suits</a>, StretchSense gloves for finger tracking, HTC VIVE base stations, and three video cameras, all integrated into <a href="https://www.movella.com/products/motion-capture/xsens-mvn-animate" target="_blank" rel="noopener noreferrer">Xsens Animate Pro</a>. Each recorded take undergoes HD reprocessing and is automatically matched with the video reference, minimizing the need for software adjustments due to the positional aid provided by the IR stations.TekFall Supreme: A Deep DiveTekFall Supreme promises an unprecedented wrestling experience, leveraging cutting-edge technologies to deliver unparalleled realism. Here's a glimpse into what awaits players:<ul><li>MetaMotion AI:&nbsp;This proprietary system simulates realistic wrestling movements, ensuring matches feel organic and unpredictable.</li><li>Blockchain Integration: Players can collect digital assets (DAPS) that unlock real-world collectibles and unique in-game experiences.</li><li>Photogrammetry:&nbsp;The developers used photogrammetry to create incredibly lifelike visuals for wrestlers and environments.</li></ul>Key Features of the Game<ul><li>Become a champion:&nbsp;Compete online, honing your skills to become the national wrestling champion.</li><li>Team up: Form teams with friends and challenge other groups for dominance.</li><li>Character customization: Express yourself by creating your own avatar called a Digital Double that allows you to customize your appearance and move set.</li><li>Digital collectibles: Collect DAPS to unlock exclusive in-game items and real-world rewards.</li></ul>With regard to gameplay mechanics, TekFall Supreme introduces an entirely new combat system featuring 8-way movement, ensuring constant body engagement and replicating the dynamics of an actual wrestling match. This system, coupled with straightforward wrestling logic, offers players an in-depth gameplay experience that is simple to play yet difficult to master, striking a balance between button mashing and strategic decision-making.The authenticity of TekFall Supreme is further enhanced by collaboration with top wrestlers in the country, ensuring unparalleled realism and depth in the game's motions.TekFall Supreme is slated for release in Winter 2024 and has already garnered significant interest, further fueled by a strategic partnership with Sony PlayStation. With its commitment to realism and the power of Xsens technology, TekFall Supreme promises a truly immersive wrestling experience, allowing players to step on the mat and live the champion's dream. To find out more about the game, visit the <a href="https://batstoi.com/xp/" target="_blank" rel="noopener noreferrer">website</a>.&nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/LElNf3eRaT0?&amp;wmode=opaque&amp;rel=0&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true">&nbsp;&nbsp;</iframe>TekFall Supreme Gameplay

with Xsens MVN Link

Step into the ring: TekFall Supreme delivers life-like wrestling

The digital revolution has undeniably transformed how we access information and complete tasks, with laptops, tablets, and smartphones becoming ubiquitous companions in both our personal and professional lives. While these devices offer undeniable benefits, their constant use can also pose new challenges to our well-being, raising concerns about potential impacts on visual health and musculoskeletal function.One emerging area of concern is the intersection of presbyopia, a natural age-related decline in near vision, and the use of progressive lenses. These lenses, often referred to as 'no-line bifocals', &nbsp;provide wearers with a seamless transition between near and far vision, addressing the challenges of presbyopia. However, research suggests that the way we use progressive lenses, with their specific viewing zones, may subtly alter our head and neck postures, potentially leading to discomfort or even musculoskeletal disorders.To shed light on this issue, FREMAP, a leading Spanish mutual benefit association, embarked on a <a href="https://practicapreventiva.fremap.es/2023/02/09/uso-de-dispositivos-digitales-con-gafas-progresivas/" target="_blank" rel="noopener noreferrer">research</a> study to objectively assess the impact of progressive lenses on workplace ergonomics. Their primary objective was to quantify the visual and postural changes associated with using these lenses in a typical workstation environment. <img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzEwODM2NzM4NDQxLWVtaWFwLTEuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib">Worker wearing progressive lenses with the Xsens motion capture sensors to analyze postural changesTo achieve this objective, the research team, led by National Ergonomics Consultant at FREMAP Prevention, D. Antonio Emir Díaz Martínez, employed <a href="https://www.movella.com/products/motion-capture" target="_blank" rel="noopener noreferrer">Xsens Motion Capture technolog</a>y, specifically an upper body configuration with 11 strategically placed inertial sensors. This system was integrated with FREMAP's own ergonomics recording, analysis and representation software, utilizing <a href="https://www.movella.com/products/motion-capture/mvn-analyze" target="_blank" rel="noopener noreferrer">Xsens Analyze Pro</a> for data processing. This setup allowed for the accurate capture and analysis of human movement and posture data.Antonio Emir Díaz Martínez, commented: "The use of this system allows us to quantify, concisely, precisely, and without interference with normal working conditions, the postural requirements of the cervical spine in workplaces with screens for data visualization. This is thanks to having a software solution that removes the possible interferences caused by local magnetic fields."By leveraging Xsens Motion Capture, the FREMAP researchers were able to quantify the precise head and neck movements associated with using progressive lenses while interacting with a computer screen.The research involved monitoring the grazing and cervical spine movements of a worker wearing progressive glasses while they interacted with a computer workstation. To ensure standardized conditions, the upper part of the screen was positioned at eye level, maintaining a distance of 60 cm from the worker. Additionally, the worker's posture was controlled by having them maintain their back against the chair's backrest and their elbows bent at an angle of approximately 80 degrees.Research Findings and RecommendationsThe analysis revealed that participants maintained consistent neck extension throughout the study, exceeding recommended ergonomic limits. This posture is likely linked to the need to look through the lower portion of progressive lenses for optimal near vision. While neck turning remained within acceptable limits, occasional lateral tilts suggest further ergonomic adjustments may be necessary.Based on the findings, the research makes the following recommendations for progressive lens users.<ul><li>Screen Positioning:&nbsp;Ensure the screen is positioned correctly for optimal viewing. Adjust the viewing distance based on task and screen size (400-750 mm for common office monitors). Consider increasing font size for individuals with progressive lenses to increase viewing distance and minimize reliance on the lower lens segment.</li><li>Screen Height: For progressive lens users, reduce the screen height significantly compared to the standard recommendation of aligning the top of the screen with eye level. This helps avoid neck extension for viewing through the lower lens zone.</li><li>Document Holders: Utilize adjustable lecterns or document holders to facilitate switching between digital and printed materials, minimizing strain on eye accommodation.</li><li>Recovery Breaks:&nbsp;Encourage frequent breaks to rest the eyes and change posture, especially for those wearing progressive lenses.</li><li>Occupational Spectacles: For individuals with presbyopia and prolonged digital device use, consider occupational spectacles specifically designed for computer work.</li><li>Training and Awareness:&nbsp;Educate first-time progressive lens users about adaptation exercises and the importance of adjusting their workstation layout. Encourage them to adopt healthy postural habits and avoid extended periods of static posture at their workstation.</li></ul>By implementing these recommendations, individuals who rely on progressive lenses can create a more ergonomically friendly workspace and potentially mitigate the risks associated with prolonged computer use.This research project by FREMAP provides valuable insights into the potential impact of progressive lenses on workplace ergonomics. By utilizing advanced motion capture technology like Xsens, the study offers a quantifiable and objective perspective on this complex issue. The findings can help inform future research, guide the development of ergonomic interventions, and ultimately contribute to promoting healthy workplace practices for individuals reliant on progressive lenses.Xsens motion capture for ergonomics assessments<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNzEwODM3MDc2NDU2LWVtaWFwLTIuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 100%px;" class="fr-fic fr-dib">Accurate motion data: Xsens Awinda Motion Capture Technology featuring 18 inertial sensorsEnsuring proper workplace ergonomics is crucial for employee well-being, regulatory compliance, and increased productivity. This focus stems from the significant prevalence of musculoskeletal disorders (MSDs), often linked to poor ergonomics, affecting nearly 1.71 billion people globally.However, traditional assessment methods can be time-consuming and rely on subjective observations, potentially hindering accurate risk identification. Xsens Motion capture technology offers a compelling solution. Xsens captures objective and validated data on worker movements, eliminating subjectivity and increasing data collection efficiency. This empowers companies to swiftly identify potential hazards and make informed decisions regarding workplace design and modifications. Ultimately, this fosters safer and more productive workspaces, leading to a thriving and healthy working environment for all.<a href="https://www.movella.com/applications/health-sports/workplace-ergonomics" target="_blank" rel="noopener noreferrer">Learn more</a> about Xsens solutions for workplace ergonomics.&nbsp;

FREMAP uses Xsens motion capture to analyze the ergonomic impact of progressive lenses in the workplace and makes recommendations for improvement

Ergonomic impact of progressive lenses in the workplace

The 2023&nbsp;<a href="https://vision-robotics.nl/news/smart-automation-can-drive-the-industry-to-the-next-level/" rel="noopener noreferrer" target="_blank">Vision, Robotics &amp; Motion Trade Show</a>&nbsp;was an industry-anticipated event that took place in the Netherlands on the 7th and 8th of June. The event was organized by Mikrocentrum and held at the Brabanthallen in &#39;s-Hertogenbosch<a href="https://vision-robotics.nl/home-en/" style="background-color: transparent;" target="_blank">1</a>.The aim of the trade show was to inspire and educate attendees about the potential for automation in the manufacturing sector and provide insights into the practical implementation of technologies like robotics, vision, and motion. It served as a platform for manufacturing companies to understand and explore ways to address challenges such as customer demands, lead times, workload, and personnel shortage through automation<a href="https://vision-robotics.nl/home-en/" target="_blank">1</a>.The event featured an expo where participants could meet 100 manufacturers, system integrators, suppliers, and consultants who could provide suitable solutions and help with implementation.<h3 dir="ltr">Wevolver presents Robotics Report</h3>Wevolver attended the event speaking to engineers and attendees engaging with the demo areas where attendees could learn from innovative applications from other industries such as logistics and agriculture.Wevolver team members also presented their recently launched robotics report,<a href="http://The Vision, Robotics & Motion" rel="noopener noreferrer" target="_blank">&nbsp;The 2023 Manufacturing Robotics Report</a>, to attendees at the Vision, Robotics &amp; Motion event.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjg3ODUzMDk3MTM0LTc2NjZhOWE5LTliMmQtNDAzOC1iYTA3LTVhNGE0Nzg3OTU2Zi5qcGciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib">Wevolver, CEO Richard Hulskes, presenting the Protolabs Robotics Report.&nbsp;<h3 dir="ltr">Young Talent Square</h3>One of the highlights of the event was the <a href="https://www.wevolver.com/article/young-talent-square-at-vision-robotics-motion-2023-start-ups-and-student-teams-discuss-their-technologies" rel="noopener noreferrer" target="_blank">Young Talent Square</a>, which provided a platform for student-teams and start-ups to showcase their innovative solutions. Five start-up companies and two student teams were featured in the 2023 edition of the event<a href="https://vision-robotics.nl/home-en/" target="_blank">1</a>. <a href="https://www.wevolver.com/article/young-talent-square-at-vision-robotics-motion-2023-start-ups-and-student-teams-discuss-their-technologies" rel="noopener noreferrer" target="_blank">Read more about these young teams</a> in our recent article highlighting their technologies.&nbsp;<h3 dir="ltr">Connecting across industries</h3>The event was not just a trade fair but also a conference where leading suppliers and scientists from the Benelux and Germany came to share the latest developments in fields such as vision, robotics, sensors, mechatronics, grippers, and drive and operating technologies.<iframe width="640" height="360" src="https://www.youtube.com/embed/hQ8eWJ6pH7A?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe>As part of the Dutch high-tech ecosystem, the event was connected to Holland High Tech, a top sector for High Tech Systems and Materials in the Netherlands. Holland High Tech focuses on fostering innovation, collaboration, internationalisation, and economic growth in the high-tech sector, and it represents a wide range of companies, from multinationals to SMEs, start-ups, and scale-ups<a href="https://hollandhightech.nl/en/we-are-holland-high-tech" style="background-color: transparent;" target="_blank">3</a>.In summary, the Vision, Robotics &amp; Motion event in 2023 was a significant gathering that aimed to advance the manufacturing industry by sharing knowledge and innovations in automation and related technologies.The next edition of the Vision, Robotics &amp; Motion trade fair is scheduled for June 5 and 6, 2024. Would you like to know more about the next edition? Register then for their&nbsp;<a href="https://vision-robotics.nl/news/" id="isPasted" target="_blank">newsletter.</a>

The 2023 trade show brought together technological innovations, industry experts, and future talents in the field of automation.

Automation Innovation: A look of the 2023 Vision, Robotics & Motion Trade Show

As one of the rising AAA metaverses, <a href="https://www.yabal.io/" rel="noopener noreferrer" target="_blank">Yabal</a> is the perfect example of how motion capture technology is becoming critical to the future of live entertainment.&nbsp;Yabal is a metaverse specifically created for live entertainment and its current focus is to deliver weekly live concerts. Users are immersed in a 3D virtual world where they can attend these shows, setting a new bar for artists and their performances.Movella's <a href="https://www.movella.com/products/mvn-animate" target="_blank" rel="noopener noreferrer">Xsens Animate</a> motion capture technology empowers Yabal to deliver seamless interaction between physical and virtual worlds, providing the highest quality experience to their users.&nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/ohH82hIJVoc?&amp;wmode=opaque&amp;rel=0&amp;enablejsapi=1&amp;origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</iframe> The importance of motion tracking and captureLeading the way on the journey to become the gamified and interoperable high-fidelity metaverse for live entertainment is <a href="https://www.linkedin.com/in/dominikfaber/" rel="noopener noreferrer" target="_blank">Dominik Faber</a>, Yabal's Founder. Dominik recognised the importance of excellent motion tracking and capturing to enable artists to create authentic, intimate in-game live shows which led to the discovery of Xsens, and their array of Xsens motion capture products. &nbsp;The main reason the team decided to adopt and implement Xsens technology was the overall data quality it provided, and how it went above and beyond its competitors' capabilities. Dominik says, "we saw the VR headset market was crashing and started to investigate screen based virtual environments to develop and create performances. We found Xsens to have excellent positional tracking with stellar graphics, and there was no magnetic interference. All round, it was a much better, more reliable suit than the others."Thanks to the capabilities of Xsens motion capture technology, Yabal has delivered a vast variety of live shows and with its infinite scalability, this number is set to increase. Currently in pre-series A, the team's next steps are to expand their presence globally and fully embed Xsens technology within their framework and infrastructure.&nbsp;Getting up close and personalVirtual environments provide a new level of intimacy around artist engagement, something that's unattainable in the physical world. By capturing authentic facial movements with a device as simple as an iPhone, and realistic body movements with the Xsens suit, and displaying these in real-time, the user experience is elevated and makes individuals feel much closer to the artist. The goal here is to combine entertaining live shows with engaging gameplay.&nbsp;This is why magnetic interference is important. Magnetic interference, which happens around vital pieces of equipment such as speakers and distorts the animation. This distortion removes this newly created level of intimacy and ruins the immersive experience. Sadly, this is prevalent in many pieces of motion capture technology, and Movella is the only inertial motion capture company that has managed to overcome this.Furthermore, this is why the reliability of the suit is essential. With live performances and real-time entertainment, there is no luxury of time. Creators and performers can't wait for debugging so the technology needs to be reliable and work first-time. When the technology is unreliable, as with magnetic interference, the immersive, intimate nature of the experience is ruined, and there is a risk of reputational damage, leading to a loss of audience going forwards. &nbsp;When discussing the process for performances, Dominik explains how there is no blueprint, and every show is a different, fun, creative, and–at times–experimental process. Nothing is ever pre-recorded. Live means live.&nbsp;Reflecting on some of his favorite performances Dominik comments, “one of our first ever shows was with Aetna, an upcoming German band consisting of two people playing live synthesizers and drums. We created their avatars and, using Xsens motion capture suits, they delivered a virtual, real-time live performance. The reception, and reaction, from the fans was fantastic."Another great performance was from European DJ, Hugel, in the midst of the pandemic. It was his birthday and all his previous plans fell through. At short notice we were able to organize a globally accessible performance and he was over the moon to be able to play to, and interact with, his fans."<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjc1OTIxODAyNzAyLVlhYmFsIGltYWdlIHJlc2l6ZWQucG5nIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib"><h3 id="isPasted">Creating the future, today</h3>It's clear to see that the metaverse will be a fundamental part of humanity’s future. From social interactions, to education applications and the entertainment industry, the metaverse and rise of companies such as Movella and Yabal working collaboratively, will completely disrupt and re-engineer the world as we know it.&nbsp;With Movella already being a leading innovator within the motion tracking industry, combined with the possibilities of multiple metaverses and the Unreal Engine, this boundary-pushing company has already begun its journey to becoming an intrinsic component for success in the metaverse.&nbsp;

with Xsens MVN Animate

Bringing Live Entertainment to the Metaverse

Adapting the vibrant imagery of Lyle, Lyle, Crocodile from the page of a children&rsquo;s book to a Hollywood blockbuster is no simple feat. First, you need to bring a six-foot-one singing and dancing crocodile to life. Then you have to make it believable; performing alongside Academy Award-winning Javier Bardem while capturing the magic that made the book so special. Lyle the crocodile needed to be completely authentic, and completely endearing.&nbsp;That&rsquo;s the challenge faced by motion capture experts,&nbsp;<a href="https://actorcapture.com/" rel="noopener noreferrer" target="_blank">Actor Capture</a>, when Sony asked them to take on the project. With work on productions such as Suicide Squad and Cardi Tries, Actor Capture is a leading consultant in creating 2D and 3D characters across film and game.&nbsp;James Martin, Technical Director at Actor Capture, led his team through the production process to bring Lyle to life. For this story of a boy who befriends a walking, talking, and singing crocodile, the team had to develop a full performance capture of Lyle &mdash; from teeth to toes &mdash; that could share the screen with Oscar-winning talent.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjc1OTIwNzg1NzkyLUx5bGUgTHlsZSBDcm9jb2RpbGUgMS5qcGciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib"><h3>Getting ahead</h3>Actor Capture knew they needed to be involved early in the process. By coming on board during pre-production, James and the team could identify exactly what was needed to bring Lyle to life. Lyle himself would be developed from a combination of performers &ndash; each representing different forms that he takes throughout the film: starting as a child, growing up, and then for the more stunt-heavy moments.&nbsp;A scale-accurate performer, Ben Palacios, was utilized for the emotional and more performance-driven captures. For a young Lyle, James proposed a scale-accurate child actor to secure a realistic performance and capture the youthful energy of the original story. And for the stunts, there would be some challenges. A particular wrestling scene came to mind when James spoke about the process.&nbsp;<iframe width="640" height="360" src="https://www.youtube.com/embed/T0ZIStVHSjI?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true" data-gtm-yt-inspected-7="true" id="786230741" title="Lyle, Lyle, Crocodile - Behind-the-scenes using Xsens motion capture technology"></iframe> &ldquo;Mr. Primm, the character played by Scoot McNairy, has a background as a high school wrestling champion,&rdquo; says James. &ldquo;And he takes on Lyle &mdash; or Lyle takes on Mr. Primm!&rdquo; For these moments the singing, dancing, and stunts were all made from two entirely separate (and acrobatic) Lyles who could deal with the physical demands.Actor Capture worked closely with each actor to ensure their performances were just right. The cast had a month of training to ensure they were aware of the different workflows involved and how to perform in the suits when on set. It also gave them a good grounding in relevant techniques and terminology.<h3>The Right Capture</h3>Working in a team of four, Actor Capture was involved for the duration of the production. From calibration of suits to laundry, getting them to the right people, and into post-production they made certain that the motion capture process was entirely prepped and ready. Which also meant having the right motion capture tools for the right moments.Having a motion capture setup that enabled the team to go back and effortlessly match existing footage at a 24fps framerate was paramount. Whenever complex interactions take place between a live-action performer and an animated principal character, it becomes a data-heavy pursuit. Being able to capture the most accurate data possible enables the CGI elements to work seamlessly with live-action. Without it, there was no guarantee of creating a believable character.&ldquo;We choose Xsens for our body motion capture every time,&rdquo; says James. Data quality is key to generating the best performance capture possible. For Actor Capture, Xsens consistently produces that quality. By using a combination of tools - including the Link Suit, Manus and Facewear - Actor Capture were able to cover the whole body and receive best-in-class data output.&nbsp;Being able to rely on accurate data that could be shared with teams around the world meant that they could rely on the final product being exactly what was needed. Xsens&rsquo; Link Suit in particular was used for a variety of reasons along with providing a high level of data output. This suit was vital when filming all of Lyle&rsquo;s movements on set &ndash; it&rsquo;s widely preferred by performers and, crucially, is simple to use.&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjc1OTIwODQ5MzY4LTIwMjEwOTE3XzA5NTMxMy5qcGciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib"><h3 id="isPasted">Adaptation</h3>Working on a fast-paced set comes with its own challenges, and when you&#39;re adding a CGI character into the mix these grow exponentially. It&#39;s important to be able to adapt and modify your process as production progresses.During filming it was clear that capturing the live-action hands (on account of Lyle being a crocodile) wasn&#39;t going to deliver an authentic result. So, in consultation with producers, Actor Capture recommended an entirely separate capture session and post-production involvement to construct the hands as an additional component.Being able to utilize tools that provide that extra level of flexibility was an essential factor in that decision-making process. Actor Capture knew that with the Xsens Glove by Manus, they could simply capture the hands separately and offer the production team the right advice to ensure they ended up with the right results.<h3 id="isPasted">Award-winning standards</h3>Actor Capture was excited by the prospect of having the motion capture of a crocodile hold up alongside the performance of Javier Bardem. Making sure that the animation was going to live up to award-winning talent was a determining factor in knowing exactly why Xsens needed to be involved.&nbsp;Actor Capture is known for delivering AAA results. Having access to the highest quality motion capture tools ensures that the processes involved are as convenient as possible for the production team. That convenience enables them to focus on generating a complete, authentic performance that suspends all disbelief when audiences sit down to enjoy the final movie.

Crocodile antics opposite Javier Bardem

Over the past few years, there has been a rapid rise of digitization and significant advancements in high-end &lsquo;Hollywood style&rsquo; production technology. These developments have unveiled numerous opportunities for organizations in the entertainment industry, enabling them to make improvements in efficiency, costs, and resources.This &lsquo;Hollywood style&rsquo; production technology is now so advanced, portable, and intuitive that an experienced solo content producer, with the right tools, can produce consumer-ready content without a full production team of the same (if not better!) quality.Through combining expertise from the gaming industry, visual effects and premium motion tracking technology the future potential of content and immersive entertainment experiences seems limitless. If we can dream it, the chances are we&rsquo;ll eventually be able to do it.The challengeAs a full-stack visual effect and virtual production studio, specializing in innovative visualization solutions,&nbsp;<a href="https://www.aoefx.com/" rel="noopener noreferrer" target="_blank">Area of Effect (AOE)</a>&nbsp;was approached by Loud Robot, a joint venture record label between RCA Records and Bad Robot.The project involved creating a music video for&nbsp;<a href="https://www.instagram.com/sallyboy/?hl=en" rel="noopener noreferrer" target="_blank">Sally Boy&rsquo;s</a>&nbsp;new single, i Love U, with a unique challenge: can one individual with the right technical ability, create a music video in-engine, using high-end modern tools such as&nbsp;<a href="https://www.xsens.com/products/mvn-animate?hsCtaTracking=0031f976-823a-4074-8cc4-d6f2347422ae%7C584bb7ed-596e-4dd6-992d-245825acf04f" rel="noopener noreferrer" target="_blank">Xsens MVN Animate</a>,&nbsp;<a href="https://facewaretech.com/" rel="noopener noreferrer" target="_blank">Faceware</a>, and&nbsp;<a href="https://www.unrealengine.com/en-US/?utm_source=GoogleSearch&utm_medium=Performance&utm_campaign=an*3Q_pr*UnrealEngine_ct*Search_pl*Brand_co*UK&utm_id=17086214830&sub_campaign=&utm_content=&utm_term=unreal%20engine" rel="noopener noreferrer" target="_blank">Unreal Engine</a>?<iframe width="640" height="360" src="https://www.youtube.com/embed/y7xCp0fTng0?&wmode=opaque&rel=0&enablejsapi=1&origin=https://www.wevolver.com" frameborder="0" allowfullscreen="" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe> Diving in at the deep end<a href="https://www.linkedin.com/in/brycecohen/" rel="noopener noreferrer" target="_blank">Bryce Cohen</a>, Real-Time VFX Associate at AOE was tasked with discovering just how much an individual was able to do to create a music video in Unreal Engine, from the very initial conceptual stages to final editing and production. The project gave him the opportunity to showcase his impressive technical abilities by utilizing cutting-edge Hollywood-style technology.The first stage was discovering what technology needed to be used to create the desired end result. For example, the video was going to be based around a character, who would be talking and moving their mouth to react, so face tracking was a must. The character was also going to be moving around a lot, so camera tracking was required. In the end, a decision was made to use all available technology and really push the boundaries of what was possible through motion capture.&ldquo;When I was first approached about this project, I was nervous about the entire thing since it was nothing but variables,&rdquo; said Cohen. &ldquo;Creatives with the right technical abilities have a whole new world of virtual production available to them through utilizing new and improved technology such as mocap.&rdquo;Lights, camera, action! A lot of the technology used within the video was brand new to Cohen and he only had hours to familiarize himself with how to use it.&ldquo;It&rsquo;s so user intuitive and straightforward, with all the brilliant tutorials available online, you&rsquo;re able to learn solo in-studio,&rdquo; said Cohen. &ldquo;However, it&rsquo;s important to note that due to the cost and level of skill required, these are not consumer or hobbyist tools.&ldquo;The production of this project was full of little moments of discovery. My favorite of which was trying to figure out how to animate butterflies to bring more life to one of the scenes. The solution? Taping a camera tracker to the director, Jake Zaoutis&rsquo; head and having him run around my garage, acting like a butterfly.&rdquo;A key piece of high-end technology that made the whole video production possible was the Xsens suit. This enabled real-time referencing of the video shots for a quick production pipeline.The <a href="https://www.xsens.com/products/mvn-animate?hsCtaTracking=0031f976-823a-4074-8cc4-d6f2347422ae%7C584bb7ed-596e-4dd6-992d-245825acf04f" rel="noopener noreferrer" target="_blank">Xsens MVN Animate</a> suit provides accurate, production-quality results, similar to what an optical system can provide results every time, from anywhere in the world. This boundary-pushing technology provides clean, production-ready data from both inside and outside a studio. Cohen found the collection of real data to be crucial to the success of the video.Cohen said: &ldquo;That was another bonus in terms of the way the suit itself was structured. At no point did we worry about breaking the suit or find it limiting&mdash;at times, you forgot you were wearing<img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1670573992281-iloveu+3.png" style="width: 300px;" class="fr-fic fr-dib">Making the impossible, possibleIn Cohen&rsquo;s opinion, there were two main challenges to overcome. The first was a software problem and the second was a more general one, regarding &lsquo;how to work&rsquo;.For the software problem, Cohen needed to build a custom facial rig for the character. This was a very difficult process that took trial and error to get things right, but it became easier after discovering and using the tool in practice.For the &lsquo;how to work&rsquo; challenge, the main issue was translating creative direction from Zaoutis, who&rsquo;s never worked within an environment such as the Unreal Engine before, into actions, processes and outcomes. Cohen found he was responsible for not only solving the problem but explaining the reasoning behind whether or not it was an idea to move forward with, predominantly due to time constraints and resource dedication. Compromise was key.There were many scenes within the final video that wouldn&rsquo;t have been possible to create without the use of mocap, specifically the Xsens suit. For example, when the character is running down a street, the graphics and motion were so realistic, the team couldn&rsquo;t have looped it as a running animation and also didn&rsquo;t have a treadmill standing by. It wouldn&rsquo;t have been possible to do this with markerless mocap as the camera field of view would have been too wide and there were no other suitable alternatives.With the intuitiveness of the technology, Cohen had as much control and customizability as possible in order to make it feel like a &lsquo;real&rsquo; production. This resulted in the movements recorded being tailored to the exact shot required for the video, with no authenticity lost by automating parts.&ldquo;When you&rsquo;re trying to make something real in a digital space, you need everything that&rsquo;s being put into that space to be real. It&#39;s the imperfections and happy accidents that make things feel real.&rdquo; Cohen explained.In terms of preparation, the artist and face behind the character, Sally Boy, had none. He was shown the character for approval and then arrived in the studio (garage), put on the Xsens suit and had a list of over 100 different physical movements to do. Those actions were then applied to the character.<img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1670574064513-iloveu+4.png" style="width: 300px;" class="fr-fic fr-dib">The final music video was an extension of Sally Boy&rsquo;s art and a reflection of the emotions in his music, not just a piece of marketing material.This technology has the potential to bridge the gap between the gaming and film industries. When they start to work hand in hand, individuals can produce, as Cohen said, &ldquo;some really exciting stuff.&rdquo;About AOEArea of Effects is a full-stack visual effects and virtual production studio specializing in innovative visualization solutions for feature films, television, and commercial production.Based in Los Angeles, New Orleans, and Honolulu, our academy award-winning crews aim to change the way content creators think about the entire pre and post-production processes. We work with some of the biggest names in film, television, and gaming in order to achieve and drive our creative and technical goals, including the multi-Academy Award Winning VFX Supervisor Rob Legato.

Creating a Hollywood-style music video with a one-man team

When Columbia engineer Axl Chen, MS &#39;23, enrolled in &quot;Practical Deep Learning System Performance,&quot; he couldn&rsquo;t have imagined he would soon be leading a start-up that develops full-body VR tracking shoes. But that&rsquo;s exactly what happened. The course&mdash;taught by Professor Parijat Dube&mdash;introduced Chen to algorithms that can boost the accuracy of human activity recognition. A year later, he&rsquo;s the proud founder and CEO of Surplex, a company developing a full-body VR tracker, hidden inside a pair of shoes.&quot;I [was] really interested in AI applications, but I [hadn&rsquo;t] found a lot of applications where it is a novel kind of research that can be applied into the real world,&quot; says Chen. Now, Surplex is working on one such application: capturing full-body human motion for practical virtual reality uses like gaming and professional sports training.<h2>Bridging the Gap Between Technology and Imagination</h2>Combining dense sensors, IMU, and deep learning, Chen and a team of engineers and developers from Columbia, MIT, UPenn, Rutgers, and China&#39;s Tsinghua University have created a pair of shoes that have the potential to revolutionize today&#39;s VR experience.&nbsp;&quot;We are combining textile sensing and AI wisdom for human pose estimation,&quot; Chen says.The Surplex shoes use 480 pressure sensors that track body movements with &quot;great accuracy, even when making tiny motions,&quot; according to the&nbsp;<a href="https://www.kickstarter.com/projects/surplex/surplex-future-vr-tracking-shoes" target="_blank">project&#39;s Kickstarter campaign.</a> &quot;Better still, you don&#39;t need to be confined to limited space, or tangled up with cords and straps as with other VR trackers.&rdquo;Chen, who has an undergraduate degree from Parsons School of Design, took his first steps at Columbia Engineering in a summer program.&nbsp;&quot;I actually came to Columbia for an exchange [program], basically a summer semester. Here, I took a class of Machine Learning and also deep learning,&rdquo; Chen says, &ldquo;and I was actually quite fascinated by AI technology. Then, I applied for a Masters at Columbia in&nbsp;<a href="https://www.cs.columbia.edu/" target="_blank">computer science</a>.&quot;Chen sees the potential to change the way professional sports approaches motion tracking. Currently approaches are either majorly expensive or demand an awkward base station.&nbsp;&quot;Before, you would need to have a huge amount of professional equipment to capture your full body motion, several cameras looking at you to get a good capture,&rdquo; Chen says. &ldquo;Some use carpets [that have pressure sensors] so let&#39;s say, for example if you are lifting your leg, kicking around, dancing around, in that kind of scenario, it is hard to capture your full body motion by just using pressure sensing. So, I was thinking, how can we bridge this gap between textile sensing and full body capture with good quality?&rdquo;<h2>Start-Up State of Mind</h2><img src="https://s3-us-west-1.amazonaws.com/wevolver-project-images/froala%2F1669372828113-surplex-shoes.jpeg" style="width: 766px;" class="fr-fic fr-dib">The project has already garnered public interest, raising over $60,000 dollars through a Kickstarter campaign. Stories about Surplex in&nbsp;<a href="https://www.inputmag.com/style/body-tracking-shoes-virtual-reality-kickstarter-surplex" target="_blank">INPUT</a>,&nbsp;<a href="https://vrscout.com/news/full-body-vr-tracking-shoes-coming-soon-to-kickstarter/" target="_blank">VRScout</a>,<a href="http://trendhunter.com/trends/fullbody-tracking-shoes" target="_blank">TrendHunter</a> and&nbsp;<a href="https://finance.yahoo.com/news/surplex-announces-launch-full-body-130000528.html" target="_blank">Yahoo News</a> praise Chen&#39;s new developments and predict his project could open up new possibilities for gaming and entertainment.When asked about what kind of advice he would offer to young engineers looking to launch their careers, Chen says that students and young entrepreneurs have a unique vantage point that allows them to think big and see opportunities and ideas that more seasoned professionals may be missing.&nbsp;&quot;When you try to start a startup when you&#39;re an undergrad, you can think about fields that cannot be seen by others,&rdquo; says Chen, &ldquo;you have a much broader view of what is happening right now in the world and what&#39;s possible. When you are young you have a chance to try and test and see if that works out.&rdquo;

Axl Chen is the founder and CEO of Surplex, a new full-body tracking technology company aiming to change the gaming industry and professional sports.

Stepping Forward: MS student Develops VR Full-Body Tracking Shoes

In this episode, we talk about how a machine learning algorithm that can predict what sequence of actions a volleyball player will take next is being used to create more effective human/machine interactions for safer autonomy in our lives.&nbsp;<iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless="" src="https://player.simplecast.com/043f2944-eb28-44e2-a4ef-5bea1da30819?dark=false" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe><hr>This podcast is sponsored by <a href="https://www2.mouser.com/" id="isPasted" rel="nofollow" target="_blank">Mouser Electronics</a>. &nbsp;&nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjY2NzAyODA1MjExLU1vdXNlci1zcG9uc29yLTEtYS5qcGciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 766px;" class="fr-fic fr-dib"><hr><h3 id="isPasted">EPISODE NOTES</h3>(3:15) - Algorithms predict sports teams' moves with 80 percent accuracyThis episode was brought to you by Mouser, our favorite place to get electronic components for any project. Click HERE to learn more about how to make a DIY predictive maintenance system using AI &amp; edge computing.<hr>As always, you can find these and other interesting &amp; impactful engineering articles on Wevolver.com.To learn more about this show, please visit our<a href="https://www.wevolver.com/profile/the.next.byte" target="_blank">&nbsp;shows page</a>. By following the page, you will get automatic updates by email when a new show is published. Be sure to give us a follow and review on<a href="https://podcasts.apple.com/nl/podcast/the-next-byte/id1548255861?l=en" rel="nofollow" target="_blank">&nbsp;Apple&nbsp;</a>podcasts,<a href="https://open.spotify.com/show/6lPPsRtegnivsRUEsQ09R7?si=IPMiah7xT_apJtPjqvXMlA" rel="nofollow" target="_blank">&nbsp;Spotify</a>, and most of your favorite podcast platforms!

In this episode, we talk about how a machine learning algorithm that can predict what sequence of actions a volleyball player will take next is being used to create more effective human/machine interactions for safer autonomy in our lives.

Podcast: AI Predicts Sports Games with 80 percent Accuracy

<a href="https://reopera.ca/" rel="noopener noreferrer" target="_blank">re:Naissance Opera</a>, a collective formed by a group of digital and opera artists looks to answer the question:&ldquo;What would opera look and feel like if it were invented today?&rdquo;. For founder <a href="https://reopera.ca/debi-wong/" rel="noopener noreferrer" target="_blank">Debi Wong</a> and the team, it started with giving artists the tools&ndash;including the <a href="https://www.xsens.com/products/mvn-animate" rel="noopener noreferrer" target="_blank">Xsens MVN Link</a> suit&ndash;which they could use to bring the ancient art form of opera to a whole new audience with virtual reality.As Debi explains:&nbsp;&ldquo;It&rsquo;s about building the platform first; performance second. At re:Naissance we&rsquo;re empowering artists to co-create with us, by providing them platforms and tools to create genre-defying works, which is our whole ethos. And that extends to the audience too. We want them to come in and also be co-creators with us.&rdquo;Working closely with 3D Artist Conrad Sky, re:Naissance Opera began developing OrpheusVR, an interactive, choose-your-own-adventure, virtual-reality opera for a modern audience. The inspiration for the project stemmed from Debi wanting to break away from the traditional methods of operatic storytelling, and her own personal interest in video games as an art form.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjY2MjQ5NzU5MDk1LUV1cnlkaWNlIGluIHRoZSBVbmRlcndvcmxkLUJvYiBLcmV1dC5wbmciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 300px;" class="fr-fic fr-dib">&ldquo;It might be surprising, but I&rsquo;m a big gamer - so I was inspired to think: what are the intersections between the world I engage with on stage, which has these huge stories and big ideas and amazing characters that we don&#39;t run into in everyday life, and video game worlds? In opera, I feel like I&#39;m doing the same thing, embodying these larger-than-life characters or playing through these worlds and stories, and I started thinking about how these two could cross over.&rdquo;After a prototype was successfully released in 2021, the re:Naissance Opera team produced <a href="https://eur05.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmailstat.us%2Ftr%2Ft%2Ff3n84myjla0m3cub%2F1%2Fhttps%3A%2F%2Freopera.ca%2Flive-from-the-underworld%2F&data=05%7C01%7CLeon.Chen%40movella.com%7Cc9d77d290fd7438b364808dabd72bff1%7C0d9644303c5f4a6990b984cee624918a%7C0%7C0%7C638030597845781089%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=qwBV3eNIhVQGYFCA8W2WX57Y91ItwnxV5FVVBnifhF0%3D&reserved=0" rel="noopener noreferrer" target="_blank">&lsquo;Live From The Underworld&rsquo;</a>, a two-part immersive operatic experience with computer-generated sets and mythological avatars brought to life by the remarkable collaboration of opera, video game professionals and dancers in Xsens suits. The series featured the work of award-winning script writer and voice actor <a href="https://eur05.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmailstat.us%2Ftr%2Ft%2Ff3n84myjla0m3cub%2F2%2Fhttps%3A%2F%2Fwww.imdb.com%2Fname%2Fnm1191973%2F&data=05%7C01%7CLeon.Chen%40movella.com%7Cc9d77d290fd7438b364808dabd72bff1%7C0d9644303c5f4a6990b984cee624918a%7C0%7C0%7C638030597845781089%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=YEPjNV6zU3Tb7iPmXzhLMblM0USzQ2P4Pwb5KctbnMo%3D&reserved=0" rel="noopener noreferrer" target="_blank">Omari Newton</a>, who played the voice of Corvus on Netflix&#39;s <a href="https://eur05.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmailstat.us%2Ftr%2Ft%2Ff3n84myjla0m3cub%2F3%2Fhttps%3A%2F%2Fwww.imdb.com%2Ftitle%2Ftt8688814%2F%3Fref_%3Dnm_flmg_act_12&data=05%7C01%7CLeon.Chen%40movella.com%7Cc9d77d290fd7438b364808dabd72bff1%7C0d9644303c5f4a6990b984cee624918a%7C0%7C0%7C638030597845781089%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1eV7YJes77PMpPNN7R9o3oIVhl%2Fyl1VB9rtXQZYzJKo%3D&reserved=0" rel="noopener noreferrer" target="_blank">The Dragon Prince</a> animated series and whose IMDb includes a roster of VR games. &#39;Live From the Underworld&#39; has been nominated at the 2022 AUREA Awards, happening this December in Germany at NTR &ndash; The Metaverse Summit.For &lsquo;Live From The Underworld&rsquo; to succeed, it was essential that the digital characters were able to convey the emotions of the performer behind the avatar. Each of the show&rsquo;s performers would make distinct motions while recording, so it was important that re:Naissance had the motion capture technology in place to bring their individualistic behaviors into the show, which is why the team turned to Xsens.&ldquo;The Xsens suits are just so easy to throw on and you can become any avatar or mythological creature you want or can think of&rdquo;,&nbsp;Debi Wong explains. Working with Xsens meant that performers could act as they usually would on stage, thanks to the accessibility and robustness of the MVN Link suit.<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjY2MjUwMDI2ODQ4LUVyaWthIE1pdHN1aGFzaGkgaW4gWFNlbnMgc3VpdC1waG90b01hY2tlbnppZUxhd3JlbmNlIHJlc2l6ZWQuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib">Part one of the series, &#39;Eurydice: Live from the Underworld&#39; premiered online in the Fall of 2021. Part two of the series, &#39;Live from the Underworld II: Eurydice&rsquo;s Descent&#39; is the continuation to the story and was live-streamed in Spring 2022. On November 16, 2022, audiences can experience the first ever in-person performance of the series with &#39;Live from the Underworld II: Eurydice&rsquo;s Calling&#39; which features an alternate ending, where Persephone&rsquo;s avatar is unveiled. This live performance kicks off <a href="https://eur05.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmailstat.us%2Ftr%2Ft%2Ff3n84myjla0m3cub%2F4%2Fhttp%3A%2F%2Freopera.ca%2Findiefest&data=05%7C01%7CLeon.Chen%40movella.com%7Cc9d77d290fd7438b364808dabd72bff1%7C0d9644303c5f4a6990b984cee624918a%7C0%7C0%7C638030597845781089%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=LMHKJZ2cEtfGmk6gxung91HOkLC7FGTlMsfgzuJvrGQ%3D&reserved=0" rel="noopener noreferrer" target="_blank">IndieFest</a>, a festival that celebrates performing arts and emerging technology in Vancouver, Canada.Alongside bringing ancient stories to life through modern technology, Debi and the re:Naissance team continue to develop modern-day operatic performances to empower storytellers, and ensure the artform is accessible to future generations.&ldquo;The growth of opera has never been about one person coming up with an idea. It was about many different people from many different sectors&ndash;from philosophers to singer-songwriters to scientists to musicians and composers and performers,all throwing their ideas and riffing off each other. The future of opera will largely depend on accessibility, not just in terms of hardware, but in terms of being able to access your ability as an artist and create your own story, your own inspiration.&rdquo; <img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjY2MjUwMDQ1MDg4LUVyaWthIE1pdHN1aGFzaGkgaW4gWHNlbnMgc3VpdCB3aXRoIHRoZSBBdmF0YXIuanBnIiwiZWRpdHMiOnsicmVzaXplIjp7IndpZHRoIjo5NTAsImZpdCI6ImNvdmVyIn19fQ==" style="width: 300px;" class="fr-fic fr-dib">Watch &lsquo;Live from the Underworld&rsquo; Ep. 2 Performance <a href="https://youtu.be/CHndV-0qiUs?t=1789" rel="noopener noreferrer" target="_blank">VOD</a> as well as <a href="https://drive.google.com/file/d/107WnKN1VuhrlXpGl8ilWG3U6AIPoQhCg/view" rel="noopener noreferrer" target="_blank">BTS footage</a>.

By Using Movella’s Xsens Motion Capture Technology 

re:Naissance Opera Reinvent Opera for the Next Generation

In this episode, we discuss how a wearable based sensing platform developed by MIT can provide detailed information about a user’s muscle activity and enable virtual physical therapy to increase access for this vital practice. &nbsp;<iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless="" src="https://player.simplecast.com/225fb133-bd97-4e96-b79b-11bfc3ae2fcd?dark=false" class="fr-draggable" data-lf-form-tracking-inspected-kn9eq4roawkarlvp="true" data-lf-yt-playback-inspected-kn9eq4roawkarlvp="true" data-lf-vimeo-playback-inspected-kn9eq4roawkarlvp="true"></iframe><hr>This podcast is sponsored by <a href="https://www2.mouser.com/" id="isPasted" rel="nofollow" target="_blank">Mouser Electronics</a>. &nbsp;<img src="https://images.wevolver.com/eyJidWNrZXQiOiJ3ZXZvbHZlci1wcm9qZWN0LWltYWdlcyIsImtleSI6ImZyb2FsYS8xNjY2MTcxMjQ1MDkwLU1vdXNlci1zcG9uc29yLTEtYS5qcGciLCJlZGl0cyI6eyJyZXNpemUiOnsid2lkdGgiOjk1MCwiZml0IjoiY292ZXIifX19" style="width: 766px;" class="fr-fic fr-dib"><hr><h3 id="isPasted">EPISODE NOTES</h3>(3:00) - MIT System "sees" The Inner Structure of The Body During Physical RehabEpisode 92 was brought to you by Mouser Electronics, Farbod &amp; Daniel’s favorite electronics distributor. Click <a href="https://resources.mouser.com/monitoring/remote-health-monitoring" target="_blank">here</a> to read about the Mouser technical resource discussing neural networks!<hr>As always, you can find these and other interesting &amp; impactful engineering articles on Wevolver.com.To learn more about this show, please visit our<a href="https://www.wevolver.com/profile/the.next.byte" target="_blank">&nbsp;shows page</a>. By following the page, you will get automatic updates by email when a new show is published. Be sure to give us a follow and review on<a href="https://podcasts.apple.com/nl/podcast/the-next-byte/id1548255861?l=en" rel="nofollow" target="_blank">&nbsp;Apple&nbsp;</a>podcasts,<a href="https://open.spotify.com/show/6lPPsRtegnivsRUEsQ09R7?si=IPMiah7xT_apJtPjqvXMlA" rel="nofollow" target="_blank">&nbsp;Spotify</a>, and most of your favorite podcast platforms!

MuscleRehab is a system that uses electrical impedance tomography and optical motion tracking for visualizing muscle engagement and motion data during unsupervised physical rehabilitation. Image courtesy of MIT CSAIL.

In this episode, we discuss how a wearable based sensing platform developed by MIT can provide detailed information about a user’s muscle activity and enable virtual physical therapy to increase access for this vital practice. 

motion capture systems

Latest Posts