Unveiling the Future: Human-Robot Interaction Revolutionizes Social Navigation Using AI and Deep Learning

In a world where automation dominates the manufacturing sector, one question persists: why aren't robots omnipresent in our daily lives? The answer lies in the intricate challenges of bridging the gap between humans and machines. While robots thrive in structured environments, the unpredictability and complexity of human behavior pose significant hurdles to seamless integration.

In Robotican's recent work, we have developed a new way for humans to interact with service robots. A person is talking to a robot and command it to perform series of tasks a spoken language. Such a command can be: "Go forward up until the end of the hallway, enter the room in front of you, ask the doctor to give you the examination files, and come back here". The robot uses a Speech-To-Text engine, to write the command in text, then it applies a specially trained LLM (Large Language Model) to divide the command into sub-tasks. In our example the sub-tasks will be: "move forward, enter the room, ask the doctor, go back". 



The robot start performing the sub-tasks according to the required order.  While moving the robot uses it cameras to "see" the environment in front of it. The frame from this camera goes into an LVM (Large Visual Model) which receives a photo and output text. When the way is clear this LVM will output "move forward", and an action will be: send the robot a navigation way point 10 meters ahead". When say, in our example, a group of people are standing in front of the robot blocking the way. Then the LVM will output "People are blocking the way", and the action will be "ask them to let me pass through".  Then a Text-To-Speech engine will say "Excuse me, I'm a robot with an important task. May I please pass through? Thank you.” Then the robot pass and continues its task. This process is repeated until the robot complete its task, or is unable to do it.

"The answer lies in the intricate challenges of bridging the gap between humans and machines"

This is a unique approach of combining TTS, STT, LLM and LVM to allow robot interact with human, and human interact with a robot in a spoken language, while understanding tasks, seeing and understanding the environment around it, and asking people to help the robot conducting its task successfully.

Enter Robotican, a pioneering force at the forefront of autonomous robotics, spearheading the charge to revolutionize Human-Robot Interfaces. As a key player in the Israel Innovation Authority's groundbreaking consortium, Robotican harnesses its extensive expertise and recent advancement in AI and Deep Learning to develop innovative solutions that allows robots to navigate amongst people while interacting with them similarly to the way other peoples do.

Championing the quest to teach robots to navigate unstructured environments effortlessly, Robotican embarks on a transformative journey empowered by cutting-edge Large Language and Vision Models (LLM & LVM). Leveraging the revolutionary capabilities of these models, Robotican engineers have unlocked the potential to communicate with robots in a language they understand.

Omri Eitan, Robotican's AI expert, sheds light on this groundbreaking advancement, stating, "The transformative power of the latest Language Model technology has ushered in a new era of complexity in decision-making and deep contextual reasoning. Tasks once deemed intensive engineering endeavors now undergo fine-tuning, and interactions once artificial now feel natural."
 

With Robotican's innovative approach, robots decode textual or verbal instructions, process visual data using LVM to navigate crowded environments, and seamlessly engage in dialogue with individuals, courtesy of LLM. This paradigm shift not only enhances precision in task execution but also fosters meaningful human-like interactions, paving the way for unprecedented advancements in automation and artificial intelligence.

Witness the dawn of a new era as Robotican redefines the landscape of human-robot interaction, propelling automation into realms previously deemed unimaginable. Join us as we embark on this transformative journey, shaping a future where robots seamlessly integrate into every facet of our lives. #RoboticanRevolution #HumanRobotInteraction #AIInnovation #AutomationAdvancements