{"id":577925,"date":"2024-02-19T08:15:28","date_gmt":"2024-02-19T13:15:28","guid":{"rendered":"https:\/\/www.therobotreport.com\/?p=577925"},"modified":"2024-02-18T17:04:29","modified_gmt":"2024-02-18T22:04:29","slug":"roboguide-robot-dog-uses-ai-assist-visually-impaired","status":"publish","type":"post","link":"https:\/\/www.therobotreport.com\/roboguide-robot-dog-uses-ai-assist-visually-impaired\/","title":{"rendered":"RoboGuide robot dog uses AI to assist the visually impaired"},"content":{"rendered":"
\"RoboGuide

RoboGuide uses sophisticated sensors and AI to help visually impaired users interact with the world around them. Credit: Royal National Institute of Blind People<\/p><\/div>\n

Visually impaired people may soon be able to use AI-powered robotic service dogs to navigate the world around them. Researchers from the University of Glasgow, along with industry and charity partners, have unveiled RoboGuide.<\/p>\n

The robot uses artificial intelligence to not only assist its users to move independently, but also to speak to them about what\u2019s going on around them. RoboGuide employs a variety of cutting-edge technologies mounted onto an off-the-shelf robot body, according to<\/a> the University of Glasgow.<\/p>\n

RoboGuide relies on computer vision to navigate<\/h2>\n

RoboGuide isn\u2019t the first robotic assistant<\/a> developed for visually impaired people. Another example is Gilde from MassRobotics resident startup and Pitchfire winner Glidance Inc.<\/a> <\/p>\n

The University of Glasgow researchers said RoboGuide does address two significant challenges for such robots. The first is that the technology these robots use to navigate their surroundings can limit their usefulness as guides.<\/p>\n

\u201cRobots which use GPS to navigate, for example, can perform well outdoors, but often struggle in indoor settings, where signal coverage can weaken,\u201d said Dr. Olaoluwa Popoola, the project\u2019s principal investigator at the University of Glasgow\u2019s James Watt School of Engineering<\/a>. \u201cOthers, which use cameras to see, are limited by line of sight, which makes it harder for them to safely guide people around objects or around bends.\u201d<\/p>\n

RoboGuide is equipped with a series of sophisticated sensors to accurately map its environment.<\/p>\n

\u201cWe use computer vision and 3D technology, where it scans the whole environment and it understands where each object, each pillar, each obstacle is,\u201d said Dr. Wasim Ahmad, project co-investigator.<\/p>\n

The team has developed software that assesses the mapping data and uses simultaneous localization and mapping (SLAM<\/a>) algorithms to  determine optimal routes from one location to another. The software interprets sensor data in real time, enabling the robot to track and avoid moving obstacles.<\/p>\n

\r\n

\"SITELearn from Agility Robotics, Amazon, Disney, Teradyne and many more.<\/a><\/p>\r\n\r\n\r\n

\n

University of Glasgow adds interactivity<\/h2>\n

In addition to improved navigation, RoboGuide includes the ability to talk to its user. The robot uses a large language model (LLM) — similar to the technology that powers ChatGPT — to understand and respond to questions from people around it.<\/p>\n

LLMs are deep learning algorithms<\/a> that process natural language inputs, such as spoken questions, and predicts responses based on those inputs. RoboGuide\u2019s AI is trained on massive data sets of language to be able to predict and generate context-appropriate responses to questions and commands.<\/p>\n

RoboGuide recently reached a significant milestone in its development. In December 2023, volunteers with visual impairments tested it for the first time.<\/p>\n

The quadruped<\/a> robot guided them through the Hunterian Museum in Glasgow. RoboGuide helped the volunteers tour exhibits on the first floor and provided interactive spoken information on six exhibits.<\/p>\n

The results were promising. \u201cOne hundred percent I would use this in the future,\u201d said volunteer Kyle Somerville (see video below). \u201cAs well, there are a lot of people I know that would definitely either want to try this or would definitely use it.\u201d <\/p>\n