{"id":577287,"date":"2024-01-03T15:33:37","date_gmt":"2024-01-03T20:33:37","guid":{"rendered":"https:\/\/www.therobotreport.com\/?p=577287"},"modified":"2024-01-03T15:33:37","modified_gmt":"2024-01-03T20:33:37","slug":"ddog-mit-project-connects-brain-computer-interface-spot-robot","status":"publish","type":"post","link":"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/","title":{"rendered":"Ddog project at MIT connects brain-computer interface with Spot robot"},"content":{"rendered":"<p><iframe loading=\"lazy\" title=\"Ddog: The World\u2019s First Brain-Controlled Spot Robot\" width=\"740\" height=\"416\" src=\"https:\/\/www.youtube.com\/embed\/uBcdnOlYJw8?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe><\/p>\n<p>An MIT research team, led by Nataliya Kos&#8217;myna, recently published a paper about its Ddog project. It aims to turn a Boston Dynamics Spot quadruped into a basic communicator for people with physical challenges such as ALS, cerebral palsy, and spinal cord injuries.&nbsp;<\/p>\n<p>The <a href=\"https:\/\/www.media.mit.edu\/projects\/ddog\/overview\/\" target=\"_blank\" rel=\"noopener\">project<\/a>&#8216;s system uses a brain-computer interface (BCI) system including <a href=\"https:\/\/www.media.mit.edu\/projects\/attentivu\/overview\/\" target=\"_blank\" rel=\"noopener\">AttentivU<\/a>. This comes in the form of a pair of wireless glasses with sensors embedded into the frames. These sensors can measure a person&#8217;s electroencephalogram (EEG), or brain activity, and electrooculogram, or eye movements.&nbsp;<\/p>\n<p>This research builds on the <a href=\"https:\/\/www.therobotreport.com\/tag\/MIT\/\" target=\"_blank\" rel=\"noopener\">university<\/a>&#8216;s <a href=\"https:\/\/www.media.mit.edu\/projects\/brain-switch\/overview\/\" target=\"_blank\" rel=\"noopener\">Brain Switch<\/a>, a real-time, closed-loop BCI that allows users to communicate nonverbally and in real time with a caretaker. Kos&#8217;myna&#8217;s Ddog project extends the application using the same tech stack and infrastructure as Brain Switch.&nbsp;<\/p>\n<h2>Spot could fetch items for users&nbsp;<\/h2>\n<p>There are 30,000 people living with ALS (amyotrophic lateral sclerosis) in the U.S. today, and an estimated 5,000 new cases are diagnosed each year, <a href=\"https:\/\/rarediseases.org\/rare-diseases\/amyotrophic-lateral-sclerosis\/\" target=\"_blank\" rel=\"noopener\">according to<\/a> the National Organization for Rare Disorders. In addition, about 1 million Americans are living with cerebral palsy, <a href=\"https:\/\/www.cerebralpalsyguide.com\/cerebral-palsy\/statistics\" target=\"_blank\" rel=\"noopener\">according to<\/a> the Cerebral Palsy Guide.&nbsp;<\/p>\n<p>Many of these people already have or will eventually lose their ability to walk, get themselves dressed, speak, write, or even breathe. While aids for communication do exist, most are eye-gaze devices that allow users to communicate using a computer. There aren&#8217;t many systems that allow the user to interact with the world around them.&nbsp;<\/p>\n<p>Ddog&#8217;s biggest advantage is its mobility. Spot is fully autonomous. This means that when given simple instructions, it can carry them out without intervention.<\/p>\n<p>Spot is also highly mobile. Its four legs mean that it can go almost anywhere a human can, including up and down slopes and stairs. The robot&#8217;s arm accessory allows it perform tasks like delivering groceries, moving a chair, or bringing a book or toy to the user.&nbsp;<\/p>\n<p>The MIT system runs on just two iPhones and a pair of glasses. It doesn&#8217;t require sticky electrodes or backpacks, making it much more accessible for everyday use than other aids, said the team.<\/p>\n<p><iframe loading=\"lazy\" title=\"[IN-DEPTH INTERVIEW] Ddog: The World\u2019s First Brain-Controlled Spot Robot\" width=\"740\" height=\"416\" src=\"https:\/\/www.youtube.com\/embed\/ltrPvggcx4c?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe><\/p>\n<h2>How Ddog works<\/h2>\n<p>The first thing Spot must do when working with a new user in a new environment is create a 3D map of the world its working within. Next, the first iPhone will prompt the user by asking what they want to do next, and the user will answer by simply thinking of what they want.&nbsp;<\/p>\n<p>The second iPhone runs the local navigation map, controls Spot&#8217;s arm, and augments Spot&#8217;s lidar with the iPhone&#8217;s lidar data. The two iPhones communicate with each other to track Spot&#8217;s progress in completing tasks.<\/p>\n<p>The MIT team designed to system to work fully offline or online. The online version has a more advanced set of machine learning models and better fine-tuned models.&nbsp;<\/p>\n<div id=\"attachment_577298\" style=\"width: 1010px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-577298\" class=\"size-full wp-image-577298\" src=\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/ddog-overview.jpg\" alt=\"Ddog overview.\" width=\"1000\" height=\"706\" srcset=\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/ddog-overview.jpg 1000w, https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/ddog-overview-300x212.jpg 300w, https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/ddog-overview-150x106.jpg 150w, https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/ddog-overview-768x542.jpg 768w, https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/ddog-overview-337x238.jpg 337w\" sizes=\"(max-width: 1000px) 100vw, 1000px\" \/><p id=\"caption-attachment-577298\" class=\"wp-caption-text\">An overview of the Project Ddog system. | Source: MIT<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Project Ddog aims to turn a Boston Dynamics Spot quadruped into a basic communicator for those with physical challenges such as ALS.\u00a0<\/p>\n","protected":false},"author":872,"featured_media":577299,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"rbr50_analysis":"","rbr50_state":"","rbr50_country":"","rbr50_description":"","rbr50_numemps":"","rbr50_text_taxonomy_radio":null,"rbr50_text_taxonomy_select":null,"rbr50_url":"","rbr50_yearfounded":"","_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","ngg_post_thumbnail":0,"footnotes":""},"categories":[1753,1770,2011,1401],"tags":[2042,511,1774,979],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Ddog project at MIT connects brain-computer interface with Spot robot - The Robot Report<\/title>\n<meta name=\"description\" content=\"MIT&#039;s project Ddog aims to turn a Boston Dynamics Spot quadruped into a basic communicator for those with physical challenges like ALS.\u00a0\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Ddog project at MIT connects brain-computer interface with Spot robot - The Robot Report\" \/>\n<meta property=\"og:description\" content=\"MIT&#039;s project Ddog aims to turn a Boston Dynamics Spot quadruped into a basic communicator for those with physical challenges like ALS.\u00a0\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/\" \/>\n<meta property=\"og:site_name\" content=\"The Robot Report\" \/>\n<meta property=\"article:published_time\" content=\"2024-01-03T20:33:37+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/project-ddog-featured.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"770\" \/>\n\t<meta property=\"og:image:height\" content=\"500\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Brianna Wessling\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@therobotreport\" \/>\n<meta name=\"twitter:site\" content=\"@therobotreport\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Brianna Wessling\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/\",\"url\":\"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/\",\"name\":\"Ddog project at MIT connects brain-computer interface with Spot robot - The Robot Report\",\"isPartOf\":{\"@id\":\"https:\/\/www.therobotreport.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/project-ddog-featured.jpg\",\"datePublished\":\"2024-01-03T20:33:37+00:00\",\"dateModified\":\"2024-01-03T20:33:37+00:00\",\"author\":{\"@id\":\"https:\/\/www.therobotreport.com\/#\/schema\/person\/b49ac8168e6f266c4fcadb923f6e94d0\"},\"description\":\"MIT's project Ddog aims to turn a Boston Dynamics Spot quadruped into a basic communicator for those with physical challenges like ALS.\u00a0\",\"breadcrumb\":{\"@id\":\"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/#primaryimage\",\"url\":\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/project-ddog-featured.jpg\",\"contentUrl\":\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/project-ddog-featured.jpg\",\"width\":770,\"height\":500,\"caption\":\"MIT's Ddog project uses Spot robot to aid users. Credit: MIT\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.therobotreport.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Ddog project at MIT connects brain-computer interface with Spot robot\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.therobotreport.com\/#website\",\"url\":\"https:\/\/www.therobotreport.com\/\",\"name\":\"The Robot Report\",\"description\":\"Robotics news, research and analysis\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.therobotreport.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.therobotreport.com\/#\/schema\/person\/b49ac8168e6f266c4fcadb923f6e94d0\",\"name\":\"Brianna Wessling\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.therobotreport.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/719a94898a1df4a988dece3c21c2050a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/719a94898a1df4a988dece3c21c2050a?s=96&d=mm&r=g\",\"caption\":\"Brianna Wessling\"},\"description\":\"Brianna Wessling is an Associate Editor, Robotics, WTWH Media. She joined WTWH Media in November 2021, and is a recent graduate from the University of Kansas. She can be reached at bwessling@wtwhmedia.com\",\"url\":\"https:\/\/www.therobotreport.com\/author\/bwessling\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Ddog project at MIT connects brain-computer interface with Spot robot - The Robot Report","description":"MIT's project Ddog aims to turn a Boston Dynamics Spot quadruped into a basic communicator for those with physical challenges like ALS.\u00a0","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/","og_locale":"en_US","og_type":"article","og_title":"Ddog project at MIT connects brain-computer interface with Spot robot - The Robot Report","og_description":"MIT's project Ddog aims to turn a Boston Dynamics Spot quadruped into a basic communicator for those with physical challenges like ALS.\u00a0","og_url":"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/","og_site_name":"The Robot Report","article_published_time":"2024-01-03T20:33:37+00:00","og_image":[{"width":770,"height":500,"url":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/project-ddog-featured.jpg","type":"image\/jpeg"}],"author":"Brianna Wessling","twitter_card":"summary_large_image","twitter_creator":"@therobotreport","twitter_site":"@therobotreport","twitter_misc":{"Written by":"Brianna Wessling","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/","url":"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/","name":"Ddog project at MIT connects brain-computer interface with Spot robot - The Robot Report","isPartOf":{"@id":"https:\/\/www.therobotreport.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/#primaryimage"},"image":{"@id":"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/#primaryimage"},"thumbnailUrl":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/project-ddog-featured.jpg","datePublished":"2024-01-03T20:33:37+00:00","dateModified":"2024-01-03T20:33:37+00:00","author":{"@id":"https:\/\/www.therobotreport.com\/#\/schema\/person\/b49ac8168e6f266c4fcadb923f6e94d0"},"description":"MIT's project Ddog aims to turn a Boston Dynamics Spot quadruped into a basic communicator for those with physical challenges like ALS.\u00a0","breadcrumb":{"@id":"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/#primaryimage","url":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/project-ddog-featured.jpg","contentUrl":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2024\/01\/project-ddog-featured.jpg","width":770,"height":500,"caption":"MIT's Ddog project uses Spot robot to aid users. Credit: MIT"},{"@type":"BreadcrumbList","@id":"https:\/\/www.therobotreport.com\/ddog-mit-project-connects-brain-computer-interface-spot-robot\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.therobotreport.com\/"},{"@type":"ListItem","position":2,"name":"Ddog project at MIT connects brain-computer interface with Spot robot"}]},{"@type":"WebSite","@id":"https:\/\/www.therobotreport.com\/#website","url":"https:\/\/www.therobotreport.com\/","name":"The Robot Report","description":"Robotics news, research and analysis","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.therobotreport.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.therobotreport.com\/#\/schema\/person\/b49ac8168e6f266c4fcadb923f6e94d0","name":"Brianna Wessling","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.therobotreport.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/719a94898a1df4a988dece3c21c2050a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/719a94898a1df4a988dece3c21c2050a?s=96&d=mm&r=g","caption":"Brianna Wessling"},"description":"Brianna Wessling is an Associate Editor, Robotics, WTWH Media. She joined WTWH Media in November 2021, and is a recent graduate from the University of Kansas. She can be reached at bwessling@wtwhmedia.com","url":"https:\/\/www.therobotreport.com\/author\/bwessling\/"}]}},"_links":{"self":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/posts\/577287"}],"collection":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/users\/872"}],"replies":[{"embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/comments?post=577287"}],"version-history":[{"count":0,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/posts\/577287\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/media\/577299"}],"wp:attachment":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/media?parent=577287"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/categories?post=577287"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/tags?post=577287"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}