{"id":565378,"date":"2023-03-30T20:39:18","date_gmt":"2023-03-31T00:39:18","guid":{"rendered":"https:\/\/www.therobotreport.com\/?p=565378"},"modified":"2023-03-30T20:44:51","modified_gmt":"2023-03-31T00:44:51","slug":"researchers-taught-quadruped-to-use-legs-as-manipulators","status":"publish","type":"post","link":"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/","title":{"rendered":"Researchers taught a quadruped to use its legs for manipulation"},"content":{"rendered":"<div align=\"center\"><iframe loading=\"lazy\" title=\"Legs as Manipulator: Pushing Quadrupedal Agility Beyond Locomotion\" width=\"740\" height=\"416\" src=\"https:\/\/www.youtube.com\/embed\/d3YCmkEC7V0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe><\/div>\n<pre><\/pre>\n<p>Researchers from Carnegie Mellon University (CMU) and UC Berkeley want to give quadrupeds more capabilities similar to their biological counterparts. Just like real dogs can use their front legs for things other than walking and running, like digging and other manipulation tasks, the researchers think quadrupeds could someday do the same.<\/p>\n<p>Currently, we see quadrupeds use their legs as just legs to navigate their surroundings. Some of them, like Boston Dynamics&#8217; Spot, get around these limitations by <a href=\"https:\/\/www.therobotreport.com\/robot-arm-opens-new-doors-boston-dynamics-spot\/\">adding a robotic arm to the quadruped&#8217;s back<\/a>. This arm allows Spot to manipulate things, like opening doors and pressing buttons, while maintaining the flexibility that four legs give locomotion.<\/p>\n<p>However, the researchers at CMU and UC Berkeley taught a Unitree Go1 quadruped, equipped with an Intel RealSense camera for perception, how to use its front legs to <a href=\"https:\/\/robot-skills.github.io\/\" target=\"_blank\" rel=\"noopener\">climb walls, press buttons, kick a soccer ball and perform other object interactions in the real world<\/a>, on top of teaching it how to walk.<\/p>\n<p>The team started this challenging task by decoupling the skill learning into two broad categories: locomotion, which involves movements like walking or climbing a wall, and manipulation, which involves using one leg to interact with objects while balancing on three legs. Decoupling these tasks help the quadruped to simultaneously move to stay balanced and manipulate objects with one leg.<\/p>\n<p>By training in simulation, the team taught the quadruped these skills and transferred them to the real world with their proposed sim2real variant. This variant builds upon recent locomotion success.<\/p>\n<p>All of these skills are combined into a robust long-term plan by teaching the quadruped a behavior tree that encodes a high-level task hierarchy from one clean expert demonstration. This allows the quadruped to move through the behavior tree and return to its last successful movement when it runs into problems with certain branches of the behavior tree.<\/p>\n<p>For example, if a quadruped is tasked with pressing a button on a wall but fails to climb up the wall, it returns to the last task it did successfully, like approaching the wall, and starts there again.<\/p>\n<p>The research team was made up of Xuxin Cheng, a Master&#8217;s student in robotics at CMU, Ashish Kumar, a graduate student at UC Berkeley, and Deepak Pathak, an assistant professor at CMU in Computer Science. You can read their technical paper &#8220;<a href=\"https:\/\/robot-skills.github.io\/resources\/legmanip.pdf\" target=\"_blank\" rel=\"noopener\">Legs as Manipulator: Pushing Quadrupedal Agility Beyond Locomotion<\/a>&#8221; (PDF) to learn more. They said a limitation of their work is that they decoupled high-level decision making and low-level command tracking, but that a full end-to-end solution is &#8220;an exciting future direction.&#8221;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Researchers taught a Unitree Go1 quadruped how to use its front legs to climb walls, press buttons and kick a soccer ball.<\/p>\n","protected":false},"author":872,"featured_media":565382,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"rbr50_analysis":"","rbr50_state":"","rbr50_country":"","rbr50_description":"","rbr50_numemps":"","rbr50_text_taxonomy_radio":"","rbr50_text_taxonomy_select":"","rbr50_url":"","rbr50_yearfounded":"","_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","ngg_post_thumbnail":0,"footnotes":""},"categories":[1753,2009,1284,1401,2012,2001],"tags":[1130,2526,1042],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Researchers taught a quadruped to use its legs for manipulation<\/title>\n<meta name=\"description\" content=\"Researchers taught a Unitree Go1 quadruped how to use its front legs to climb walls, press buttons and kick a soccer ball.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Researchers taught a quadruped to use its legs for manipulation\" \/>\n<meta property=\"og:description\" content=\"Researchers taught a Unitree Go1 quadruped how to use its front legs to climb walls, press buttons and kick a soccer ball.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/\" \/>\n<meta property=\"og:site_name\" content=\"The Robot Report\" \/>\n<meta property=\"article:published_time\" content=\"2023-03-31T00:39:18+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-03-31T00:44:51+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/03\/quadruped-featured.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"770\" \/>\n\t<meta property=\"og:image:height\" content=\"500\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Brianna Wessling\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@therobotreport\" \/>\n<meta name=\"twitter:site\" content=\"@therobotreport\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Brianna Wessling\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/\",\"url\":\"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/\",\"name\":\"Researchers taught a quadruped to use its legs for manipulation\",\"isPartOf\":{\"@id\":\"https:\/\/www.therobotreport.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/03\/quadruped-featured.jpg\",\"datePublished\":\"2023-03-31T00:39:18+00:00\",\"dateModified\":\"2023-03-31T00:44:51+00:00\",\"author\":{\"@id\":\"https:\/\/www.therobotreport.com\/#\/schema\/person\/b49ac8168e6f266c4fcadb923f6e94d0\"},\"description\":\"Researchers taught a Unitree Go1 quadruped how to use its front legs to climb walls, press buttons and kick a soccer ball.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/#primaryimage\",\"url\":\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/03\/quadruped-featured.jpg\",\"contentUrl\":\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/03\/quadruped-featured.jpg\",\"width\":770,\"height\":500,\"caption\":\"A quadruped robot leaning against a wall and touching a button.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.therobotreport.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Researchers taught a quadruped to use its legs for manipulation\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.therobotreport.com\/#website\",\"url\":\"https:\/\/www.therobotreport.com\/\",\"name\":\"The Robot Report\",\"description\":\"Robotics news, research and analysis\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.therobotreport.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.therobotreport.com\/#\/schema\/person\/b49ac8168e6f266c4fcadb923f6e94d0\",\"name\":\"Brianna Wessling\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.therobotreport.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/719a94898a1df4a988dece3c21c2050a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/719a94898a1df4a988dece3c21c2050a?s=96&d=mm&r=g\",\"caption\":\"Brianna Wessling\"},\"description\":\"Brianna Wessling is an Associate Editor, Robotics, WTWH Media. She joined WTWH Media in November 2021, and is a recent graduate from the University of Kansas. She can be reached at bwessling@wtwhmedia.com\",\"url\":\"https:\/\/www.therobotreport.com\/author\/bwessling\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Researchers taught a quadruped to use its legs for manipulation","description":"Researchers taught a Unitree Go1 quadruped how to use its front legs to climb walls, press buttons and kick a soccer ball.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/","og_locale":"en_US","og_type":"article","og_title":"Researchers taught a quadruped to use its legs for manipulation","og_description":"Researchers taught a Unitree Go1 quadruped how to use its front legs to climb walls, press buttons and kick a soccer ball.","og_url":"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/","og_site_name":"The Robot Report","article_published_time":"2023-03-31T00:39:18+00:00","article_modified_time":"2023-03-31T00:44:51+00:00","og_image":[{"width":770,"height":500,"url":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/03\/quadruped-featured.jpg","type":"image\/jpeg"}],"author":"Brianna Wessling","twitter_card":"summary_large_image","twitter_creator":"@therobotreport","twitter_site":"@therobotreport","twitter_misc":{"Written by":"Brianna Wessling","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/","url":"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/","name":"Researchers taught a quadruped to use its legs for manipulation","isPartOf":{"@id":"https:\/\/www.therobotreport.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/#primaryimage"},"image":{"@id":"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/#primaryimage"},"thumbnailUrl":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/03\/quadruped-featured.jpg","datePublished":"2023-03-31T00:39:18+00:00","dateModified":"2023-03-31T00:44:51+00:00","author":{"@id":"https:\/\/www.therobotreport.com\/#\/schema\/person\/b49ac8168e6f266c4fcadb923f6e94d0"},"description":"Researchers taught a Unitree Go1 quadruped how to use its front legs to climb walls, press buttons and kick a soccer ball.","breadcrumb":{"@id":"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/#primaryimage","url":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/03\/quadruped-featured.jpg","contentUrl":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/03\/quadruped-featured.jpg","width":770,"height":500,"caption":"A quadruped robot leaning against a wall and touching a button."},{"@type":"BreadcrumbList","@id":"https:\/\/www.therobotreport.com\/researchers-taught-quadruped-to-use-legs-as-manipulators\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.therobotreport.com\/"},{"@type":"ListItem","position":2,"name":"Researchers taught a quadruped to use its legs for manipulation"}]},{"@type":"WebSite","@id":"https:\/\/www.therobotreport.com\/#website","url":"https:\/\/www.therobotreport.com\/","name":"The Robot Report","description":"Robotics news, research and analysis","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.therobotreport.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.therobotreport.com\/#\/schema\/person\/b49ac8168e6f266c4fcadb923f6e94d0","name":"Brianna Wessling","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.therobotreport.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/719a94898a1df4a988dece3c21c2050a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/719a94898a1df4a988dece3c21c2050a?s=96&d=mm&r=g","caption":"Brianna Wessling"},"description":"Brianna Wessling is an Associate Editor, Robotics, WTWH Media. She joined WTWH Media in November 2021, and is a recent graduate from the University of Kansas. She can be reached at bwessling@wtwhmedia.com","url":"https:\/\/www.therobotreport.com\/author\/bwessling\/"}]}},"_links":{"self":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/posts\/565378"}],"collection":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/users\/872"}],"replies":[{"embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/comments?post=565378"}],"version-history":[{"count":0,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/posts\/565378\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/media\/565382"}],"wp:attachment":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/media?parent=565378"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/categories?post=565378"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/tags?post=565378"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}