{"id":559173,"date":"2021-03-22T12:01:40","date_gmt":"2021-03-22T16:01:40","guid":{"rendered":"https:\/\/www.therobotreport.com\/?p=559173"},"modified":"2021-03-22T12:01:40","modified_gmt":"2021-03-22T16:01:40","slug":"deep-learning-sensor-placement-soft-robots","status":"publish","type":"post","link":"https:\/\/www.therobotreport.com\/deep-learning-sensor-placement-soft-robots\/","title":{"rendered":"Deep learning optimizes sensor placement for soft robots"},"content":{"rendered":"<div id=\"attachment_559174\" style=\"width: 1010px\" class=\"wp-caption alignleft\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-559174\" class=\"wp-image-559174 size-full\" src=\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1.jpg\" alt=\"deep learning sensors soft robots\" width=\"1000\" height=\"667\" srcset=\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1.jpg 1000w, https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1-300x200.jpg 300w, https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1-150x100.jpg 150w, https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1-768x512.jpg 768w, https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1-357x238.jpg 357w\" sizes=\"(max-width: 1000px) 100vw, 1000px\" \/><p id=\"caption-attachment-559174\" class=\"wp-caption-text\"><strong>MIT built a deep learning neural network to aid the design of soft robots, such as these iterations of a robotic elephant. | Photo Credit: MIT<\/strong><\/p><\/div>\n<p>There are some tasks <a href=\"https:\/\/www.therobotreport.com\/category\/robots-platforms\/industrial-robots\/\">traditional robots<\/a> &#8211; the rigid and metallic kind &#8211; simply aren\u2019t cut out for. Soft-bodied robots, on the other hand, may be able to interact with people more safely or slip into tight spaces with ease. But for robots to reliably complete their programmed duties, they need to know the whereabouts of all their body parts. That\u2019s a tall task for a soft robot that can deform in a virtually infinite number of ways.<\/p>\n<p>MIT researchers developed an algorithm to help engineers design <a href=\"https:\/\/www.therobotreport.com\/category\/technologies\/soft-robotics\/\">soft robots<\/a> that collect more useful information about their surroundings. The deep learning algorithm suggests an optimized placement of sensors within the robot\u2019s body, allowing it to better interact with its environment and complete assigned tasks. The advance is a step toward the automation of robot design.<\/p>\n<p>\u201cThe system not only learns a given task, but also how to best design the robot to solve that task,\u201d said Alexander Amini. \u201cSensor placement is a very difficult problem to solve. So, having this solution is extremely exciting.\u201d<\/p>\n<p>The research will be presented at the IEEE International Conference on Soft Robotics and will be published in the journal <em>IEEE Robotics and Automation Letters<\/em>. Co-lead authors are Amini and Andrew Spielberg, both PhD students in MIT Computer Science and Artificial Intelligence Laboratory (CSAIL). Other co-authors include MIT PhD student Lillian Chin, and professors Wojciech Matusik and Daniela Rus.<\/p>\n<p><strong>Related:<\/strong> <a class=\"entry-title-link\" href=\"https:\/\/www.therobotreport.com\/designing-quadruped-controlled-powered-pneumatics\/\" rel=\"bookmark\">Designing a quadruped controlled &amp; powered by pneumatics<\/a><\/p>\n<p>Creating soft robots that complete real-world tasks has been a long-running challenge in robotics. Their rigid counterparts have a built-in advantage: a limited range of motion. Rigid robots\u2019 finite array of joints and limbs usually makes for manageable calculations by the algorithms that control mapping and motion planning. Soft robots are not so tractable.<\/p>\n<p>Soft robots are flexible and pliant \u2014 they generally feel more like a bouncy ball than a bowling ball. \u201cThe main problem with soft robots is that they are infinitely dimensional,\u201d said Spielberg. \u201cAny point on a soft-bodied robot can, in theory, deform in any way possible.\u201d That makes it tough to design a soft robot that can map the location of its body parts. Past efforts have used an external camera to chart the robot\u2019s position and feed that information back into the robot\u2019s control program. But the researchers wanted to create a soft robot untethered from external aid.<\/p>\n<div align=\"center\">\n<p><iframe loading=\"lazy\" title=\"Co-Learning of Task and Sensor Placement for Soft Robotics (Teaser)\" width=\"740\" height=\"416\" src=\"https:\/\/www.youtube.com\/embed\/MSa7D0FvxqY?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<\/div>\n<p>\u201cYou can\u2019t put an infinite number of sensors on the robot itself,\u201d said Spielberg. \u201cSo, the question is: How many sensors do you have, and where do you put those sensors in order to get the most bang for your buck?\u201d The team turned to deep learning for an answer.<\/p>\n<p>The researchers developed a novel neural network architecture that both optimizes sensor placement and learns to efficiently complete tasks. First, the researchers divided the robot\u2019s body into regions called \u201cparticles.\u201d Each particle\u2019s rate of strain was provided as an input to the neural network. Through a process of trial and error, the network \u201clearns\u201d the most efficient sequence of movements to complete tasks, like gripping objects of different sizes. At the same time, the network keeps track of which particles are used most often, and it culls the lesser-used particles from the set of inputs for the networks\u2019 subsequent trials.<\/p>\n<p>By optimizing the most important particles, the network also suggests where sensors should be placed on the robot to ensure efficient performance. For example, in a simulated robot with a grasping hand, the algorithm might suggest that sensors be concentrated in and around the fingers, where precisely controlled interactions with the environment are vital to the robot\u2019s ability to manipulate objects. While that may seem obvious, it turns out the algorithm vastly outperformed humans\u2019 intuition on where to site the sensors.<\/p>\n<p><strong>Related:<\/strong> <a class=\"entry-title-link\" href=\"https:\/\/www.therobotreport.com\/metamaterials-lead-transforming-robots-say-us-army-mit-researchers\/\" rel=\"bookmark\">Metamaterials could lead to transforming robots<\/a><\/p>\n<p>The researchers pitted their algorithm against a series of expert predictions. For three different soft robot layouts, the team asked roboticists to manually select where sensors should be placed to enable the efficient completion of tasks like grasping various objects. Then they ran simulations comparing the human-sensorized robots to the algorithm-sensorized robots. And the results weren\u2019t close.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-559175 size-full\" src=\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/soft-robotic-sensor-placement.jpg\" alt=\"deep learning sensors soft robots\" width=\"1000\" height=\"558\" srcset=\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/soft-robotic-sensor-placement.jpg 1000w, https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/soft-robotic-sensor-placement-300x167.jpg 300w, https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/soft-robotic-sensor-placement-150x84.jpg 150w, https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/soft-robotic-sensor-placement-768x429.jpg 768w, https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/soft-robotic-sensor-placement-368x205.jpg 368w\" sizes=\"(max-width: 1000px) 100vw, 1000px\" \/><\/p>\n<p>\u201cOur model vastly outperformed humans for each task, even though I looked at some of the robot bodies and felt very confident on where the sensors should go,\u201d said Amini. \u201cIt turns out there are a lot more subtleties in this problem than we initially expected.\u201d<\/p>\n<p>Spielberg said their work could help to automate the process of robot design. In addition to developing algorithms to control a robot\u2019s movements, \u201cwe also need to think about how we\u2019re going to sensorize these robots, and how that will interplay with other components of that system,\u201d he said. And better sensor placement could have industrial applications, especially where robots are used for fine tasks like gripping. \u201cThat\u2019s something where you need a very robust, well-optimized sense of touch,\u201d said Spielberg. \u201cSo, there\u2019s potential for immediate impact.\u201d<\/p>\n<p>\u201cAutomating the design of sensorized soft robots is an important step toward rapidly creating intelligent tools that help people with physical tasks,\u201d said Rus. \u201cThe sensors are an important aspect of the process, as they enable the soft robot to \u201csee\u201d and understand the world and its relationship with the world.\u201d<\/p>\n<p><em><strong>Editor&#8217;s Note:<\/strong> This article was republished from <a href=\"http:\/\/www.news.mit.edu\" target=\"_blank\" rel=\"noopener\">MIT News<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>There are some tasks traditional robots &#8211; the rigid and metallic kind &#8211; simply aren\u2019t cut out for. Soft-bodied robots, on the other hand, may be able to interact with people more safely or slip into tight spaces with ease. But for robots to reliably complete their programmed duties, they need to know the whereabouts&hellip;<\/p>\n","protected":false},"author":792,"featured_media":559174,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"rbr50_analysis":"","rbr50_state":"","rbr50_country":"","rbr50_description":"","rbr50_numemps":"","rbr50_text_taxonomy_radio":"","rbr50_text_taxonomy_select":"","rbr50_url":"","rbr50_yearfounded":"","_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","ngg_post_thumbnail":0,"footnotes":""},"categories":[1753,1382,2009,1401,2160],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Deep learning optimizes sensor placement for soft robots<\/title>\n<meta name=\"description\" content=\"MIT developed an algorithm to help engineers design soft robots by suggesting optimized placement of sensors within the robot\u2019s body.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Deep learning optimizes sensor placement for soft robots\" \/>\n<meta property=\"og:description\" content=\"MIT developed an algorithm to help engineers design soft robots by suggesting optimized placement of sensors within the robot\u2019s body.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322\" \/>\n<meta property=\"og:site_name\" content=\"The Robot Report\" \/>\n<meta property=\"article:published_time\" content=\"2021-03-22T16:01:40+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1000\" \/>\n\t<meta property=\"og:image:height\" content=\"667\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Daniel Ackerman | MIT News\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@therobotreport\" \/>\n<meta name=\"twitter:site\" content=\"@therobotreport\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Daniel Ackerman | MIT News\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.therobotreport.com\/deep-learning-sensor-placement-soft-robots\/\",\"url\":\"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322\",\"name\":\"Deep learning optimizes sensor placement for soft robots\",\"isPartOf\":{\"@id\":\"https:\/\/www.therobotreport.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322#primaryimage\"},\"image\":{\"@id\":\"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1.jpg\",\"datePublished\":\"2021-03-22T16:01:40+00:00\",\"dateModified\":\"2021-03-22T16:01:40+00:00\",\"author\":{\"@id\":\"https:\/\/www.therobotreport.com\/#\/schema\/person\/1df80031ae669c6f789ae9fdcd3033e0\"},\"description\":\"MIT developed an algorithm to help engineers design soft robots by suggesting optimized placement of sensors within the robot\u2019s body.\",\"breadcrumb\":{\"@id\":\"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322#primaryimage\",\"url\":\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1.jpg\",\"contentUrl\":\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1.jpg\",\"width\":1000,\"height\":667,\"caption\":\"MIT developed a deep learning neural network to aid the design of soft robots, such as these iterations of a robotic elephant. | Photo Credit: MIT\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.therobotreport.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Deep learning optimizes sensor placement for soft robots\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.therobotreport.com\/#website\",\"url\":\"https:\/\/www.therobotreport.com\/\",\"name\":\"The Robot Report\",\"description\":\"Robotics news, research and analysis\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.therobotreport.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.therobotreport.com\/#\/schema\/person\/1df80031ae669c6f789ae9fdcd3033e0\",\"name\":\"Daniel Ackerman | MIT News\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.therobotreport.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/db4bb958c25c584eb2061c7877854426?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/db4bb958c25c584eb2061c7877854426?s=96&d=mm&r=g\",\"caption\":\"Daniel Ackerman | MIT News\"},\"url\":\"https:\/\/www.therobotreport.com\/author\/daniel-ackerman\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Deep learning optimizes sensor placement for soft robots","description":"MIT developed an algorithm to help engineers design soft robots by suggesting optimized placement of sensors within the robot\u2019s body.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322","og_locale":"en_US","og_type":"article","og_title":"Deep learning optimizes sensor placement for soft robots","og_description":"MIT developed an algorithm to help engineers design soft robots by suggesting optimized placement of sensors within the robot\u2019s body.","og_url":"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322","og_site_name":"The Robot Report","article_published_time":"2021-03-22T16:01:40+00:00","og_image":[{"width":1000,"height":667,"url":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1.jpg","type":"image\/jpeg"}],"author":"Daniel Ackerman | MIT News","twitter_card":"summary_large_image","twitter_creator":"@therobotreport","twitter_site":"@therobotreport","twitter_misc":{"Written by":"Daniel Ackerman | MIT News","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.therobotreport.com\/deep-learning-sensor-placement-soft-robots\/","url":"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322","name":"Deep learning optimizes sensor placement for soft robots","isPartOf":{"@id":"https:\/\/www.therobotreport.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322#primaryimage"},"image":{"@id":"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322#primaryimage"},"thumbnailUrl":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1.jpg","datePublished":"2021-03-22T16:01:40+00:00","dateModified":"2021-03-22T16:01:40+00:00","author":{"@id":"https:\/\/www.therobotreport.com\/#\/schema\/person\/1df80031ae669c6f789ae9fdcd3033e0"},"description":"MIT developed an algorithm to help engineers design soft robots by suggesting optimized placement of sensors within the robot\u2019s body.","breadcrumb":{"@id":"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322#primaryimage","url":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1.jpg","contentUrl":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2021\/03\/MIT-Sensor-Placement-01-press_1.jpg","width":1000,"height":667,"caption":"MIT developed a deep learning neural network to aid the design of soft robots, such as these iterations of a robotic elephant. | Photo Credit: MIT"},{"@type":"BreadcrumbList","@id":"https:\/\/news.mit.edu\/2021\/sensor-soft-robots-placement-0322#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.therobotreport.com\/"},{"@type":"ListItem","position":2,"name":"Deep learning optimizes sensor placement for soft robots"}]},{"@type":"WebSite","@id":"https:\/\/www.therobotreport.com\/#website","url":"https:\/\/www.therobotreport.com\/","name":"The Robot Report","description":"Robotics news, research and analysis","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.therobotreport.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.therobotreport.com\/#\/schema\/person\/1df80031ae669c6f789ae9fdcd3033e0","name":"Daniel Ackerman | MIT News","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.therobotreport.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/db4bb958c25c584eb2061c7877854426?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/db4bb958c25c584eb2061c7877854426?s=96&d=mm&r=g","caption":"Daniel Ackerman | MIT News"},"url":"https:\/\/www.therobotreport.com\/author\/daniel-ackerman\/"}]}},"_links":{"self":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/posts\/559173"}],"collection":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/users\/792"}],"replies":[{"embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/comments?post=559173"}],"version-history":[{"count":0,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/posts\/559173\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/media\/559174"}],"wp:attachment":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/media?parent=559173"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/categories?post=559173"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/tags?post=559173"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}