{"id":566142,"date":"2023-07-05T15:25:04","date_gmt":"2023-07-05T19:25:04","guid":{"rendered":"https:\/\/www.therobotreport.com\/?p=566142"},"modified":"2023-07-05T15:25:04","modified_gmt":"2023-07-05T19:25:04","slug":"sereacts-pickgpt-lets-users-instruct-robots-with-natural-language","status":"publish","type":"post","link":"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/","title":{"rendered":"Sereact&#8217;s PickGPT lets users instruct robots with natural language"},"content":{"rendered":"<p><iframe loading=\"lazy\" title=\"Introducing PickGPT - a large language model for bin-picking solutions by Sereact\" width=\"740\" height=\"416\" src=\"https:\/\/www.youtube.com\/embed\/QcINWkmkRcM?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe><\/p>\n<p><a href=\"https:\/\/sereact.ai\/\" target=\"_blank\" rel=\"noopener\">Sereact<\/a>, a German-based AI and robotics developer, has announced PickGPT, a robotics transformer that combines large language models (LLMs) with the company&#8217;s computer vision technology.&nbsp;<\/p>\n<p>PickGPT allows robot operators to instruct robots using natural language by enabling robots to process natural language and visual information and correlate multimode data. PickGPT allows robots to perceive their environment with unprecedented intelligence and accuracy and understand and execute instructions in natural language.&nbsp;<\/p>\n<p>&#8220;PickGPT enables straightforward communication between humans and robots via voice commands and intuitive interfaces. This simplifies the link with other warehouse systems and enables employees to instruct the robot in a simple way &#8211; for example, to define pick points or to blacklist certain items,&#8221; Ralf Gulde, Co-Founder and CEO of Sereact, said.<\/p>\n<p>The robotics developer is a software-based robotics system that doesn&#8217;t require programming or training. Because of this, PickGPT reduces the time needed to set up and customize robots and allows employees to spend that time focusing on other essential tasks. It also expands the range of people who can work with robots as they don&#8217;t need a coding background to work with the system.<\/p>\n<p>Along with faster setup, PickGPT offers more flexibility and quality control. With the robotics transformer, robots can respond quickly and easily to new tasks or changing environmental conditions, which are common in warehouse settings.&nbsp;<\/p>\n<p>PickGPT can also recognize and identify objects and products in real time based on their visual characteristics. The transformer automatically analyzes product images and matches them with items in any real-world scenario.&nbsp;<\/p>\n<p>It can also understand and interpret product titles, descriptions, and other textual information to automatically identify and assign related products to regions in an image. This means that PickGPT has a high potential for quality control processes.&nbsp;<\/p>\n<p>The robotics transformer can also simplify the return process for e-commerce companies. PickGPT has the ability to distinguish between packaging material and products in the first step of the return process, and it can then sort the items automatically based on a description or product image, meaning there is no need for barcode scanning.&nbsp;<\/p>\n<p>Sereact was founded in 2021 by Marc Tuscher and Ralf Gulde, who both researched the combination of robotics and AI at the University of Stuttgart. The company is based in Stuttgart-Vaihingen, Germany.&nbsp;<\/p>\n<p>If you&#8217;re interested in learning more about LLMs and robotics, there will be a keynote session titled &#8220;Generative AI&#8217;s Impact on Robotics&#8221; at <a href=\"https:\/\/www.robobusiness.com\/\" target=\"_blank\" rel=\"noopener\">RoboBusiness<\/a> in Santa Clara, CA on October 18-19. This keynote panel of robotics industry leaders will discuss the applications of LLMs and text generation applications to robotics. It will also explore fundamental ways generative AI can be applied to robotics design, model training, simulation, control algorithms and product commercialization. Speakers at the talk include Amit Goel, the Director of Product Management at NVIDIA, Ken Goldberg, the William S. Floyd Jr Distinguished Chair in Engineering at UC Berkeley, Ted Larson, the CEO of OLogic, Jeff Linnell, founder and CEO of Formant, and Pras Velegapudi, the VP of innovation at Agility Robotics.&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Sereact has announced PickGPT, a robotics transformer that combines large language models with the company&#8217;s computer vision technology.\u00a0<\/p>\n","protected":false},"author":872,"featured_media":566146,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"rbr50_analysis":"","rbr50_state":"","rbr50_country":"","rbr50_description":"","rbr50_numemps":"","rbr50_text_taxonomy_radio":"","rbr50_text_taxonomy_select":"","rbr50_url":"","rbr50_yearfounded":"","_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","ngg_post_thumbnail":0,"footnotes":""},"categories":[1382,2004,1401,1293,2001],"tags":[665,1179,4071],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Sereact&#039;s PickGPT lets users instruct robots with natural language - The Robot Report<\/title>\n<meta name=\"description\" content=\"Sereact has announced PickGPT, a robotics transformer that combines large language models with the company&#039;s computer vision technology.\u00a0\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Sereact&#039;s PickGPT lets users instruct robots with natural language - The Robot Report\" \/>\n<meta property=\"og:description\" content=\"Sereact has announced PickGPT, a robotics transformer that combines large language models with the company&#039;s computer vision technology.\u00a0\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/\" \/>\n<meta property=\"og:site_name\" content=\"The Robot Report\" \/>\n<meta property=\"article:published_time\" content=\"2023-07-05T19:25:04+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/07\/Sereact_PickGPT-featured.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"770\" \/>\n\t<meta property=\"og:image:height\" content=\"500\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Brianna Wessling\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@therobotreport\" \/>\n<meta name=\"twitter:site\" content=\"@therobotreport\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Brianna Wessling\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/\",\"url\":\"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/\",\"name\":\"Sereact's PickGPT lets users instruct robots with natural language - The Robot Report\",\"isPartOf\":{\"@id\":\"https:\/\/www.therobotreport.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/07\/Sereact_PickGPT-featured.jpg\",\"datePublished\":\"2023-07-05T19:25:04+00:00\",\"dateModified\":\"2023-07-05T19:25:04+00:00\",\"author\":{\"@id\":\"https:\/\/www.therobotreport.com\/#\/schema\/person\/b49ac8168e6f266c4fcadb923f6e94d0\"},\"description\":\"Sereact has announced PickGPT, a robotics transformer that combines large language models with the company's computer vision technology.\u00a0\",\"breadcrumb\":{\"@id\":\"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/#primaryimage\",\"url\":\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/07\/Sereact_PickGPT-featured.jpg\",\"contentUrl\":\"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/07\/Sereact_PickGPT-featured.jpg\",\"width\":770,\"height\":500,\"caption\":\"sereact pickGPT.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.therobotreport.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Sereact&#8217;s PickGPT lets users instruct robots with natural language\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.therobotreport.com\/#website\",\"url\":\"https:\/\/www.therobotreport.com\/\",\"name\":\"The Robot Report\",\"description\":\"Robotics news, research and analysis\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.therobotreport.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.therobotreport.com\/#\/schema\/person\/b49ac8168e6f266c4fcadb923f6e94d0\",\"name\":\"Brianna Wessling\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.therobotreport.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/719a94898a1df4a988dece3c21c2050a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/719a94898a1df4a988dece3c21c2050a?s=96&d=mm&r=g\",\"caption\":\"Brianna Wessling\"},\"description\":\"Brianna Wessling is an Associate Editor, Robotics, WTWH Media. She joined WTWH Media in November 2021, and is a recent graduate from the University of Kansas. She can be reached at bwessling@wtwhmedia.com\",\"url\":\"https:\/\/www.therobotreport.com\/author\/bwessling\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Sereact's PickGPT lets users instruct robots with natural language - The Robot Report","description":"Sereact has announced PickGPT, a robotics transformer that combines large language models with the company's computer vision technology.\u00a0","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/","og_locale":"en_US","og_type":"article","og_title":"Sereact's PickGPT lets users instruct robots with natural language - The Robot Report","og_description":"Sereact has announced PickGPT, a robotics transformer that combines large language models with the company's computer vision technology.\u00a0","og_url":"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/","og_site_name":"The Robot Report","article_published_time":"2023-07-05T19:25:04+00:00","og_image":[{"width":770,"height":500,"url":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/07\/Sereact_PickGPT-featured.jpg","type":"image\/jpeg"}],"author":"Brianna Wessling","twitter_card":"summary_large_image","twitter_creator":"@therobotreport","twitter_site":"@therobotreport","twitter_misc":{"Written by":"Brianna Wessling","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/","url":"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/","name":"Sereact's PickGPT lets users instruct robots with natural language - The Robot Report","isPartOf":{"@id":"https:\/\/www.therobotreport.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/#primaryimage"},"image":{"@id":"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/#primaryimage"},"thumbnailUrl":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/07\/Sereact_PickGPT-featured.jpg","datePublished":"2023-07-05T19:25:04+00:00","dateModified":"2023-07-05T19:25:04+00:00","author":{"@id":"https:\/\/www.therobotreport.com\/#\/schema\/person\/b49ac8168e6f266c4fcadb923f6e94d0"},"description":"Sereact has announced PickGPT, a robotics transformer that combines large language models with the company's computer vision technology.\u00a0","breadcrumb":{"@id":"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/#primaryimage","url":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/07\/Sereact_PickGPT-featured.jpg","contentUrl":"https:\/\/www.therobotreport.com\/wp-content\/uploads\/2023\/07\/Sereact_PickGPT-featured.jpg","width":770,"height":500,"caption":"sereact pickGPT."},{"@type":"BreadcrumbList","@id":"https:\/\/www.therobotreport.com\/sereacts-pickgpt-lets-users-instruct-robots-with-natural-language\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.therobotreport.com\/"},{"@type":"ListItem","position":2,"name":"Sereact&#8217;s PickGPT lets users instruct robots with natural language"}]},{"@type":"WebSite","@id":"https:\/\/www.therobotreport.com\/#website","url":"https:\/\/www.therobotreport.com\/","name":"The Robot Report","description":"Robotics news, research and analysis","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.therobotreport.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.therobotreport.com\/#\/schema\/person\/b49ac8168e6f266c4fcadb923f6e94d0","name":"Brianna Wessling","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.therobotreport.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/719a94898a1df4a988dece3c21c2050a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/719a94898a1df4a988dece3c21c2050a?s=96&d=mm&r=g","caption":"Brianna Wessling"},"description":"Brianna Wessling is an Associate Editor, Robotics, WTWH Media. She joined WTWH Media in November 2021, and is a recent graduate from the University of Kansas. She can be reached at bwessling@wtwhmedia.com","url":"https:\/\/www.therobotreport.com\/author\/bwessling\/"}]}},"_links":{"self":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/posts\/566142"}],"collection":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/users\/872"}],"replies":[{"embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/comments?post=566142"}],"version-history":[{"count":0,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/posts\/566142\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/media\/566146"}],"wp:attachment":[{"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/media?parent=566142"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/categories?post=566142"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.therobotreport.com\/wp-json\/wp\/v2\/tags?post=566142"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}