{"id":578010,"date":"2024-02-28T14:30:41","date_gmt":"2024-02-28T19:30:41","guid":{"rendered":"https:\/\/www.therobotreport.com\/?p=578010"},"modified":"2024-02-28T15:21:03","modified_gmt":"2024-02-28T20:21:03","slug":"meet-electric-sheep-latest-autonomous-lawn-robot-verdie","status":"publish","type":"post","link":"https:\/\/www.therobotreport.com\/meet-electric-sheep-latest-autonomous-lawn-robot-verdie\/","title":{"rendered":"Electric Sheep Verdie robot uses large world models for autonomous landscaping"},"content":{"rendered":"
\"Electric<\/a>

Verdie uses AI to edge and trim lawns and bushes and to blow leaves. | Source: Electric Sheep<\/p><\/div>\n

Electric Sheep Robotics Inc. today launched Verdie, a new robot using its proprietary artificial intelligence and software. It said it aims to be the first large-scale outdoor maintenance company powered by AI and robotics.<\/p>\n

The San Francisco-based company<\/a> said Verdie can autonomously edge and trim lawns and bushes, as well as blow leaves. Electric Sheep added that its AI agent, ES1, enables Verdie and its RAM lawnmowing robot “to operate in any outdoor setting with zero teaching.”<\/p>\n

\u201cThe debut of our Verdie robot is the first AI robot for tasks like trimming and edging in the world of landscaping, and it\u2019s exciting to see our ES1 technology power multiple robots that can work alongside a crew without an engineer on-site setting a specific path for them,\u201d said Nag Murty, co-founder and CEO of Electric Sheep, in a release<\/a>. “We will be rolling out the Verdie to our customer sites throughout 2024 and continuing to build out this fleet of robots as autonomous agents trained on outdoor services.\u201d<\/span><\/p>\n

“Verdie is inspired by robots such as WALL-E, R2-D2 and BB-8 — moderately complex, non-humanoid agents that perform meaningful work with embodied AI,” said the company in a blog post<\/a>.<\/p>\n

ES1 operates like ChatGPT but for spatial reasoning<\/h2>\n

Verdie and RAM use AI to understand the lawns around them and efficiently care for them, said Electric Sheep. Based on recent advances in generative AI, ES1<\/a> is a learned-world model that enables reasoning and planning for both robots.<\/p>\n

To execute tasks like mowing and inventory management, ES1 needs to understand the semantics of the world, create a map that can be used for coverage planning, and highlight the edges of the workable area, the company<\/a> explained. ES1 can do all these things through dense prediction of a world state with a single model, claimed Electric Sheep.<\/p>\n

ES1 is similar to ChatGPT, but it works with spatial AI instead of language, it said. In developing its robots, Electric Sheep said it needed to give them complex, real-time reasoning that can generalize across changes in the environment.<\/p>\n

“To tackle this, we utilized two techniques: our foundation world model ES-1 and reinforcement learning (RL) in simulation,” it explained. “ES-1 provides an agent with concepts needed for outdoor work; and has been trained from our robot mowing fleet<\/a> on thousands of diverse properties.”<\/p>\n

“Given this robust representation, we can then perform RL- which teaches the agent to solve a specific new task,” said Electric Sheep. “We found that RL on top of our world model can 1) enable simulation based training of new policies such as string trimming and 2) be generalized to work on a diverse number of sites across the country.”<\/p>\n

\"Electric

ES1’s model for reinforcement learning and robot training. Source: Electric Sheep<\/p><\/div>\n

Verdie, RAM learn to handle tools <\/h2>\n

Electric Sheep also needed to enable Verdie to handle tools, so it turned to simulation<\/a>. <\/p>\n

“For a specific example of this, we consider the task of string trimming, and train a small fully-connected policy on top of the learned embeddings using RL,” said the company. “The policy takes as input time-series data via ES-1\u2019s projected embedding space, then outputs velocity commands for the motors to track at 10 hz.”<\/p>\n

“We used NVIDIA<\/a>\u2019s ISAAC simulation for all training,” it added. “The reward function was set to follow the perimeter of the property with the tool tip of the trimmer. Since our models are already designed to run on Jetson platforms, we can train the entire policy on a single desktop GPU.”<\/p>\n

Electric Sheep said it designed both of its robots to start working once they’re on a property and turned on. As a result, Verdie can start working “out of the box,” said the company.<\/p>\n

Because the robots don’t need on-site engineers to operate, they can simply be shipped to a campus, homeowners association (HOA), or park and begin tasks alongside the crew. The company credited its full-stack data channel and the large volume of data that the robots are continually trained on. <\/p>\n

Electric Sheep is currently running the ES1 agent on a fleet of 40 RAM robots in hundreds of yards across North America. It said it plans to deploy Verdie with customers in the second quarter of 2024. <\/p>\n