alt Hacker NewsI am working in Mistral robotics team. I confirm this is map-less. The only inputs are the text prompt and the front camera rgb image.
Replies
Please oh please try to make Kärcher adopt your stuff. Even their latest premium cleaning bots are hopeless when they don't know where they are, even when I tell them where they are.
Or, I don't know, make your own vacuums.
Are you interested in working with partners that are collecting training data?
So, it has to rely on exact situational step by step commands? I'm wondering how one could conceivably deploy this in a useful way. Usually you'd need to mark areas on the map and then the robot knows where to go, A* is trivial around obstacles once you have that and a lidar. And lidars are an order of magnitude cheaper than something that can run an 8B VLA.
One could maybe autogenerate these text planning commands, but it would require a map and the robot's current location, so it doesn't really solve that, unless it can find a specific thing completely on its own. How much of a planning horizon does it have?
Nice! Thanks for confirming. If the last instruction is 'go back to where you started' does it work?