These robots look slow and not very fluid in their motions, but LLMs like ChatGPT also looked very dumb initially. If progress is as fast as LLMs , this could have massive applications in a few years.
The time between gpt 2 and 3 was 15 months. The time between gemini robotics 1 and 2 was also 15 months: https://blog.google/products-and-platforms/products/gemini/h...
The difference between gpt 2 and 3 was insane. 2 could generate limericks when it wasn't repeating a word 300x. 3 could actually do some things. By comparison gemini robotics has hardly changed at all.
I will also point out that slow, non-fluid robotics is on a totally different level of difficulty from fast fluid motion. Asimov could walk pretty smoothly, but it didn't fall over because it used a very careful sequence that was never unbalanced; you could pause at any point without falling over. Move faster, like boston dynamics, and you need to account for the change in balance from your arms swinging... or rather, you need to be able to account for the rotational inertia etc from moving multiple masses along complex paths with multiple points of articulation at hundreds or thousands of times per second.
An algorithm to fold tshirts 90% of the time is easy. The cloth hangs down by gravity and you can just look for right angles (corners), find their coordinates with binocular matching, and move them to meet each other. Getting 99%, or folding them quickly, so that the fabric is actually moving instead of just hanging still- incredibly, incredibly more complex.
Gotta admit google is pretty ballsy for directly attacking Moravec's Paradox: https://en.wikipedia.org/wiki/Moravec%27s_paradox
They're fluid, but they are slow, which is highly likely to be a safety thing, which will have the side effect of making many motions more difficult, not less.
LLMs aren't themselves hurting anyone, no matter how much certain people like to pretend otherwise, whereas an AI in a robot with significant motors in absolutely can and will. There are reasons industrial ones live in safety cages after all.
Expecting them to be like inverse kinematic driven digital dolls is wrong because the optimization won't be for matching that but something like "net reduce energy consumption" which for electric motors in multi joint arms will look a bit odd.
This is the first press videos I’ve seen of 1x speed that seems reasonable, imho. Though I see elsewhere they report only 50-75% success rate- not clear if that's first attempt, or total?
We don't get virtuous feedback loops in hardware though. Muscles are incredible engineering that took half a billion years. Token generation (speech) is low hundred thousands maybe. Unless of course improved AI navigates the space of ideas so well that it can give us alloys or synthetic flesh that does twitch as fast...
These robots are unusable in their current form. Slow and expensive, humans perform this work better and cheaper. Looks like every other robot before it, a bunch of servos and no brain.
> If progress is as fast as LLMs
Is this the new "x technology is a year away" ?
I believe that it's also for safety, these robots would easily destroy themselves if not restrained (and cause damage).
yes at 1k tok/sec i think these robots will be fast and very fluid.
For house keeping tasks the robotics companies love showing off... it honestly doesn't matter if it takes a robot longer than a human to clean your house. As long as it gets done before you get home from work, no big deal.