Gemini 4 Argon for Robotics

I am very new to robots and recently decided to go crazy and buy a humanoid from Unitree. I've spent a while building some tools in order to integrate LLMs with vision capabilities that can control the robot motion in a simple manner... and while I saw Opus and Astra crashing against tables, beds and surfaces (yeah, my LIDAR data isn't being used yet), Argon 4 takes a lot of precautions to avoid crashing against walls and other objects! I told my robot to go to a table, and the guy started walking slowly to the table, started steering at it and described the objects in it. Pretty scary for being something I've vibecoded in a matter of hours at home...

I'm a robotics noob currently building a prototype of a snow sweeping robot (www.frost-e.com) using my own design and I'm encouraged to see similar work coming from real places. Namely:

- Zero shot control using a visual harness and action primitives. I've seen this from a few other places as well (https://tml.stanford.edu/homebody/) and it's essentially having a generalist LLM command a robot via a set of predefined actions. Many robots and many tasks can probably be done with this approach, since not everything needs super intricate 6DoF arms or dexterity

- simulation bring-ups: I have a pipeline that takes in satellite imagery and reconstructs the lots and houses in a 3D environment and snows on it so that my virtual robot can learn to clean. With these latest models, you can probably create a higher fidelity digital twin more directly.

- self-improvement: These models (Argon, Astra, etc) can't operate the robot itself, but would be able to create data to distill into smaller models you can actually utilize.

It’s mildly impressive, but Google should be wiping the floor with its competition with all the resources it has. This intelligence isn’t even as good as figure 3. Unitree robots are basically doing parkour while this thing has to be hung up by a hook.

Awesome, now only if i could get my hands two of those robotic hands and make myself my dish cleaning slave...

Can we just not throw trash on the ground in the first place?

Assuming that models continue to get 90% more efficient every 18 months, and assuming that hardware continues to get 2x more powerful per watt every 2 years...

Aren't we still like a decade away from an Argon model being able to run on battery power for any reasonable amount of time that would fit on a robot that isn't the size of a school bus?

Add on another couple of years for the speed to get to what it likely needs to be to be generally useful instead of narrowly useful?

I mean - I guess we're maybe 5-7 years away from a reasonably priced robot you could plug into the wall like an old vacuum cleaner (that runs on this type of tech).

We're going to end up with a factory to build factories that build factories... you could call one such concept factorio!

I think someone should make a game based on this concept.