logoalt Hacker News

papichulo2023today at 6:27 PM8 repliesview on HN

What does "Built for rack-scale agentic efficiency" even means?


Replies

throwa356262today at 6:47 PM

If you read past the marketing talk, this is basically a massively multicore system (136) with significantly reduced power usage (300W).

Where does Agentic come into this? ARMs explanation is that future Agentic workloads will be both CPU and GPU bound thus the need for significant CPU efficiency.

inertetoday at 6:39 PM

It's volume of tokens consumed x number of agents x rack space. Basically agentic computation density.

ray_vtoday at 6:28 PM

We just say words now that sound good for marketing but have no real meaning.

show 1 reply
thewebguydtoday at 6:44 PM

Big "but mongodb is web scale" vibes

varispeedtoday at 6:29 PM

It's a code sentence for let's go to the utility room to cross pollinate ideas.

r_leetoday at 6:32 PM

I was gonna say just big DCs in marketing yap but really wtf does that mean?

otabdeveloper4today at 6:33 PM

It's when LLM agents are inefficient that you need a whole rack of servers to get shit done.

sdwvittoday at 6:34 PM

Translation: “Can you give us some money pretty please?”