> Foot down, get to 10 trillion parameters, see if the scaling holds, if so off to 100 trillion parameters
Moore's law: Computing power is multiplied by 10 every 6 months? Can't wait for the optimization and rationalization phase, where we'll recover a trillionth of that power to run powerful databases.