Tabular foundation models are one of those things where when you first look into it, it does not make sense as to why they would work so well but it does.
In drug property prediction domain, tabular foundation models coupled with another foundation model for molecules are pretty close to being the state of art.
Btw the article makes heavy use of AI or is written in that way A lot of unnecessary dramatic flair that gets very tiring
True.
Why "Every number is a measured one" and not "every parameter is measured?"
Stopped reading at that point.
LLMs are like autotune. Imagine the Rolling Stones auto-tuned.
I would love to point them at my old time series prediction problems to see their ability. I was very proud of my lightgbm back then, performing miracles after a heck of a lot fearure engineering.