Jul 24, 2026
Tabular LLMs Now Out-Predict Gradient-Boosted Trees
A new class of foundation models treats tabular data the way LLMs treat text — predicting missing columns zero-shot, no training required. On the TabArena benchmark, the best of them now outperform fully tuned XGBoost. Here's what's driving the shift and where the old guard still holds.