LLM News

Researchers have identified and solved a critical scaling problem in LLM-based theorem prediction called Structural Drift, where in-context learning performance collapses as reasoning depth increases. Using Theorem Precedence Graphs to encode topological dependencies, they achieved 89.29% accuracy on the FormalGeo7k benchmark—matching state-of-the-art supervised approaches without any gradient-based training.

Researchers have developed RDB-PFN, the first foundation model designed specifically for relational databases, trained entirely on synthetic data to overcome the scarcity of high-quality private databases. Pre-trained on over 2 million synthetic relational and single-table tasks, the model achieves few-shot performance on 19 real-world relational prediction tasks while outperforming existing graph-based and single-table baselines.