2601.06336

Total: 1

#1 Future-as-Label: Scalable Supervision from Real-World Outcomes [PDF1] [Copy] [Kimi] [REL]

Authors: Benjamin Turtel, Paul Wilczewski, Danny Franklin, Kris Skothiem

Many real-world prediction problems lack labels observable at prediction time, creating a temporal gap between prediction and outcome that yields supervision only after events resolve. To address this setting, we extend reinforcement learning with verifiable rewards to temporally resolved real-world prediction, and use it to train language models to make probabilistic forecasts under causally masked information with retrospective evaluation using proper scoring rules. Supervision is derived solely from post-resolution outcomes, preserving delayed-reward semantics. On real-world forecasting benchmarks, Qwen3-32B trained using Foresight Learning improves Brier score by 27% and halves calibration error relative to its pretrained baseline, and outperforms Qwen3-235B on both constructed future-event prediction tasks and the Metaculus benchmark despite a 7x parameter disadvantage.

Subjects: Machine Learning , Artificial Intelligence

Publish: 2026-01-09 22:15:12 UTC