2512.09665

Total: 1

#1 OxEnsemble: Fair Ensembles for Low-Data Classification [PDF] [Copy] [Kimi] [REL]

Authors: Jonathan Rystrøm, Zihao Fu, Chris Russell

We address the problem of fair classification in settings where data is scarce and unbalanced across demographic groups. Such low-data regimes are common in domains like medical imaging, where false negatives can have fatal consequences. We propose a novel approach \emph{OxEnsemble} for efficiently training ensembles and enforcing fairness in these low-data regimes. Unlike other approaches, we aggregate predictions across ensemble members, each trained to satisfy fairness constraints. By construction, \emph{OxEnsemble} is both data-efficient, carefully reusing held-out data to enforce fairness reliably, and compute-efficient, requiring little more compute than used to fine-tune or evaluate an existing model. We validate this approach with new theoretical guarantees. Experimentally, our approach yields more consistent outcomes and stronger fairness-accuracy trade-offs than existing methods across multiple challenging medical imaging classification datasets.

Subjects: Computer Vision and Pattern Recognition , Computers and Society , Machine Learning

Publish: 2025-12-10 14:08:44 UTC