S8kbmk12Oo@OpenReview

Total: 1

#1 AutoEval Done Right: Using Synthetic Data for Model Evaluation [PDF] [Copy] [Kimi] [REL]

Authors: Pierre Boyeau, Anastasios Angelopoulos, Tianle Li, Nir Yosef, Jitendra Malik, Michael Jordan

The evaluation of machine learning models using human-labeled validation data can be expensive and time-consuming. AI-labeled synthetic data can be used to decrease the number of human annotations required for this purpose in a process called autoevaluation. We suggest efficient and statistically principled algorithms for this purpose that improve sample efficiency while remaining unbiased.

Subject: ICML.2025 - Poster