Total: 1
Human oversight requirements are a core component of the European AI Act and in AI governance. In this paper, we highlight key challenges in testing for compliance with these requirements. A key difficulty lies in balancing simple, but potentially ineffective checklist-based approaches with resource-intensive empirical testing in diverse contexts where humans oversee AI systems. Additionally, the absence of easily operationalizable standards and the context-dependent nature of human oversight further complicate compliance testing. We argue that these challenges illustrate broader challenges in the future of sociotechnical AI governance.