2610.00096

Total: 1

#1 FACET at WMT 2026 Automated Translation Quality Evaluation Task [PDF1] [Copy] [Kimi] [REL]

Authors: Ahrii Kim, Chanjun Park, Seong-heum Kim

Different error types in machine translation require different evidence. Whether meaning is preserved can be judged only against the source, while whether the target is well-formed, or whether it names one entity consistently, can be judged from the target alone. We present FACET, our reference-free submission to the WMT26 Automated Translation Quality Evaluation Task, which decomposes evaluation into Fluency, Accuracy, and Consistency passes and gives each pass only the context its error type requires. A single fixed model is prompted three times, and the merged error spans yield the three task outputs, error spans, quality scores, and error-free labels, with no trained components. We also submit FACET-C, which omits the Consistency pass. Without gold labels, we characterize the predictions of FACET. Its system rankings place post-edited human translation first, and the Consistency pass changes about a tenth of segment scores while leaving the ranking nearly unchanged.

Subject: Computation and Language

Publish: 2026-09-08 14:49:27 UTC