Bill E. Johnson

Beyond Reference-Based Evaluation: Reward Models for Meta-Evaluation of Grammatical Error Correction

Reference-based metrics for Grammatical Error Correction (GEC) such as M$^2$ and ERRANT assume that the reference set enumerates all valid edits, and therefore often penalize corrections that are grammatical and meaning-preserving but phrased differently. We introduce RM-EVAL, a reward model trained on human preference …