Preference-Based Evaluation

Recent advances in AI have heightened attention on the foundations of evaluation. As models become more performant, traditional metrics and benchmarks increasingly fail to capture meaningful differences in system behavior. Indeed, Voorhees et al. observe that modern retrieval models have saturated h... View More