infra(eval): migrate pytrec_eval -> ir_measures - #198

Merged

SoundMindsAI merged 15 commits into

mainfrom

May 23, 2026

docs(planned): add infra_ir_measures_migration spec + plan + pipeline_status

SoundMindsAI
and
claude
committed
4ec8357
chore(deps): add ir-measures to runtime, move pytrec-eval to dev-group (Story 1.1)

SoundMindsAI
and
claude
committed
b265463
test(eval): add parity test fixture and skeleton (Story 1.2)

SoundMindsAI
and
claude
committed
5ae53de
feat(eval): rewrite scoring.py with ir_measures (Story 1.3)

SoundMindsAI
and
claude
committed
5f205e6
test(eval): activate parity test as permanent CI gate (Story 1.4)

SoundMindsAI
and
claude
committed
8c67447
test(eval): extend leakage assertions + existing-row regression (Story 1.5)

SoundMindsAI
and
claude
committed
4f14c28
feat(studies): reword INSUFFICIENT_JUDGMENT_OVERLAP error message (Story 1.6)

SoundMindsAI
and
claude
committed
2799040
infra(docker): credit ir_measures transitive backend for gcc/g++ install (Story 1.7)

SoundMindsAI
and
claude
committed
c2594c1
docs(ir-measures): sweep pytrec_eval -> ir_measures across all current-state docs (Story 1.8)

SoundMindsAI
and
claude
committed
fdd22ea

Navigation Menu