Non-Repeatable Experiments and Non-Reproducible Results : The Reproducibility Crisis in Human Evaluation in NLP

Belz, Anya; Thomson, Craig; Reiter, Ehud; Mille, Simon

Non-Repeatable Experiments and Non-Reproducible Results : The Reproducibility Crisis in Human Evaluation in NLP

Files

Belz_etal_ACL_Non-repetable_Experiments_And_VoR.pdf (213.67 KB)

Date

2023-07-01

Authors

Publisher

Association for Computational Linguistics

Citation

Belz, A, Thomson, C, Reiter, E & Mille, S 2023, Non-Repeatable Experiments and Non-Reproducible Results : The Reproducibility Crisis in Human Evaluation in NLP. in A Rogers, J Boyd-Graber & N Okazaki (eds), Findings of the Association for Computational Linguistics: ACL 2023. Association for Computational Linguistics, Toronto, Canada, pp. 3676-3687. https://doi.org/10.18653/v1/2023.findings-acl.226