Missing Information, Unresponsive Authors, Experimental Flaws : The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP

Belz, A, Thomson, C, Reiter, E, Abercrombie, G, Alonso Moral, J M, Arvan, M, Cheung, J, Cieliebak, M, Clark, E, van Deemter, K, Dinkar, T, Dušek, O, Eger, S, Fang, Q, Gatt, A, Gkatzia, D, González Corbelle, J, Hovy, D, Hürlimann, M, Ito, T, Kelleher, J D, Klubicka, F, Lai, H, van der Lee, C, van Miltenburg, E, Li, Y, Mahamood, S, Mieskes, M, Nissim, M, Parde, N, Plátek, O, Rieser, V, Mosteiro Romero, P, Tetreault, J, Toral, A, Wang, X, Wanner, L, Watson, L & Yang, D 2023, Missing Information, Unresponsive Authors, Experimental Flaws : The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP. in S Tafreshi, A Akula, J Sedoc, A Drozd, A Rogers & A Rumshisky (eds), The Fourth Workshop on Insights from Negative Results in NLP. Association for Computational Linguistics, Dubrovnik, Croatia, pp. 1-10, Insights 2023 : The Forth Workshop on Insights from Negative Results in NLP, Dubrovnik, Croatia, 2/06/23. https://doi.org/10.18653/v1/2023.insights-1.1
workshop