University of Aberdeen logo

AURA - Aberdeen University Research Archive

 

Missing Information, Unresponsive Authors, Experimental Flaws : The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP

dc.contributor.authorBelz, Anya
dc.contributor.authorThomson, Craig
dc.contributor.authorReiter, Ehud
dc.contributor.authorAbercrombie, Gavin
dc.contributor.authorAlonso Moral, Jose M.
dc.contributor.authorArvan, Mohammad
dc.contributor.authorCheung, Jackie
dc.contributor.authorCieliebak, Mark
dc.contributor.authorClark, Elizabeth
dc.contributor.authorvan Deemter, Kees
dc.contributor.authorDinkar, Tanvi
dc.contributor.authorDušek, Ondřej
dc.contributor.authorEger, Steffen
dc.contributor.authorFang, Qixiang
dc.contributor.authorGatt, Albert
dc.contributor.authorGkatzia, Dimitra
dc.contributor.authorGonzález Corbelle, Javier
dc.contributor.authorHovy, Dirk
dc.contributor.authorHürlimann, Manuela
dc.contributor.authorIto, Takumi
dc.contributor.authorKelleher, John D.
dc.contributor.authorKlubicka, Filip
dc.contributor.authorLai, Huiyuan
dc.contributor.authorvan der Lee, Chris
dc.contributor.authorvan Miltenburg, Emiel
dc.contributor.authorLi, Yiru
dc.contributor.authorMahamood, Saad
dc.contributor.authorMieskes, Margot
dc.contributor.authorNissim, Malvina
dc.contributor.authorParde, Natalie
dc.contributor.authorPlátek, Ondrej
dc.contributor.authorRieser, Verena
dc.contributor.authorMosteiro Romero, Pablo
dc.contributor.authorTetreault, Joel
dc.contributor.authorToral, Antonio
dc.contributor.authorWang, Xiaojun
dc.contributor.authorWanner, Leo
dc.contributor.authorWatson, Lewis
dc.contributor.authorYang, Diyi
dc.contributor.editorTafreshi, Shabnam
dc.contributor.editorAkula, Arjun
dc.contributor.editorSedoc, João
dc.contributor.editorDrozd, Aleksandr
dc.contributor.editorRogers, Anna
dc.contributor.editorRumshisky, Anna
dc.contributor.institutionUniversity of Aberdeen.Computing Scienceen
dc.contributor.institutionUniversity of Aberdeen.Computational Linguistics at Aberdeenen
dc.date.accessioned2023-09-29T10:13:01Z
dc.date.available2023-09-29T10:13:01Z
dc.date.issued2023-05-01
dc.format.extent10
dc.format.extent188287
dc.identifier281575532
dc.identifier7c179fec-3586-49f3-8b0d-af7f357d1ffc
dc.identifier85184667620
dc.identifier.citationBelz, A, Thomson, C, Reiter, E, Abercrombie, G, Alonso Moral, J M, Arvan, M, Cheung, J, Cieliebak, M, Clark, E, van Deemter, K, Dinkar, T, Dušek, O, Eger, S, Fang, Q, Gatt, A, Gkatzia, D, González Corbelle, J, Hovy, D, Hürlimann, M, Ito, T, Kelleher, J D, Klubicka, F, Lai, H, van der Lee, C, van Miltenburg, E, Li, Y, Mahamood, S, Mieskes, M, Nissim, M, Parde, N, Plátek, O, Rieser, V, Mosteiro Romero, P, Tetreault, J, Toral, A, Wang, X, Wanner, L, Watson, L & Yang, D 2023, Missing Information, Unresponsive Authors, Experimental Flaws : The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP. in S Tafreshi, A Akula, J Sedoc, A Drozd, A Rogers & A Rumshisky (eds), The Fourth Workshop on Insights from Negative Results in NLP. Association for Computational Linguistics, Dubrovnik, Croatia, pp. 1-10, Insights 2023 : The Forth Workshop on Insights from Negative Results in NLP, Dubrovnik, Croatia, 2/06/23. https://doi.org/10.18653/v1/2023.insights-1.1en
dc.identifier.citationworkshopen
dc.identifier.doi10.18653/v1/2023.insights-1.1
dc.identifier.otherBibtex: belz-etal-2023-missing
dc.identifier.otherORCID: /0000-0002-7548-9504/work/143414306
dc.identifier.urihttps://hdl.handle.net/2164/21801
dc.language.isoeng
dc.publisherAssociation for Computational Linguistics
dc.relation.ispartofThe Fourth Workshop on Insights from Negative Results in NLPen
dc.subjectSubstantive connection via eligible employment contracten
dc.subjectQA75 Electronic computers. Computer scienceen
dc.subject.lccQA75en
dc.titleMissing Information, Unresponsive Authors, Experimental Flaws : The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLPen
dc.typeConference itemen

Files

Original bundle

Now showing 1 - 1 of 1
Thumbnail Image
Name:
Belz_etal_ACL_Missing_Information_Unresposive_VoR.pdf
Size:
183.87 KB
Format:
Adobe Portable Document Format

Collections