University of Aberdeen logo

AURA - Aberdeen University Research Archive

 

Evaluating factual accuracy in complex data-to-text

dc.contributor.authorThomson, Craig
dc.contributor.authorReiter, Ehud
dc.contributor.authorSundararajan, Barkavi
dc.contributor.institutionUniversity of Aberdeen.Computing Scienceen
dc.contributor.institutionUniversity of Aberdeen.Computational Linguistics at Aberdeenen
dc.contributor.institutionUniversity of Aberdeen.Centre for Health Data Scienceen
dc.contributor.institutionUniversity of Aberdeen.Natural & Computing Sciencesen
dc.date.accessioned2024-01-05T00:14:59Z
dc.date.available2024-01-05T00:14:59Z
dc.date.embargoedUntil2024-01-05
dc.date.issued2023-05-01
dc.descriptionWe are very grateful for the hard work of the Mechanical Turk annotators who did excellent work and provided helpful feedback. We would like to thank all of the participants in the shared task, the combination of their hard work and diverse approaches has been essential to furthering understanding of the factual accuracy problem in NLG. We would also like to thank Sam Wiseman, Ratish Puduppully, and Clément Rebuffel for providing outputs from their respective systems. The constructive and insightful feedback from the two anonymous reviewers was very helpful and we greatly appreciate their input. We would also like to thank Anya Belz for checking the German translation, as well as Moray Greig, our basketball domain expert. Finally, we would like to thank members of the Aberdeen CLAN group for their advice and feedback. Craig Thomson’s work on this project was supported under an EPSRC NPIF studentship grant (EP/R512412/1).en
dc.description.statusPeer revieweden
dc.format.extent20
dc.format.extent828009
dc.identifier225283172
dc.identifier214727c6-d0bc-4255-8010-a8e11333439e
dc.identifier85147018511
dc.identifier.citationThomson, C, Reiter, E & Sundararajan, B 2023, 'Evaluating factual accuracy in complex data-to-text', Computer Speech & Language, vol. 80, 101482. https://doi.org/10.1016/j.csl.2023.101482en
dc.identifier.doi10.1016/j.csl.2023.101482
dc.identifier.issn0885-2308
dc.identifier.otherRIS: urn:41BBD7453DE068D7A6FCAB2791693188
dc.identifier.otherORCID: /0000-0002-7548-9504/work/126283888
dc.identifier.urihttps://hdl.handle.net/2164/22498
dc.identifier.urlhttps://www.sciencedirect.com/science/article/pii/S0885230823000013en
dc.identifier.vol80en
dc.language.isoeng
dc.relation.ispartofComputer Speech & Languageen
dc.subjectNatural Language Generationen
dc.subjectComplex data-to-texten
dc.subjectEvaluationen
dc.subjectAnnotationen
dc.subjectFactual accuracyen
dc.subjectNeural data-to-texten
dc.subjectQA75 Electronic computers. Computer scienceen
dc.subjectEngineering and Physical Sciences Research Council (EPSRC)en
dc.subjectEP/R512412/1en
dc.subject.lccQA75en
dc.titleEvaluating factual accuracy in complex data-to-texten
dc.typeJournal articleen

Files

Original bundle

Now showing 1 - 1 of 1
Thumbnail Image
Name:
Thomson_etal_CSL_Evaluating_factual_accuracy_AAM.pdf
Size:
808.6 KB
Format:
Adobe Portable Document Format

Collections