A taxonomy and review of generalization research in NLP

Hupkes, DieuwkeGiulianelli, MarioDankers, VernaArtetxe, MikelElazar, YanaiPimentel, TiagoChristodoulopoulos, ChristosLasri, KarimSaphra, NaomiSinclair, ArabellaUlmer, DennisSchottmann, FlorianBatsuren, KhuyagbaatarSun, KaiserSinha, KoustuvKhalatbari, LeilaRyskina, MariaFrieske, RitaCotterell, RyanJin, Zhijing2023-11-092023-11-092023-10-19Hupkes, D, Giulianelli, M, Dankers, V, Artetxe, M, Elazar, Y, Pimentel, T, Christodoulopoulos, C, Lasri, K, Saphra, N, Sinclair, A, Ulmer, D, Schottmann, F, Batsuren, K, Sun, K, Sinha, K, Khalatbari, L, Ryskina, M, Frieske, R, Cotterell, R & Jin, Z 2023, 'A taxonomy and review of generalization research in NLP', Nature Machine Intelligence, vol. 5, no. 10, pp. 1161-1174. https://doi.org/10.1038/s42256-023-00729-y2522-5839https://hdl.handle.net/2164/22147Funding Information: We thank A. Williams, A. Joulin, E. Bruni, L. Weber, R. Kirk and S. Riedel for providing feedback on the various stages of this paper, and G. Marcus for providing detailed feedback on the final draft. We also thank the reviewers of our work for providing useful comments. We thank E. Hupkes for making the app that allows searching through references, and we thank D. Haziza and E. Takmaz for other contributions to the website. M.G. was supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement no. 819455). V.D. was supported by the UKRI Centre for Doctoral Training in Natural Language Processing, funded by the UKRI (grant no. EP/S022481/1) and the University of Edinburgh. N.S. was supported by the Hyundai Motor Company (under the project Uncertainty in Neural Sequence Modeling) and the Samsung Advanced Institute of Technology (under the project Next Generation Deep Learning: From Pattern Recognition to AI). Publisher Copyright: © 2023, The Author(s).142157253engQA75 Electronic computers. Computer scienceP Philology. LinguisticsSoftwareHuman-Computer InteractionComputer Vision and Pattern RecognitionComputer Networks and CommunicationsArtificial IntelligenceSupplementary DataSupplementary InformationQA75P1A taxonomy and review of generalization research in NLPJournal article10.1038/s42256-023-00729-yhttps://www.scopus.com/pages/publications/85174518288