Construction Grammar + NLP Papers


1	Title	Authors	Publication Venue	Year	Categories	URL

2	A Computational Construction Grammar for English	Remi van Trijp	2017 AAAI Spring Symposium Series	2017	formal grammar framework	https://cdn.aaai.org/ocs/15348/15348-68226-1-PB.pdf
3	Distributional Semantics Meets Construction Grammar. Towards a Unified Usage-Based Model of Grammar and Meaning	Giulia Rambelli, Emmanuele Chersoni, Philippe Blache, Chu-Ren Huang, Alessandro Lenci	DMR	2019	embeddings/LLMs	https://hal.science/hal-02146537/file/DMR_workshop.pdf
4	Frequency vs. Association for Constraint Selection in Usage-Based Construction Grammar	Jonathan Dunn	CMCL Workshop 2019	2019	grammar induction	https://aclanthology.org/W19-2913/
5	Computational construction grammar for visual question answering	Jens Nevens, Paul Van Eecke, Katrien Beuls	Linguistics Vanguard	2019	formal grammar framework, application	https://www.degruyter.com/document/doi/10.1515/lingvan-2018-0070/html
6	CxGBERT: BERT meets Construction Grammar	Harish Tayyar Madabushi, Laurence Romain, Dagmar Divjak, Petar Milin	COLING	2020	embeddings/LLMs	https://aclanthology.org/2020.coling-main.355/
7	What about Grammar? Using BERT Embeddings to Explore Functional-Semantic Shifts of Semi-Lexical and Grammatical Constructions	Lauren Fonteyn	Computational Humanities Research CEUR-WS	2020	embeddings/LLMs	https://ceur-ws.org/Vol-2723/short15.pdf
8	The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative	Leonie Weissweiler, Valentin Hofmann, Abdullatif Köksal, Hinrich Schütze	EMNLP	2022	embeddings/LLMs	https://aclanthology.org/2022.emnlp-main.746.pdf
9	CxLM: A Construction and Context-aware Language Model	Yu-Hsiang Tseng, Cing-Fang Shih, Pin-Er Chen, Hsin-Yu Chou, Mao-Chang Ku, Shu-Kai Hsieh	LREC	2022	embeddings/LLMs	https://aclanthology.org/2022.lrec-1.683/
10	Neural reality of argument structure constructions	Bai Li, Zining Zhu, Guillaume Thomas, Frank Rudzicz, Yang Xu	ACL	2022	embeddings/LLMs	https://aclanthology.org/2022.acl-long.512/
11	Can Recurrent Neural Networks Validate Usage-Based Theories of Grammar Acquisition?	Ludovica Pannitto, Aurélie Herbelot	Frontiers in Psychology	2022	survey	https://www.frontiersin.org/articles/10.3389/fpsyg.2022.741321/full
12	Exposure and emergence in usage-based grammar: computational experiments in 35 languages	Jonathan Dunn	Cognitive Linguistics	2022	grammar induction	https://www.degruyter.com/document/doi/10.1515/cog-2021-0106/html
13	Using Collostructional Analysis to evaluate BERT's representations of linguistic constructions	Tim Veenboer, Jelke Bloem	ACL (findings)	2023	embeddings/LLMs	https://aclanthology.org/2023.findings-acl.819/
14	Enhancing Language Representation with Constructional Information for Natural Language Understanding	Lvxiaowei Xu, Jianwang Wu, Jiawei Peng, Zhilin Gong, Ming Cai , Tianxiang Wang	ACL	2023	embeddings/LLMs	https://aclanthology.org/2023.acl-long.258/
15	A Method for Studying Semantic Construal in Grammatical Constructions with Interpretable Contextual Embedding Spaces	Gabriella Chronis, Kyle Mahowald, Katrin Erk	ACL	2023	embeddings/LLMs	https://aclanthology.org/2023.acl-long.14/
16	A Discerning Several Thousand Judgments: GPT-3 Rates the Article + Adjective + Numeral + Noun Construction	Kyle Mahowald	EACL	2023	embeddings/LLMs	https://aclanthology.org/2023.eacl-main.20.pdf
17	Proceedings of the First International Workshop on Construction Grammars and NLP (CxGs+NLP, GURT/SyntaxFest 2023)	Editors: Claire Bonial, Harish Tayyar Madabushi	CxGs+NLP Workshop	2023	event
18	Exploring the Constructicon: Linguistic Analysis of a Computational CxG	Jonathan Dunn	CxGs+NLP Workshop	2023	grammar induction	https://aclanthology.org/2023.cxgsnlp-1.1/
19	CALaMo: a Constructionist Assessment of Language Models	Ludovica Pannitto, Aurélie Herbelot	CxGs+NLP Workshop	2023	embeddings/LLMs	https://aclanthology.org/2023.cxgsnlp-1.3/
20	High-dimensional vector spaces can accommodate constructional features quite conveniently	Jussi Karlgren	CxGs+NLP Workshop	2023	embeddings/LLMs	https://aclanthology.org/2023.cxgsnlp-1.4/
21	Fluid Construction Grammar: State of the Art and Future Outlook	Katrien Beuls, Paul Van Eecke	CxGs+NLP Workshop	2023	formal grammar framework	https://aclanthology.org/2023.cxgsnlp-1.6/
22	An Argument Structure Construction Treebank	Kristopher Kyle, Hakyung Sung	CxGs+NLP Workshop	2023	treebanking/meaning representation	https://aclanthology.org/2023.cxgsnlp-1.7/
23	UMR annotation of Chinese Verb compounds and related constructions	Haibo Sun, Yifan Zhu, Jin Zhao, Nianwen Xue	CxGs+NLP Workshop	2023	treebanking/meaning representation	https://aclanthology.org/2023.cxgsnlp-1.9/
24	Construction Grammar Provides Unique Insight into Neural Language Models	Leonie Weissweiler, Taiqi He, Naoki Otani, David R. Mortensen, Lori Levin, Hinrich Schütze	CxGs+NLP Workshop	2023	embeddings/LLMs	https://aclanthology.org/2023.cxgsnlp-1.10/
25	Modeling Construction Grammar’s Way into NLP: Insights from negative results in automatically identifying schematic clausal constructions in Brazilian Portuguese	Arthur Lorenzi, Vânia Gomes de Almeida, Ely Edison Matos, Tiago Timponi Torrent	CxGs+NLP Workshop	2023	identification	https://aclanthology.org/2023.cxgsnlp-1.11/
26	Representing constructional metaphors	Pavlina Kalm, Michael Regan, Sook-kyung Lee, Chris Peverada, William Croft	DMR	2020	treebanking/meaning representation	https://www.aclweb.org/anthology/2020.dmr-1.9
27	Automatically Tagging Constructions of Causation and Their Slot-Fillers	Jesse Dunietz, Lori Levin, Jaime Carbonell	TACL	2017	identification	https://www.transacl.org/ojs/index.php/tacl/article/view/1003
28	The BECauSE Corpus 2.0: Annotating Causality and Overlapping Relations	Jesse Dunietz, Lori Levin, Jaime Carbonell	LAW	2017	treebanking/meaning representation	http://www.aclweb.org/anthology/W17-0812
29	Evaluation Strategies for Computational Construction Grammars	Tania Marques, Katrien Beuls	COLING	2016	formal grammar framework	http://aclweb.org/anthology/C16-1108
30	Identification and Representation of Caused Motion Constructions	Jena D. Hwang	Dissertation	2014	identification, treebanking/meaning representation	http://search.proquest.com/docview/1651531389/abstract/40D96262F524B7EPQ/1?
31	Criteria for Identifying and Annotating Caused Motion Constructions in Corpus Data	Jena D. Hwang, Annie Zaenen, Martha Palmer	LREC	2014	identification, treebanking/meaning representation	http://www.lrec-conf.org/proceedings/lrec2014/pdf/624_Paper.pdf
32	Incorporating Coercive Constructions into a Verb Lexicon	Claire Bonial, Susan Windisch Brown, Jena D. Hwang, Christopher Parisien, Martha Palmer, Suzanne Stevenson	ACL	2011	treebanking/meaning representation	http://www.aclweb.org/anthology/W11-0910
33	Abstract Meaning Representation of Constructions: The More We Include, the Better the Representation	Claire Bonial, Bianca Badarau, Kira Griffitt, Ulf Hermjakob, Kevin Knight, Tim O’Gorman, Martha Palmer, Nathan Schneider	LREC	2018	treebanking/meaning representation	http://www.lrec-conf.org/proceedings/lrec2018/pdf/856.pdf
34	Neural heuristics for scaling constructional language processing	Paul Van Eecke, Jens Nevens, Katrien Beuls	Journal of Language Modeling	2022	formal grammar framework	https://jlm.ipipan.waw.pl/index.php/JLM/article/view/318
35	I’ve got a construction looks funny – representing and recovering non-standard constructions in UD	Josef Ruppenhofer, Ines Rehbein	Universal Dependencies Workshop (UDW)	2020	treebanking/meaning representation	https://aclanthology.org/2020.udw-1.16
36	Proceedings of the Joint Workshop on Linguistic Annotation, Multiword Expressions and Constructions (LAW-MWE-CxG-2018)	Editors: Agata Savary, Carlos Ramisch, Jena D. Hwang, Nathan Schneider, Melanie Andresen, Sameer Pradhan, Miriam R. L. Petruck	LAW-MWE-CxG	2018	event	https://aclanthology.org/volumes/W18-49/
37	From Chinese Word Segmentation to Extraction of Constructions: Two Sides of the Same Algorithmic Coin	Jean-Pierre Colson	LAW-MWE-CxG	2018	grammar induction	https://aclanthology.org/W18-4907/
38	Discourse and Lexicons: Lexemes, MWEs, Grammatical Constructions and Compositional Word Combinations to Signal Discourse Relations	Laurence Danlos	LAW-MWE-CxG	2018	treebanking/meaning representation	https://aclanthology.org/W18-4906/
39	Proceedings of the NAACL HLT Workshop on Extracting and Using Constructions in Computational Linguistics	Editors: Magnus Sahlgren, Ola Knutsson	Workshop on Extracting and Using Constructions in Computational Linguistics	2010	event	https://aclanthology.org/volumes/W10-08/
40	Towards a Domain Independent Semantics: Enhancing Semantic Representation with Construction Grammar	Jena D. Hwang, Rodney D. Nielsen, Martha Palmer	Workshop on Extracting and Using Constructions in Computational Linguistics	2010	treebanking/meaning representation	https://aclanthology.org/W10-0801/
41	Towards an Inventory of English Verb Argument Constructions	Matthew Brook O’Donnell, Nick Ellis	Workshop on Extracting and Using Constructions in Computational Linguistics	2010	treebanking/meaning representation	https://aclanthology.org/W10-0802/
42	Identifying Assertions in Text and Discourse: The Presentational Relative Clause Construction	Cecily Jill Duffield, Jena D. Hwang, Laura A. Michaelis	Workshop on Extracting and Using Constructions in Computational Linguistics	2010	identification	https://aclanthology.org/W10-0803/
43	StringNet as a Computational Resource for Discovering and Investigating Linguistic Constructions	David Wible, Nai-Lung Tsao	Workshop on Extracting and Using Constructions in Computational Linguistics	2010	treebanking/meaning representation	https://aclanthology.org/W10-0804/
44	Syntactic Construct : An Aid for translating English Nominal Compound into Hindi	Soma Paul, Prashant Mathur, Sushant Kishore	Workshop on Extracting and Using Constructions in Computational Linguistics	2010	application	https://aclanthology.org/W10-0805/
45	Learning Rules and Categorization Networks for Language Standardization	Gerhard B van Huyssteen, Marelie H Davel	Workshop on Extracting and Using Constructions in Computational Linguistics	2010	grammar induction	https://aclanthology.org/W10-0806/
46	Papers from the 2017 AAAI Spring Symposium, No. 2: Computational Construction Grammar and Natural Language Understanding	Editors: Luc Steels, Jerome Feldman	AAAI Symposium on Computational Construction Grammar and NLU	2017	event	https://aaai.org/proceeding/02-spring-2017/
47	Towards a Constructicon for German	Alexander Ziem, Hans C. Boas	AAAI Symposium on Computational Construction Grammar and NLU	2017	treebanking/meaning representation	https://aaai.org/papers/15327-towards-a-constructicon-for-german/
48	Constructional Analysis Using Constrained Spreading Activation in a FrameNet-Based Structured Connectionist Model	Ely Matos, Tiago Torrent, Vânia Almeida, Adrieli Laviola, Ludmila Lage, Natália Marção, Tatiane Tavares	AAAI Symposium on Computational Construction Grammar and NLU	2017	application	https://aaai.org/papers/15257-constructional-analysis-using-constrained-spreading-activation-in-a-framenet-based-structured-connectionist-model/
49	Semantically-Driven Coreference Resolution with Embodied Construction Grammar	Vivek Raghuram, Sean Trott, Kelly Shen, Ethan Goldberg, Sidney Oderberg	AAAI Symposium on Computational Construction Grammar and NLU	2017	application	https://aaai.org/papers/15337-semantically-driven-coreference-resolution-with-embodied-construction-grammar/
50	Meta-Layer Problem Solving for Computational Construction Grammar	Paul Van Eecke, Katrien Beuls	AAAI Symposium on Computational Construction Grammar and NLU	2017	formal grammar framework	https://aaai.org/papers/15270-meta-layer-problem-solving-for-computational-construction-grammar/
51	Modeling the Partial Productivity of Constructions	Libby Barak, Adele Goldberg	AAAI Symposium on Computational Construction Grammar and NLU	2017	identification	https://aaai.org/papers/15297-modeling-the-partial-productivity-of-constructions/
52	Template Construction Grammar: A Schema-Theoretic Computational Construction Grammar	Victor J. Barres	AAAI Symposium on Computational Construction Grammar and NLU	2017	formal grammar framework	https://aaai.org/papers/15361-template-construction-grammar-a-schema-theoretic-computational-construction-grammar/
53	Dynamic Construction Grammar and Steps Towards the Narrative Construction of Meaning	William Croft, Meagan Vigus	AAAI Symposium on Computational Construction Grammar and NLU	2017	treebanking/meaning representation	https://aaai.org/papers/15299-constructions-frames-and-event-structure/
54	Grammar Scaling: Leveraging FrameNet Data to Increase Embodied Construction Grammar Coverage	Ellen Kirsten Dodge, Sean Trott, Luca Gilardi, Elise Stickles	AAAI Symposium on Computational Construction Grammar and NLU	2017	identification	https://aaai.org/papers/15298-grammar-scaling-leveraging-framenet-data-to-increase-embodied-construction-grammar-coverage/
55	Processing Natural Language About Ongoing Actions in ECG	Steve Doubleday, Sean Trott, Jerome Feldman	AAAI Symposium on Computational Construction Grammar and NLU	2017	application	https://aaai.org/papers/15304-processing-natural-language-about-ongoing-actions-in-ecg/
56	Construction Detection in a Conventional NLP Pipeline	Jesse Dunietz, Lori Levin, Miriam R. L. Petruck	AAAI Symposium on Computational Construction Grammar and NLU	2017	identification, treebanking/meaning representation	https://aaai.org/papers/15288-construction-detection-in-a-conventional-nlp-pipeline/
57	The Brazilian Portuguese Constructicon: Modeling Constructional Inheritance, Frame Evocation and Constraints in FrameNet Brasil	Adrieli Laviola, Ludmila Lage, Natália Marção, Tatiane Tavares, Vãnia Almeida, Ely Matos, Tiago Torrent	AAAI Symposium on Computational Construction Grammar and NLU	2017	treebanking/meaning representation	https://aaai.org/papers/15256-the-brazilian-portuguese-constructicon-modeling-constructional-inheritance-frame-evocation-and-constraints-in-framenet-brasil/
58	“A Buster Keaton of Linguistics”: First Automated Approaches for the Extraction of Vossian Antonomasia	Michel Schwab, Robert Jäschke, Frank Fischer, Jannik Strötgen	EMNLP 2019	2019	identification	https://aclanthology.org/D19-1647.pdf
59	“The Michael Jordan of Greatness”: Extracting Vossian Antonomasia from Two Decades of the New York Times, 1987–2007∗	Frank Fischer, Robert Jäschke	Digital Scholarship in the Humanities	2019	identification	https://arxiv.org/pdf/1902.06428.pdf
60	The Acquisition and Use of Argument Structure Constructions: A Bayesian Model	Afra Alishahi, Suzanne Stevenson	Proceedings of the Workshop on Psychocomputational Models of Human Language Acquisition	2005	grammar induction	https://aclanthology.org/W05-0510/
61	(Re)construing Meaning in NLP	Sean Trott, Tiago Timponi Torrent, Nancy Chang, Nathan Schneider	ACL 2020	2020	survey	https://aclanthology.org/2020.acl-main.462/
62	“Who is the Madonna of Italian-American Literature?”: Target Entity Extraction and Analysis of Vossian Antonomasia	Michel Schwab, Robert Jäschke, Frank Fischer	SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature	2023	identification	https://aclanthology.org/2023.latechclfl-1.12/
63	Construction Grammar and Language Models	Harish Tayyar Madabushi, Laurence Romain, Petar Milin, Dagmar Divjak	The Cambridge Handbook of Construction Grammar	2024	survey	https://arxiv.org/abs/2308.13315
64	Learned Construction Grammars Converge Across Registers Given Increased Exposure	Jonathan Dunn, Harish Tayyar Madabushi	ConLL	2021	grammar induction	https://aclanthology.org/2021.conll-1.21.pdf
65	Construction Grammar and Artificial Intelligence	Katrien Beuls, Paul Van Eecke	Cambridge Handbook of Construction Grammar	2024 (to appear)	survey	https://arxiv.org/pdf/2309.00135.pdf
66	Neuro-Symbolic Procedural Semantics for Reasoning-Intensive Visual Dialogue Tasks	Lara Verheyena, Jérôme Botoko Ekilaa, Jens Nevensa, Paul Van Eeckea, Katrien Beuls	European Conference on Artificial Intelligence (ECAI)	2023	application	https://beehaif.org/assets/pdfs/verheyen2023neuro.pdf
67	Modelling Language Acquisition through Syntactico-Semantic Pattern Finding	Jonas Doumen, Katrien Beuls, Paul Van Eecke	EACL	2023	application, grammar induction	https://aclanthology.org/2023.findings-eacl.99.pdf
68	Language Acquisition through Intention Reading and Pattern Finding	Jens Nevens, Jonas Doumen, Paul Van Eecke, Katrien Beuls	COLING	2022	application, grammar induction	https://aclanthology.org/2022.coling-1.2.pdf
69	The FCG Editor: An innovative environment for engineering computational construction grammars	Remi van Trijp, Katrien Beuls, Paul Van Eecke	PLOS ONE	2022	application	https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0269708
70	A Construction Grammar Corpus of Varying Schematicity: A Dataset for the Evaluation of Abstractions in Language Models	Claire Bonial, Harish Tayyar Madabushi	LREC-COLING	2024	treebanking/meaning representation	https://aclanthology.org/2024.lrec-main.22.pdf
71	Constructions Are So Difficult That Even Large Language Models Get Them Right for the Wrong Reasons	Shijia Zhou, Leonie Weissweiler, Taiqi He, Hinrich Schütze, David R. Mortensen, Lori Levin	LREC-COLING	2024	embeddings/LLMs	https://aclanthology.org/2024.lrec-main.336/
72	Verbing Weirds Language (Models): Evaluation of English Zero-Derivation in Five LLMs	David R. Mortensen, Valentina Izrailevitch, Yunze Xiao, Hinrich Schütze, Leonie Weissweiler	LREC-COLING	2024	embeddings/LLMs	https://aclanthology.org/2024.lrec-main.1508/
73	UCxn: Typologically Informed Annotation of Constructions Atop Universal Dependencies	Leonie Weissweiler, Nina Böbel, Kirian Guiller, Santiago Herrera, Wesley Scivetti, Arthur Lorenzi, Nurit Melnik, Archna Bhatia, Hinrich Schütze, Lori Levin, Amir Zeldes, Joakim Nivre, William Croft, Nathan Schneider	LREC-COLING	2024	treebanking/meaning representation	https://aclanthology.org/2024.lrec-main.1471/
74	Hybrid Human-LLM Corpus Construction and LLM Evaluation for Rare Linguistic Phenomena	Leonie Weissweiler, Abdullatif Köksal, Hinrich Schütze	preprint	2024	embeddings/LLMs	https://arxiv.org/pdf/2403.06965
75	Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNs	Kanishka Misra, Kyle Mahowald	preprint	2024	embeddings/LLMs	https://arxiv.org/abs/2403.19827
76	Annotation Scheme for English Argument Structure Constructions Treebank	Hakyung Sung, Kristopher Kyle	LAW	2024	treebanking/meaning representation	https://aclanthology.org/2024.law-1.2.pdf
77	Usage-based constructionist approaches and Large Language Models	Adele Goldberg	Constructions and Frames	2024	survey	https://adele.scholar.princeton.edu/sites/g/files/toruqf6701/files/documents/24_Goldberg_ConstructionsandFrames_formatted.pdf


1	This is a living bibliography of publications relating Construction Grammar to Natural Language Processing.
2
3
4
5	Background reading
6	General overviews of Construction Grammar can be found in:
7		Adele E. Goldberg (2003), Constructions: A new theoretical approach to language. Trends in Cognitive Science. https://www.sciencedirect.com/science/article/abs/pii/S1364661303000809
8		Tobias Ungerer and Stefan Hartmann (2023), Constructionist approaches: past, present, future. Cambridge Elements in Construction Grammar. https://www.cambridge.org/core/elements/constructionist-approaches/4F37E9A2B97EB663F532B4068702055C
9
10	Inclusion criteria
11	Focus is on work that
12	1) explicitly invokes a Construction Grammar perspective
13	2) is oriented towards NLP & corpora—which is to say, conducive to building or examining robust computational implementations
14	Criterion (2) excludes lots of theoretical linguistics, corpus linguistics, and psycholinguistics work in the CxG literature.
15	Not included at present: additional literature on constructicography, and on smaller-scale studies with formal grammar implementations.
16	There is an extensive literature on NLP approaches to multiword expressions such as light verb constructions and verb-particle constructions—these are not listed here, but see https://multiword.org/.
17
18	Categories (column E)
19	embeddings/LLMs - studies of the constructional "knowledge" of large language models, distributional factors in constructions
20	formal grammar framework - studies involving implementation of a computational formalism like FCG or ECG
21	grammar induction - algorithmically extracting constructional patterns from corpora (focus on type-level description/generalization)
22	identification - algorithmically finding instances of known constructions (focus on token-level description/disambiguation)
23	treebanking/meaning representation - approaches to human annotation of form/meaning in corpora (outside of a formal grammar framework)
24	application - use of constructions for some downstream task
25	survey
26	event
27
28	Contributors
29	Wesley Scivetti	Georgetown University
30	Nathan Schneider	Georgetown University
31
32	Status
33	63 papers as of 2023-08-30
34