Computational Models of Language Change


1		LINGUIST 289: Topics in Computational Linguistics: Computational Models of Language Change
2		Spring 2016
3	Dan Jurafsky
4	Tuesdays 4:30-6:30, Greenberg Room
5	Topics in computational models of language change, with a focus on semantics. Vector semantic models of change in word meaning and word sentiment, rates of lexical innovation, computational models of syntactic and morphological change and sound change, and models of language evolution like the interated learning paradigm.			s
6	Prerequisites: LINGUIST 288, LINGUIST 232A, LINGUIST 250, and either LINGUIST 205A or 210A, plus at least one course in historical linguistics. Or consent of instructor
7
8		Superset of papers in each week, selection to be made a week in advance, boldfaced
9				Food
10	Week 2: April 5	Types and Directions of Change: Subjectification, Metaphor, Inflation, Bleaching, Jespersen's Cycle	Everyone read Traugott+Dasher and choose 1 of the others. Naomi, James, and Reuben in charge today
11	Naomi	Traugott, Elizabeth C. & Richard B. Dasher. 2002. Chapter 2, "Prior and Current Work", from Regularity in Semantic Change. Cambridge: Cambridge University Press.	Find it on searchworks. See if this link works:
12	James	Dahl, Östen. 2001. Inflationary effects in language and elsewhere. In Joan Bybee & Paul Hopper (eds.), Frequency and the emergence of linguistic structure, vol. 2, 471–80. Amsterdam: John Benjamins.	http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.31.911&rep=rep1&type=pdf
13	James	Kiparsky, Paul & Cleo Condoravdi. 2006. Tracking Jespersen's cycle. In M. Janse, B.D. Joseph & A. Ralli (eds.), The 2nd international conference of Modern Greek dialects and linguistic theory, 172-197. Mytilene: Doukas	http://web.stanford.edu/~kiparsky/Papers/lesvosnegation.pdf
14	Reuben	Yang Xu, Terry Regier, and Barbara C. Malt. 2015. Historical Semantic Chaining and Efficient Communication: The Case of Container Names. Cognitive Science.	http://linguistics.berkeley.edu/~yangxu/xu_regier_malt_2015_historicalchaining_preprint.pdf
15		Extra papers:
16		Traugott, Elizabeth. 1989. On the rise of epistemic meanings in English: An example of subjectification in semantic change. Language 65(1). 31–55.	http://www.jstor.org/stable/414841
17		Sweetser, Eve. 1991. Chapter 2 "Semantic Change" of From etymology to pragmatics: Metaphorical and cultural aspects of semantic structure. Vol. 54. Cambridge University Press
18		George Kingsley Zipf. 1945. The meaning-frequency relationship of words. The Journal of General Psychology, 33(2):251–256.
19		Bodo Winter, Graham Thompson, and Matthias Urban. 2014. Cognitive Factors Motivating The Evolution Of Word Meanings: Evidence From Corpora, Behavioral Data And Encyclopedic Network Structure. In Evolution of Language: Proceedings of the 10th International Conference (EVOLANG10), pages 353–360.
20		Elly van Gelderen. 2011. The Linguistic Cycle: Language Change and the Language Faculty.	https://global.oup.com/academic/product/the-linguistic-cycle-9780199756049?cc=us&lang=en&
21
22	Week 3: April 16	Social Aspects of Change: Variation, Networks, Community, etc NOTE THE CHANGED DATE: THURSDAY NOT TUESDAY	Will + Rob (Food: Sarah)	Food: Sara
23	Will (networks)/Rob (incrementation)	Labov, William. 2001. Section 10.4 “Social Networks” pages 356-363, and Chapter 14 “Incrementation [the curvilinear hypothesis]” pages 446-465, from Principles of linguistic change, vol. 2: Social factors. Oxford: Blackwell.	http://web.stanford.edu/class/linguist289/labovreadings.pdf
24	Will	Centola, D. and A. Baronchelli. The spontaneous emergence of conventions: An experimental study of cultural evolution. PNAS, 2015.	http://ndg.asc.upenn.edu/files/Centola-Baronchelli-2015-PNAS.pdf
25	Rob	Eckert, P. (2012). Three waves of variation study: The emergence of meaning in the study of sociolinguistic variation. Annual review of Anthropology, 41, 87-100.	http://web.stanford.edu/~eckert/PDF/ThreeWaves.pdf
26		Uriel Weinreich, William Labov, and Marvin I. Herzog. 1968. Empirical Foundations for a Theory of Language Change	http://www.utexas.edu/cola/centers/lrc/books/hist05.html
27		Labov, William. 2007. Transmission and diffusion. Language 83.344-87.	http://muse.jhu.edu/content/article_reflink/journals/language/v083/83.2labov.pdf
28		Tagliamonte, Sali A., and Alexandra D'Arcy. 2009. "Peaks beyond phonology: Adolescence, incrementation, and language change." Language 85.1 (2009): 58-108.	http://muse.jhu.edu/journals/language/v085/85.1.tagliamonte.html
29		Lu, Q., Korniss, G., & Szymanski, B. K. (2009). The Naming Game in social networks: community formation and consensus engineering. Journal of Economic Interaction and Coordination, 4(2), 221–235. doi:10.1007/s11403-009-0057-7 or	http://link.springer.com/content/pdf/10.1007%2Fs11403-009-0057-7.pdf
30		A model of grassroots changes in linguistic systems Pierrehumbert, J. B., Stonedahl, F. and Daland, R. (2014)	http://arxiv.org/pdf/1408.1985v1.pdf
31		Danescu-Niculescu-Mizil, Cristian, et al. "No country for old members: User lifecycle and linguistic change in online communities." Proceedings of the 22nd international conference on World Wide Web. International World Wide Web Conferences Steering Committee, 2013.	http://www.mpi-sws.org/~cristian/Linguistic_change.html
32
33
34	Week 4: April 19	Vector semantics for word sense change (+ new sense detection)	James, Delenn + Allen (+Will on his paper?)	Food: Simon
35	James	A Computational Evaluation of Two Laws of Semantic Change Yang Xu and Charles Kemp	http://www.linguistics.berkeley.edu/~yangxu/xu_kemp_2015_parallelchange.pdf
36	Will	Will Hamilton, Jure Leskovec, and Dan Jurafsky. 2016ms. Diachronic Word Embeddings Reveal Laws of Semantic Change	http://arxiv.org/pdf/1605.09096v1.pdf
37	Allen	Lea Frermann and Mirella Lapata. 2016. A Bayesian Model of Diachronic Meaning Change. TACL	http://aclweb.org/anthology/Q/Q16/Q16-1003.pdf
38	Delenn	Adam Jatowt and Kevin Duh. 2014. A framework for analyzing semantic change of words across time. In Proc. 14th ACM/IEEE-CS Conf. on Digital Libraries, 229–238. IEEE Press	http://cs.jhu.edu/~kevinduh/papers/jatowt14change.pdf
39
40		Extra papers:
41		Sagi, E., Kaufmann, S. & Clark, B. Tracing semantic change with latent semantic analysis. Current Methods in Historical Semantics 73, 161 (2011).	http://homepages.uconn.edu/~stk12004/Papers/SagiKaufmannClark_MoutonLSA_revision_vE4.pdf
42		Eyal Sagi. Nouns are more stable than Verbs: Patterns of semantic change in 19th century English.	https://mindmodeling.org/cogsci2010/papers/0217/paper0217.pdf	http://www.ermon.net/sites/default/files/biblio/Sagi-CogSci2010-RelativeChangeInNounsAndVerbs.pdf
43		Temporal Analysis of Language through Neural Language Models Yoon Kim∗ Yi-I Chiu∗ Kentaro Hanaki∗ Darshan Hegde∗ Slav Petrov⋄	https://www.aclweb.org/anthology/W/W14/W14-2517.pdf
44		A distributional similarity approach to the detection of semantic change in the Google Books Ngram corpus. Kristina Gulordava, Marco Baroni	http://clic.cimec.unitn.it/marco/publications/gems-11/gulordava-baroni-gems-2011.pdf
45		Mihalcea, Rada, and Vivi Nastase. "Word epoch disambiguation: Finding how words change over time." ACL 2012	http://www.aclweb.org/anthology/P12-2051
46		Steyvers, M. & Tenenbaum, J. B. The Large-scale structure of semantic networks: Statistical analyses and a model of semantic growth. Cognitive science 29, 41–78 (2005).
47		Vivek Kulkarni, Rami Al-Rfou, Bryan Perozzi, and Steven Skiena. 2014. Statistically significant detection of linguistic change. Proc. 24th WWW Conf., 625–635.
48		Derry Tanti Wijaya and Reyyan Yeniterzi. 2011. Understanding semantic change of words over centuries. In Proceedings of the 2011 International Workshop on Detecting and Exploiting Cultural Diversity on the Social Web, pages 35–40. ACM
49		Automatically identifying changes in the semantic orientation of words. Paul Cook, Suzanne Stevenson	http://www.cs.toronto.edu/~pcook/CookStevenson2010.pdf
50		Temporal Patterns of Happiness and Information in a Global Social Network: Hedonometrics and Twitter. Peter Sheridan Dodds, Kameron Decker Harris, Isabel M. Kloumann, Catherine A. Bliss, Christopher M. Danforth	http://www.uvm.edu/~pdodds/research/papers/files/2011/dodds2011e.pdf
51		Schulz, Muriel R. (1975). The semantic derogation of women. In Barrie Thorne & Nancy Henley (eds.), Language and sex: Difference and dominance. Rowley, MA: Newbury House, 64—75.
52		Cook, Paul, Jey Han Lau, Diana McCarthy, and Timothy Baldwin. 2014. Novel Word-sense Identification. COLING. Dublin. 1624– 1635
53		Lau, Han Jey, Paul Cook, Diana McCarthy, Spandana Gella, and Timothy Baldwin. 2014. Learning Word Sense Distributions, Detecting Unattested Senses and Identifying Novel Senses using Topic Models. Proceedings of ACL. Baltimore. 259–270
54		Mitra, Sunny, Ritwik Mitra, Suman Kalyan Maity, Martin Riedl, Chris Biemann, Pawan Goyal, and Animesh Mukherjee. 2015. An automatic approach to identify word sense changes in text media across timescales. Natural Language Engineering 21:773–798.
55		Mitra, Sunny, Ritwik Mitra, Martin Riedl, Chris Biemann, Animesh Mukherjee, and Pawan Goyal. 2014. That’s sick dude!: Automatic identification of word sense change across different timescales. Proceedings of ACL. Baltimore. 1020–1029
56		Popescu, Octavian and Carlo Strapparava. 2015. SemEval 2015, Task 7: Diachronic Text Evaluation. In Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015). Denver, CO, USA, pages 869–877
57
58
59	Week 5: April 26	Sound change	Simon + Alex	Food: Ciyang
60	Alex	Hay, J.B., Pierrehumbert, J.B., Walker, A. J. and LaShell, P. (2015) Tracking word frequency effects through 130 years of sound change, Cognition 139, 83-91.	http://www.sciencedirect.com/science/article/pii/S001002771500044X
61	Alex	How Rhoticity became /r/-sandhi. Hay & Sudbury (2005)	http://muse.jhu.edu/journals/language/v081/81.4hay.pdf
62	Simon	Wedel, A., Jackson, S., & Kaplan, A. (2013). Functional load and the lexicon: Evidence that syntactic category and frequency relationships in minimal lemma pairs predict the loss of phoneme contrasts in language change. Language and Speech, 56, 395–417.	http://las.sagepub.com/content/early/2013/07/01/0023830913489096.full.pdf+html
63	Simon	Alexandre Bouchard-Côté, David Hall, Thomas L. Griffiths, and Dan Klein. 2013. Automated reconstruction of ancient languages using probabilistic models of sound change. PNAS	http://www.pnas.org/content/110/11/4224.full
64		Wedel, A. (2012). Lexical contrast maintenance and the development of sublexical contrast systems. Language and Cognition, 4(4), 319–355.	http://dingo.sbs.arizona.edu/~wedel/publications/PDF/LexicalContrast_Wedel.pdf
65
66
67	Week 6: May 3	Phylogenetic models	Ignacio + Reuben	Food: Ignacio + Reuben
68	Ignacio	MacMahon and MacMahon Chapters 1 and 2
69	Ignacio	Quentin D. Atkinson and Russell D. Gray. 2008. How old is the Indo-European Language Family? Illumination or More Moths to the Flame?
70	Reuben	Annemarie Verkerk. Where do all the motion verbs come from? The speed of development of manner verbs and path verbs in Indo-European. Diachronica 32 (2015), 69-104	http://www.evolution.reading.ac.uk/~tb904576/diachronica_03ver_preprint.pdf
71		extra papers:
72		Chang, Cathcart, Hall, Garrett. 2015. Ancestry-constrained Phylogenetic Analysis Supports the Indo-European Steppe Hypothesis. Language	http://www.linguisticsociety.org/sites/default/files/news/ChangEtAlPreprint.pdf
73		Gray, Russell D., and Quentin D. Atkinson. 2003. Language-tree divergemce times support the Anatolian theory of Indo-European origin. Nature 426.435–39	http://www.nature.com/nature/journal/v426/n6965/abs/nature02029.html
74
75		Daumé H III, Campbell L (2007) A Bayesian model for discovering typological implications. Assoc Comput Linguist 45:65–72
76		Non-Parametric Bayesian Areal Linguistics, Hal Daume ́ III	http://www.umiacs.umd.edu/~hal/docs/daume09areal.pdf
77		High-definition phonotactics reflect linguistic pasts	https://figshare.com/s/c64b7b3ba91cfeaab6b8
78
79
80
81	Week 7: May 10	Language as Evidence for Historical Change in Culture	Austin +Sara	Food: Robert
82	Sara	The civilizing process in London’s Old Bailey Sara Klingenstein, Tim Hitchcock, and Simon DeDeo	http://www.pnas.org/content/111/26/9419.abstract
83		Quantitative analysis of culture using millions of digitized books. Michel et al.	http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3279742/
84	Austin	Akpinar, Ezgi, and Jonah Berger. "Drivers of cultural success: The case of sensory metaphors." Journal of personality and social psychology 109, no. 1 (2015): 20.	http://psycnet.apa.org/psycinfo/2015-23900-001/
85	Austin	Youn et al. (2016) "On the universal structure of human lexical semantics." PNAS 113(7)	http://www.pnas.org/content/113/7/1766
86		extra papers:
87		Lexical shifts, substantive changes, and continuity in State of the Union discourse, 1790–2014. Alix Rule, Jean-Philippe Cointet, and Peter S. Bearman. PNAS vol. 112 no. 35. 10837–10844,	https://www.pnas.org/content/112/35/10837.full
88
89	Week 8: May 17	Iterated Learning/Game Theoretic Models	George, Ciyang, Robert	Food: Naomi
90	Robert	Jon W. Carr, Kenny Smith, Hannah Cornish, Simon Kirby. 2016. The Cultural Evolution of Structured Languages in an Open-Ended, Continuous World Cognitive Science (2016) 1-32.	http://onlinelibrary.wiley.com/doi/10.1111/cogs.12371/epdf
91	Ciyang	Words as alleles: connecting language evolution with Bayesian learners to models of genetic drift . Florencia Reali, Thomas L. Griffiths. 2010: Proc Roy Soc B	http://rspb.royalsocietypublishing.org/content/royprsb/277/1680/429.full.pdf
92	George	What is a universal? On the explanatory potential of evolutionary game theory in linguistics. Gerhard Jager	http://www.sfs.uni-tuebingen.de/~gjaeger/publications/lenlsSpringer.pdf
93		Kirby, S., Cornish, H., & Smith, K. (2008). Cumulative cultural evolution in the laboratory: an experimental approach to the origins of structure in human language. Proceedings of the National Academy of Sciences of the United States of America, 105(31), 10681–10686.	http://www.pnas.org/content/early/2008/07/29/0707835105.full.pdf
94		Kirby, S., Tamariz, M., Cornish, H., & Smith, K. (2015). Compression and Communication in the Cultural Evolution of Linguistic Structure. Cognition, 141, 87–102.	http://www.sciencedirect.com/science/article/pii/S0010027715000815
95		Silvey, C., Kirby, S., & Smith, K. (2015). Word Meanings Evolve to Selectively Preserve Distinctions on Salient Dimensions. Cognitive Science, 39, 212–226. doi:10.1111/cogs.12150	http://onlinelibrary.wiley.com/doi/10.1111/cogs.12150/pdf
96		Yanovich I. (2016). Genetic Drift Explains Sapir's ``drift'' In Semantic Change. In S.G. Roberts, C. Cuskley, L. McCrohon, L. Barceló-Coblijn, O. Fehér & T. Verhoef (eds.) The Evolution of Language: Proceedings of the 11th International Conference (EVOLANG11).	http://evolang.org/neworleans/papers/24.html
97		Deo, A. (2015). The semantic and pragmatic underpinnings of grammaticalization paths: The progressive to imperfective shift. Semantics and Pragmatics.
98		Ahern, C. & R. Clark (2014). Diachronic Processes in Language as Signaling Under Conflicting Interests. In: E.A. Cartmill, S. Roberts, H. Lyn, H. Cornish (eds.), Proceedings of the 10th International Conference on the Evolution of Language (Evolang X), pages 25–32.
99		Enke, D., R. Mühlenbernd & I. Yanovich (2016). The Emergence of the Progressive to Imperfective Diachronic Cycle in Reinforcement-learning Agents. In: S.G. Roberts, C. Cuskley, L. McCrohon, L. Barcel´o-Coblijn, O. Feher & T. Verhoef (eds.), The Evolution of Language: Proceedings of the 11th International Conference on the Evolution of Language (Evolang XI), Article 191.
100
101
102	Week 10: May 31	Computational Models of Syntactic/Morphological Change	Branden, Jason	Food: Austin
103		Lieberman, E., Michel, J.-B., Jackson, J., Tang, T. & Nowak, M. A. Quantifying the evolutionary dynamics of language. Nature 449, 713–716 (2007).	http://www.nature.com/nature/journal/v449/n7163/abs/nature06137.html
104		Tabor, W. 1994. Syntactic Innovation: A Connectionist Model. Stanford PhD DIssertation. Chapter 5 "Reanalaysis-anticipatory Frequency Change (Q-Divergence)"	linguist289.stanford.edu/taborthesischapter5.pdf
105
106		Extra reading:
107		Tabor, W. 1994. Syntactic Innovation: A Connectionist Model. Stanford PhD DIssertation. [It's over 100 Mbytes, don't download over slow connection]	linguist289.stanford.edu/tabor.thesis.2up.pdf
108		Tabor, W. (1995) Lexical Change as Nonlinear Interpolation. In Proceedings of the 17th Annual Cognitive Science Conference. J. D. Moore and J. F. Lehman, eds. Hillsdale, NJ: Lawrence Erlbaum Associates. (6 pages)	http://www.sp.uconn.edu/~ps300vc/Papers/lcasni.pdf
109		Tabor, Whitney (1993) `The gradual development of degree modifier sort of and kind of: a corpus proximity model'. Papers from the th Regional Meeting of the Chicago Linguistic Society 29: 451-65.
110		The gradualness of syntactic change: A corpus proximity model
111		Continuity in language change: implications for a theory of grammar	http://www.sp.uconn.edu/~ps300vc/Papers/cinlc.pdf
112		Tabor, W., Kuperman, V., & Kukona, A. (2011, March). On the nature of syntactic categories: a corpus study of "kind of" in American English. CUNY conference.	http://psychology.uconn.edu/labs/solab/papers/taborCUNY2011revised.pdf
113		Hal Tily. 2010. THE ROLE OF PROCESSING COMPLEXITY IN WORD ORDER VARIATION AND CHANGE. Stanford PhD Dissertation
114		Using distributional semantics to study syntactic productivity in diachrony: A case study	http://www.fperek.net/pdfs/PerekToAppear-using-distributional.pdf
115	No date	Extra stuff we couldn't fit in
116		Effect of population size and other factors on lexicon size and/or rate of change
117		Pagel, M., Atkinson, Q. D. & Meade, A. Frequency of word-use predicts rates of lexical evolution throughout Indo-European history. Nature 449, 717–720 (2007).
118		Petersen, A. M., Tenenbaum, J., Havlin, S. & Stanley, H. E. Statistical Laws Governing Fluctuations in Word Use from Word Birth to Word Death. Scientific Reports 2 (2012)
119		Rate of language evolution is affected by population size. PNAS 2015. Lindell Bromham Xia Hua Thomas G. Fitzpatrick and Simon J. Greenhill	http://www.pnas.org/content/112/7/2097
120		Bentz, Christian, Annemarie Verkerk, Douwe Kiela, Felix Hill, and Paula Buttery. "Adaptive communication: Languages with more non-native speakers tend to have fewer word forms." PloS one 10, no. 6 (2015): e0128254	http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0128254
121		Lupyan, Gary, and Rick Dale. "Language structure is partly determined by social structure." PloS one 5, no. 1 (2010)	http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0008559
122		Simpler grammar, larger vocabulary: how population size affects language	http://rspb.royalsocietypublishing.org/content/285/1871/20172586
123		F Reali, N Chater, MH Christiansen - Proc. R. Soc. B, 2018 - rspb.royalsocietypublishing.org