1 | LINGUIST 289: Topics in Computational Linguistics: Computational Models of Language Change | |||
---|---|---|---|---|
2 | Spring 2016 | |||
3 | Dan Jurafsky | |||
4 | Tuesdays 4:30-6:30, Greenberg Room | |||
5 | Topics in computational models of language change, with a focus on semantics. Vector semantic models of change in word meaning and word sentiment, rates of lexical innovation, computational models of syntactic and morphological change and sound change, and models of language evolution like the interated learning paradigm. | s | ||
6 | Prerequisites: LINGUIST 288, LINGUIST 232A, LINGUIST 250, and either LINGUIST 205A or 210A, plus at least one course in historical linguistics. Or consent of instructor | |||
7 | ||||
8 | Superset of papers in each week, selection to be made a week in advance, boldfaced | |||
9 | Food | |||
10 | Week 2: April 5 | Types and Directions of Change: Subjectification, Metaphor, Inflation, Bleaching, Jespersen's Cycle | Everyone read Traugott+Dasher and choose 1 of the others. Naomi, James, and Reuben in charge today | |
11 | Naomi | Traugott, Elizabeth C. & Richard B. Dasher. 2002. Chapter 2, "Prior and Current Work", from Regularity in Semantic Change. Cambridge: Cambridge University Press. | Find it on searchworks. See if this link works: | |
12 | James | Dahl, Östen. 2001. Inflationary effects in language and elsewhere. In Joan Bybee & Paul Hopper (eds.), Frequency and the emergence of linguistic structure, vol. 2, 471–80. Amsterdam: John Benjamins. | http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.31.911&rep=rep1&type=pdf | |
13 | James | Kiparsky, Paul & Cleo Condoravdi. 2006. Tracking Jespersen's cycle. In M. Janse, B.D. Joseph & A. Ralli (eds.), The 2nd international conference of Modern Greek dialects and linguistic theory, 172-197. Mytilene: Doukas | http://web.stanford.edu/~kiparsky/Papers/lesvosnegation.pdf | |
14 | Reuben | Yang Xu, Terry Regier, and Barbara C. Malt. 2015. Historical Semantic Chaining and Efficient Communication: The Case of Container Names. Cognitive Science. | http://linguistics.berkeley.edu/~yangxu/xu_regier_malt_2015_historicalchaining_preprint.pdf | |
15 | Extra papers: | |||
16 | Traugott, Elizabeth. 1989. On the rise of epistemic meanings in English: An example of subjectification in semantic change. Language 65(1). 31–55. | http://www.jstor.org/stable/414841 | ||
17 | Sweetser, Eve. 1991. Chapter 2 "Semantic Change" of From etymology to pragmatics: Metaphorical and cultural aspects of semantic structure. Vol. 54. Cambridge University Press | |||
18 | George Kingsley Zipf. 1945. The meaning-frequency relationship of words. The Journal of General Psychology, 33(2):251–256. | |||
19 | Bodo Winter, Graham Thompson, and Matthias Urban. 2014. Cognitive Factors Motivating The Evolution Of Word Meanings: Evidence From Corpora, Behavioral Data And Encyclopedic Network Structure. In Evolution of Language: Proceedings of the 10th International Conference (EVOLANG10), pages 353–360. | |||
20 | Elly van Gelderen. 2011. The Linguistic Cycle: Language Change and the Language Faculty. | |||
21 | ||||
22 | Week 3: April 16 | Social Aspects of Change: Variation, Networks, Community, etc NOTE THE CHANGED DATE: THURSDAY NOT TUESDAY | Will + Rob (Food: Sarah) | Food: Sara |
23 | Will (networks)/Rob (incrementation) | Labov, William. 2001. Section 10.4 “Social Networks” pages 356-363, and Chapter 14 “Incrementation [the curvilinear hypothesis]” pages 446-465, from Principles of linguistic change, vol. 2: Social factors. Oxford: Blackwell. | http://web.stanford.edu/class/linguist289/labovreadings.pdf | |
24 | Will | Centola, D. and A. Baronchelli. The spontaneous emergence of conventions: An experimental study of cultural evolution. PNAS, 2015. | http://ndg.asc.upenn.edu/files/Centola-Baronchelli-2015-PNAS.pdf | |
25 | Rob | Eckert, P. (2012). Three waves of variation study: The emergence of meaning in the study of sociolinguistic variation. Annual review of Anthropology, 41, 87-100. | http://web.stanford.edu/~eckert/PDF/ThreeWaves.pdf | |
26 | Uriel Weinreich, William Labov, and Marvin I. Herzog. 1968. Empirical Foundations for a Theory of Language Change | http://www.utexas.edu/cola/centers/lrc/books/hist05.html | ||
27 | Labov, William. 2007. Transmission and diffusion. Language 83.344-87. | http://muse.jhu.edu/content/article_reflink/journals/language/v083/83.2labov.pdf | ||
28 | Tagliamonte, Sali A., and Alexandra D'Arcy. 2009. "Peaks beyond phonology: Adolescence, incrementation, and language change." Language 85.1 (2009): 58-108. | http://muse.jhu.edu/journals/language/v085/85.1.tagliamonte.html | ||
29 | Lu, Q., Korniss, G., & Szymanski, B. K. (2009). The Naming Game in social networks: community formation and consensus engineering. Journal of Economic Interaction and Coordination, 4(2), 221–235. doi:10.1007/s11403-009-0057-7 or | http://link.springer.com/content/pdf/10.1007%2Fs11403-009-0057-7.pdf | ||
30 | A model of grassroots changes in linguistic systems Pierrehumbert, J. B., Stonedahl, F. and Daland, R. (2014) | http://arxiv.org/pdf/1408.1985v1.pdf | ||
31 | Danescu-Niculescu-Mizil, Cristian, et al. "No country for old members: User lifecycle and linguistic change in online communities." Proceedings of the 22nd international conference on World Wide Web. International World Wide Web Conferences Steering Committee, 2013. | http://www.mpi-sws.org/~cristian/Linguistic_change.html | ||
32 | ||||
33 | ||||
34 | Week 4: April 19 | Vector semantics for word sense change (+ new sense detection) | James, Delenn + Allen (+Will on his paper?) | Food: Simon |
35 | James | A Computational Evaluation of Two Laws of Semantic Change Yang Xu and Charles Kemp | http://www.linguistics.berkeley.edu/~yangxu/xu_kemp_2015_parallelchange.pdf | |
36 | Will | Will Hamilton, Jure Leskovec, and Dan Jurafsky. 2016ms. Diachronic Word Embeddings Reveal Laws of Semantic Change | http://arxiv.org/pdf/1605.09096v1.pdf | |
37 | Allen | Lea Frermann and Mirella Lapata. 2016. A Bayesian Model of Diachronic Meaning Change. TACL | http://aclweb.org/anthology/Q/Q16/Q16-1003.pdf | |
38 | Delenn | Adam Jatowt and Kevin Duh. 2014. A framework for analyzing semantic change of words across time. In Proc. 14th ACM/IEEE-CS Conf. on Digital Libraries, 229–238. IEEE Press | http://cs.jhu.edu/~kevinduh/papers/jatowt14change.pdf | |
39 | ||||
40 | Extra papers: | |||
41 | Sagi, E., Kaufmann, S. & Clark, B. Tracing semantic change with latent semantic analysis. Current Methods in Historical Semantics 73, 161 (2011). | |||
42 | Eyal Sagi. Nouns are more stable than Verbs: Patterns of semantic change in 19th century English. | http://www.ermon.net/sites/default/files/biblio/Sagi-CogSci2010-RelativeChangeInNounsAndVerbs.pdf | ||
43 | Temporal Analysis of Language through Neural Language Models Yoon Kim∗ Yi-I Chiu∗ Kentaro Hanaki∗ Darshan Hegde∗ Slav Petrov⋄ | https://www.aclweb.org/anthology/W/W14/W14-2517.pdf | ||
44 | A distributional similarity approach to the detection of semantic change in the Google Books Ngram corpus. Kristina Gulordava, Marco Baroni | http://clic.cimec.unitn.it/marco/publications/gems-11/gulordava-baroni-gems-2011.pdf | ||
45 | Mihalcea, Rada, and Vivi Nastase. "Word epoch disambiguation: Finding how words change over time." ACL 2012 | http://www.aclweb.org/anthology/P12-2051 | ||
46 | Steyvers, M. & Tenenbaum, J. B. The Large-scale structure of semantic networks: Statistical analyses and a model of semantic growth. Cognitive science 29, 41–78 (2005). | |||
47 | Vivek Kulkarni, Rami Al-Rfou, Bryan Perozzi, and Steven Skiena. 2014. Statistically significant detection of linguistic change. Proc. 24th WWW Conf., 625–635. | |||
48 | Derry Tanti Wijaya and Reyyan Yeniterzi. 2011. Understanding semantic change of words over centuries. In Proceedings of the 2011 International Workshop on Detecting and Exploiting Cultural Diversity on the Social Web, pages 35–40. ACM | |||
49 | Automatically identifying changes in the semantic orientation of words. Paul Cook, Suzanne Stevenson | http://www.cs.toronto.edu/~pcook/CookStevenson2010.pdf | ||
50 | Temporal Patterns of Happiness and Information in a Global Social Network: Hedonometrics and Twitter. Peter Sheridan Dodds, Kameron Decker Harris, Isabel M. Kloumann, Catherine A. Bliss, Christopher M. Danforth | http://www.uvm.edu/~pdodds/research/papers/files/2011/dodds2011e.pdf | ||
51 | Schulz, Muriel R. (1975). The semantic derogation of women. In Barrie Thorne & Nancy Henley (eds.), Language and sex: Difference and dominance. Rowley, MA: Newbury House, 64—75. | |||
52 | Cook, Paul, Jey Han Lau, Diana McCarthy, and Timothy Baldwin. 2014. Novel Word-sense Identification. COLING. Dublin. 1624– 1635 | |||
53 | Lau, Han Jey, Paul Cook, Diana McCarthy, Spandana Gella, and Timothy Baldwin. 2014. Learning Word Sense Distributions, Detecting Unattested Senses and Identifying Novel Senses using Topic Models. Proceedings of ACL. Baltimore. 259–270 | |||
54 | Mitra, Sunny, Ritwik Mitra, Suman Kalyan Maity, Martin Riedl, Chris Biemann, Pawan Goyal, and Animesh Mukherjee. 2015. An automatic approach to identify word sense changes in text media across timescales. Natural Language Engineering 21:773–798. | |||
55 | Mitra, Sunny, Ritwik Mitra, Martin Riedl, Chris Biemann, Animesh Mukherjee, and Pawan Goyal. 2014. That’s sick dude!: Automatic identification of word sense change across different timescales. Proceedings of ACL. Baltimore. 1020–1029 | |||
56 | Popescu, Octavian and Carlo Strapparava. 2015. SemEval 2015, Task 7: Diachronic Text Evaluation. In Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015). Denver, CO, USA, pages 869–877 | |||
57 | ||||
58 | ||||
59 | Week 5: April 26 | Sound change | Simon + Alex | Food: Ciyang |
60 | Alex | Hay, J.B., Pierrehumbert, J.B., Walker, A. J. and LaShell, P. (2015) Tracking word frequency effects through 130 years of sound change, Cognition 139, 83-91. | http://www.sciencedirect.com/science/article/pii/S001002771500044X | |
61 | Alex | How Rhoticity became /r/-sandhi. Hay & Sudbury (2005) | http://muse.jhu.edu/journals/language/v081/81.4hay.pdf | |
62 | Simon | Wedel, A., Jackson, S., & Kaplan, A. (2013). Functional load and the lexicon: Evidence that syntactic category and frequency relationships in minimal lemma pairs predict the loss of phoneme contrasts in language change. Language and Speech, 56, 395–417. | http://las.sagepub.com/content/early/2013/07/01/0023830913489096.full.pdf+html | |
63 | Simon | Alexandre Bouchard-Côté, David Hall, Thomas L. Griffiths, and Dan Klein. 2013. Automated reconstruction of ancient languages using probabilistic models of sound change. PNAS | http://www.pnas.org/content/110/11/4224.full | |
64 | Wedel, A. (2012). Lexical contrast maintenance and the development of sublexical contrast systems. Language and Cognition, 4(4), 319–355. | http://dingo.sbs.arizona.edu/~wedel/publications/PDF/LexicalContrast_Wedel.pdf | ||
65 | ||||
66 | ||||
67 | Week 6: May 3 | Phylogenetic models | Ignacio + Reuben | Food: Ignacio + Reuben |
68 | Ignacio | MacMahon and MacMahon Chapters 1 and 2 | ||
69 | Ignacio | Quentin D. Atkinson and Russell D. Gray. 2008. How old is the Indo-European Language Family? Illumination or More Moths to the Flame? | ||
70 | Reuben | Annemarie Verkerk. Where do all the motion verbs come from? The speed of development of manner verbs and path verbs in Indo-European. Diachronica 32 (2015), 69-104 | http://www.evolution.reading.ac.uk/~tb904576/diachronica_03ver_preprint.pdf | |
71 | extra papers: | |||
72 | Chang, Cathcart, Hall, Garrett. 2015. Ancestry-constrained Phylogenetic Analysis Supports the Indo-European Steppe Hypothesis. Language | http://www.linguisticsociety.org/sites/default/files/news/ChangEtAlPreprint.pdf | ||
73 | Gray, Russell D., and Quentin D. Atkinson. 2003. Language-tree divergemce times support the Anatolian theory of Indo-European origin. Nature 426.435–39 | http://www.nature.com/nature/journal/v426/n6965/abs/nature02029.html | ||
74 | ||||
75 | Daumé H III, Campbell L (2007) A Bayesian model for discovering typological implications. Assoc Comput Linguist 45:65–72 | |||
76 | Non-Parametric Bayesian Areal Linguistics, Hal Daume ́ III | http://www.umiacs.umd.edu/~hal/docs/daume09areal.pdf | ||
77 | High-definition phonotactics reflect linguistic pasts | https://figshare.com/s/c64b7b3ba91cfeaab6b8 | ||
78 | ||||
79 | ||||
80 | ||||
81 | Week 7: May 10 | Language as Evidence for Historical Change in Culture | Austin +Sara | Food: Robert |
82 | Sara | The civilizing process in London’s Old Bailey Sara Klingenstein, Tim Hitchcock, and Simon DeDeo | http://www.pnas.org/content/111/26/9419.abstract | |
83 | Quantitative analysis of culture using millions of digitized books. Michel et al. | http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3279742/ | ||
84 | Austin | Akpinar, Ezgi, and Jonah Berger. "Drivers of cultural success: The case of sensory metaphors." Journal of personality and social psychology 109, no. 1 (2015): 20. | http://psycnet.apa.org/psycinfo/2015-23900-001/ | |
85 | Austin | Youn et al. (2016) "On the universal structure of human lexical semantics." PNAS 113(7) | http://www.pnas.org/content/113/7/1766 | |
86 | extra papers: | |||
87 | Lexical shifts, substantive changes, and continuity in State of the Union discourse, 1790–2014. Alix Rule, Jean-Philippe Cointet, and Peter S. Bearman. PNAS vol. 112 no. 35. 10837–10844, | https://www.pnas.org/content/112/35/10837.full | ||
88 | ||||
89 | Week 8: May 17 | Iterated Learning/Game Theoretic Models | George, Ciyang, Robert | Food: Naomi |
90 | Robert | Jon W. Carr, Kenny Smith, Hannah Cornish, Simon Kirby. 2016. The Cultural Evolution of Structured Languages in an Open-Ended, Continuous World Cognitive Science (2016) 1-32. | http://onlinelibrary.wiley.com/doi/10.1111/cogs.12371/epdf | |
91 | Ciyang | Words as alleles: connecting language evolution with Bayesian learners to models of genetic drift . Florencia Reali, Thomas L. Griffiths. 2010: Proc Roy Soc B | ||
92 | George | What is a universal? On the explanatory potential of evolutionary game theory in linguistics. Gerhard Jager | ||
93 | Kirby, S., Cornish, H., & Smith, K. (2008). Cumulative cultural evolution in the laboratory: an experimental approach to the origins of structure in human language. Proceedings of the National Academy of Sciences of the United States of America, 105(31), 10681–10686. | http://www.pnas.org/content/early/2008/07/29/0707835105.full.pdf | ||
94 | Kirby, S., Tamariz, M., Cornish, H., & Smith, K. (2015). Compression and Communication in the Cultural Evolution of Linguistic Structure. Cognition, 141, 87–102. | http://www.sciencedirect.com/science/article/pii/S0010027715000815 | ||
95 | Silvey, C., Kirby, S., & Smith, K. (2015). Word Meanings Evolve to Selectively Preserve Distinctions on Salient Dimensions. Cognitive Science, 39, 212–226. doi:10.1111/cogs.12150 | http://onlinelibrary.wiley.com/doi/10.1111/cogs.12150/pdf | ||
96 | Yanovich I. (2016). Genetic Drift Explains Sapir's ``drift'' In Semantic Change. In S.G. Roberts, C. Cuskley, L. McCrohon, L. Barceló-Coblijn, O. Fehér & T. Verhoef (eds.) The Evolution of Language: Proceedings of the 11th International Conference (EVOLANG11). | http://evolang.org/neworleans/papers/24.html | ||
97 | Deo, A. (2015). The semantic and pragmatic underpinnings of grammaticalization paths: The progressive to imperfective shift. Semantics and Pragmatics. | |||
98 | Ahern, C. & R. Clark (2014). Diachronic Processes in Language as Signaling Under Conflicting Interests. In: E.A. Cartmill, S. Roberts, H. Lyn, H. Cornish (eds.), Proceedings of the 10th International Conference on the Evolution of Language (Evolang X), pages 25–32. | |||
99 | Enke, D., R. Mühlenbernd & I. Yanovich (2016). The Emergence of the Progressive to Imperfective Diachronic Cycle in Reinforcement-learning Agents. In: S.G. Roberts, C. Cuskley, L. McCrohon, L. Barcel´o-Coblijn, O. Feher & T. Verhoef (eds.), The Evolution of Language: Proceedings of the 11th International Conference on the Evolution of Language (Evolang XI), Article 191. | |||
100 | ||||
101 | ||||
102 | Week 10: May 31 | Computational Models of Syntactic/Morphological Change | Branden, Jason | Food: Austin |
103 | Lieberman, E., Michel, J.-B., Jackson, J., Tang, T. & Nowak, M. A. Quantifying the evolutionary dynamics of language. Nature 449, 713–716 (2007). | http://www.nature.com/nature/journal/v449/n7163/abs/nature06137.html | ||
104 | Tabor, W. 1994. Syntactic Innovation: A Connectionist Model. Stanford PhD DIssertation. Chapter 5 "Reanalaysis-anticipatory Frequency Change (Q-Divergence)" | linguist289.stanford.edu/taborthesischapter5.pdf | ||
105 | ||||
106 | Extra reading: | |||
107 | Tabor, W. 1994. Syntactic Innovation: A Connectionist Model. Stanford PhD DIssertation. [It's over 100 Mbytes, don't download over slow connection] | linguist289.stanford.edu/tabor.thesis.2up.pdf | ||
108 | Tabor, W. (1995) Lexical Change as Nonlinear Interpolation. In Proceedings of the 17th Annual Cognitive Science Conference. J. D. Moore and J. F. Lehman, eds. Hillsdale, NJ: Lawrence Erlbaum Associates. (6 pages) | http://www.sp.uconn.edu/~ps300vc/Papers/lcasni.pdf | ||
109 | Tabor, Whitney (1993) `The gradual development of degree modifier sort of and kind of: a corpus proximity model'. Papers from the th Regional Meeting of the Chicago Linguistic Society 29: 451-65. | |||
110 | The gradualness of syntactic change: A corpus proximity model | |||
111 | Continuity in language change: implications for a theory of grammar | http://www.sp.uconn.edu/~ps300vc/Papers/cinlc.pdf | ||
112 | Tabor, W., Kuperman, V., & Kukona, A. (2011, March). On the nature of syntactic categories: a corpus study of "kind of" in American English. CUNY conference. | http://psychology.uconn.edu/labs/solab/papers/taborCUNY2011revised.pdf | ||
113 | Hal Tily. 2010. THE ROLE OF PROCESSING COMPLEXITY IN WORD ORDER VARIATION AND CHANGE. Stanford PhD Dissertation | |||
114 | Using distributional semantics to study syntactic productivity in diachrony: A case study | http://www.fperek.net/pdfs/PerekToAppear-using-distributional.pdf | ||
115 | No date | Extra stuff we couldn't fit in | ||
116 | Effect of population size and other factors on lexicon size and/or rate of change | |||
117 | Pagel, M., Atkinson, Q. D. & Meade, A. Frequency of word-use predicts rates of lexical evolution throughout Indo-European history. Nature 449, 717–720 (2007). | |||
118 | Petersen, A. M., Tenenbaum, J., Havlin, S. & Stanley, H. E. Statistical Laws Governing Fluctuations in Word Use from Word Birth to Word Death. Scientific Reports 2 (2012) | |||
119 | Rate of language evolution is affected by population size. PNAS 2015. Lindell Bromham Xia Hua Thomas G. Fitzpatrick and Simon J. Greenhill | http://www.pnas.org/content/112/7/2097 | ||
120 | Bentz, Christian, Annemarie Verkerk, Douwe Kiela, Felix Hill, and Paula Buttery. "Adaptive communication: Languages with more non-native speakers tend to have fewer word forms." PloS one 10, no. 6 (2015): e0128254 | http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0128254 | ||
121 | Lupyan, Gary, and Rick Dale. "Language structure is partly determined by social structure." PloS one 5, no. 1 (2010) | http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0008559 | ||
122 | ||||
123 | F Reali, N Chater, MH Christiansen - Proc. R. Soc. B, 2018 - rspb.royalsocietypublishing.org |