练习

I.1 从任意报纸或杂志中收集一个由不同长度例句组成的小型语料库。使用 WordNet 或任何标准词典，确定每个句子中每个开放类词各有多少个义项。每个句子共有多少种不同的义项组合？这个数量看起来如何随句子长度变化？

I.2 使用 WordNet 或标准参考词典，为语料库中的每个开放类词标注正确的义项标签。选择正确义项是否总是一件简单直接的事？报告你遇到的困难。

I.3 使用你最喜欢的词典，在短语 Time flies like an arrow 上模拟第 13 页所述的原始 Lesk 词重合消歧算法。假设每次只消解一个词，从左到右依次进行，并且后续过程会使用先前决策的结果。

I.4 实现上一道练习的解决方案。使用 WordNet，在短语 Time flies like an arrow 上实现第 13 页所述的原始 Lesk 词重合消歧算法。

参考文献¶

Agirre, E. and O. L. de Lacalle. 2003. Clustering WordNet word senses. RANLP 2003.

Agirre, E. and P. Edmonds, eds. 2006. Word Sense Disambiguation: Algorithms and Applications. Kluwer.

Amsler, R. A. 1981. A taxonomy for English nouns and verbs. ACL.

Basile, P., A. Caputo, and G. Semeraro. 2014. An enhanced Lesk word sense disambiguation algorithm through a distributional semantic model. COLING.

Black, E. 1988. An experiment in computational discrimination of English word senses. IBM Journal of Research and Development, 32(2):185–194.

Boguraev, B. K. and T. Briscoe, eds. 1989. Computational Lexicography for Natural Language Processing. Longman.

Chaplot, D. S. and R. Salakhutdinov. 2018. Knowledge-based word sense disambiguation using topic models. AAAI.

Chen, J. N. and J. S. Chang. 1998. Topical clustering of MRD senses based on information retrieval techniques. Computational Linguistics, 24(1):61–96.

Ciaramita, M. and Y. Altun. 2006. Broad-coverage sense disambiguation and information extraction with a supersense sequence tagger. EMNLP.

Ciaramita, M. and M. Johnson. 2003. Supersense tagging of unknown nouns in WordNet. EMNLP-2003.

Copestake, A. and T. Briscoe. 1995. Semi-productive polysemy and sense extension. Journal of Semantics, 12(1):15–68.

Cottrell, G. W. 1985. A Connectionist Approach to Word Sense Disambiguation. Ph.D. thesis, University of Rochester, Rochester, NY. Revised version published by Pitman, 1989.

Diab, M. and P. Resnik. 2002. An unsupervised method for word sense tagging using parallel corpora. ACL.

Dolan, B. 1994. Word sense ambiguation: Clustering related senses. COLING.

Duda, R. O. and P. E. Hart. 1973. Pattern Classification and Scene Analysis. John Wiley and Sons.

Faruqui, M., J. Dodge, S. K. Jauhar, C. Dyer, E. Hovy, and N. A. Smith. 2015. Retrofitting word vectors to semantic lexicons. NAACL HLT.

Fellbaum, C., ed. 1998. WordNet: An Electronic Lexical Database. MIT Press.

Gale, W. A., K. W. Church, and D. Yarowsky. 1992a. Estimating upper and lower bounds on the performance of word-sense disambiguation programs. ACL.

Gale, W. A., K. W. Church, and D. Yarowsky. 1992b. One sense per discourse. HLT.

Haber, J. and M. Poesio. 2020. Assessing polyseme sense similarity through co-predication acceptability and contextualised embedding distance. *SEM.

Hearst, M. A. 1991. Noun homograph disambiguation. Proceedings of the 7th Conference of the University of Waterloo Centre for the New OED and Text Research.

Henrich, V., E. Hinrichs, and T. Vodolazova. 2012. WebCAGe – a web-harvested corpus annotated with GermaNet senses. EACL.

Hirst, G. 1987. Semantic Interpretation and the Resolution of Ambiguity. Cambridge University Press.

Hirst, G. 1988. Resolving lexical ambiguity computationally with spreading activation and polaroid words. In S. L. Small, G. W. Cottrell, and M. K. Tanenhaus, eds, Lexical Ambiguity Resolution, 73–108. Morgan Kaufmann.

Hirst, G. and E. Charniak. 1982. Word sense and case slot disambiguation. AAAI.

Hovy, E. H., M. P. Marcus, M. Palmer, L. A. Ramshaw, and R. Weischedel. 2006. OntoNotes: The 90% solution. HLT-NAACL.

Iacobacci, I., M. T. Pilehvar, and R. Navigli. 2016. Embeddings for word sense disambiguation: An evaluation study. ACL.

Jurgens, D. and I. P. Klapaftis. 2013. SemEval-2013 task 13: Word sense induction for graded and non-graded senses. *SEM.

Kawamoto, A. H. 1988. Distributed representations of ambiguous words and their resolution in connectionist networks. In S. L. Small, G. W. Cottrell, and M. Tanenhaus, eds, Lexical Ambiguity Resolution, 195–228. Morgan Kaufman.

Kelly, E. F. and P. J. Stone. 1975. Computer Recognition of English Word Senses. North-Holland.

Kilgarriff, A. and J. Rosenzweig. 2000. Framework and results for English SENSEVAL. Computers and the Humanities, 34:15–48.

Kumar, S., S. Jat, K. Saxena, and P. Talukdar. 2019. Zero-shot word sense disambiguation using sense definition embeddings. ACL.

Landes, S., C. Leacock, and R. I. Tengi. 1998. Building semantic concordances. In C. Fellbaum, ed., WordNet: An Electronic Lexical Database, 199–216. MIT Press.

Lauscher, A., I. Vulić, E. M. Ponti, A. Korhonen, and G. Glavaš. 2019. Informing unsupervised pretraining with external linguistic knowledge. ArXiv preprint arXiv:1909.02339.

Lengerich, B., A. Maas, and C. Potts. 2018. Retrofitting distributional embeddings to knowledge graphs with functional relations. COLING.

Lesk, M. E. 1986. Automatic sense disambiguation using machine readable dictionaries: How to tell a pine cone from an ice cream cone. Proceedings of the 5th International Conference on Systems Documentation.

Levine, Y., B. Lenz, O. Dagan, O. Ram, D. Padnos, O. Sharir, S. Shalev-Shwartz, A. Shashua, and Y. Shoham. 2020. SenseBERT: Driving some sense into BERT. ACL.

Loureiro, D. and A. Jorge. 2019. Language modelling makes sense: Propagating representations through WordNet for full-coverage word sense disambiguation. ACL.

Luo, F., T. Liu, Z. He, Q. Xia, Z. Sui, and B. Chang. 2018a. Leveraging gloss knowledge in neural word sense disambiguation by hierarchical co-attention. EMNLP.

Luo, F., T. Liu, Q. Xia, B. Chang, and Z. Sui. 2018b. Incorporating glosses into neural word sense disambiguation. ACL.

Madhu, S. and D. Lytel. 1965. A figure of merit technique for the resolution of non-grammatical ambiguity. Mechanical Translation, 8(2):9–13.

Manandhar, S., I. P. Klapaftis, D. Dligach, and S. Pradhan. 2010. SemEval-2010 task 14: Word sense induction & disambiguation. SemEval.

Martin, J. H. 1986. The acquisition of polysemy. ICML.

Masterman, M. 1957. The thesaurus in syntax and semantics. Mechanical Translation, 4(1):1–2.

Melamud, O., J. Goldberger, and I. Dagan. 2016. context2vec: Learning generic context embedding with bidirectional LSTM. CoNLL.

Mihalcea, R. 2007. Using Wikipedia for automatic word sense disambiguation. NAACL-HLT.

Mihalcea, R. and D. Moldovan. 2001. Automatic generation of a coarse grained WordNet. NAACL Workshop on WordNet and Other Lexical Resources.

Miller, G. A., C. Leacock, R. I. Tengi, and R. T. Bunker. 1993. A semantic concordance. HLT.

Morris, W., ed. 1985. American Heritage Dictionary, 2nd college edition. Houghton Mifflin.

Mrkšić, N., D. Ó Séaghdha, B. Thomson, M. Gašić, L. M. Rojas-Barahona, P.-H. Su, D. Vandyke, T.-H. Wen, and S. Young. 2016. Counter-fitting word vectors to linguistic constraints. NAACL HLT.

Navigli, R. 2006. Meaningful clustering of senses helps boost word sense disambiguation performance. COLING/ACL.

Navigli, R. 2009. Word sense disambiguation: A survey. ACM Computing Surveys, 41(2).

Navigli, R. 2016. Chapter 20. Ontologies. In R. Mitkov, ed., The Oxford Handbook of Computational Linguistics. Oxford University Press.

Navigli, R. and S. P. Ponzetto. 2012. BabelNet: The automatic construction, evaluation and application of a wide coverage multilingual semantic network. Artificial Intelligence, 193:217–250.

Navigli, R. and D. Vannella. 2013. SemEval-2013 task 11: Word sense induction and disambiguation within an end-user application. *SEM.

Nguyen, K. A., S. Schulte im Walde, and N. T. Vu. 2016. Integrating distributional lexical contrast into word embeddings for antonym-synonym distinction. ACL.

Palmer, M., O. Babko-Malaya, and H. T. Dang. 2004. Different sense granularities for different applications. HLT NAACL Workshop on Scalable Natural Language Understanding.

Palmer, M., H. T. Dang, and C. Fellbaum. 2006. Making fine-grained and coarse-grained sense distinctions, both manually and automatically. Natural Language Engineering, 13(2):137–163.

Pedersen, T. and R. Bruce. 1997. Distinguishing word senses in untagged text. EMNLP.

Peters, M., M. Neumann, M. Iyyer, M. Gardner, C. Clark, K. Lee, and L. Zettlemoyer. 2018. Deep contextualized word representations. NAACL HLT.

Pilehvar, M. T. and J. Camacho-Collados. 2019. WiC: the word-in-context dataset for evaluating context-sensitive meaning representations. NAACL HLT.

Pilehvar, M. T., D. Jurgens, and R. Navigli. 2013. Align, disambiguate and walk: A unified approach for measuring semantic similarity. ACL.

Ponzetto, S. P. and R. Navigli. 2010. Knowledge-rich word sense disambiguation rivaling supervised systems. ACL.

Pu, X., N. Pappas, J. Henderson, and A. Popescu-Belis. 2018. Integrating weakly supervised word sense disambiguation into neural machine translation. TACL, 6:635–649.

Pustejovsky, J. 1995. The Generative Lexicon. MIT Press.

Pustejovsky, J. and B. K. Boguraev, eds. 1996. Lexical Semantics: The Problem of Polysemy. Oxford University Press.

Quillian, M. R. 1968. Semantic memory. In M. Minsky, ed., Semantic Information Processing, 227–270. MIT Press.

Quillian, M. R. 1969. The teachable language comprehender: A simulation program and theory of language. CACM, 12(8):459–476.

Raganato, A., C. D. Bovi, and R. Navigli. 2017a. Neural sequence learning models for word sense disambiguation. EMNLP.

Raganato, A., J. Camacho-Collados, and R. Navigli. 2017b. Word sense disambiguation: A unified evaluation framework and empirical comparison. EACL.

Riesbeck, C. K. 1975. Conceptual analysis. In R. C. Schank, ed., Conceptual Information Processing, 83–156. American Elsevier, New York.

Schneider, N., J. D. Hwang, V. Srikumar, J. Prange, A. Blodgett, S. R. Moeller, A. Stern, A. Bitan, and O. Abend. 2018. Comprehensive supersense disambiguation of English prepositions and possessives. ACL.

Schütze, H. 1992. Dimensions of meaning. Proceedings of Supercomputing ’92. IEEE Press.

Schütze, H. 1997. Ambiguity Resolution in Language Learning: Computational and Cognitive Models. CSLI Publications, Stanford, CA.

Schütze, H. 1998. Automatic word sense discrimination. Computational Linguistics, 24(1):97–124.

Simmons, R. F. 1973. Semantic networks: Their computation and use for understanding English sentences. In R. C. Schank and K. M. Colby, eds, Computer Models of Thought and Language, 61–113. W. H. Freeman & Co.

Small, S. L. and C. Rieger. 1982. Parsing and comprehending with Word Experts. In W. G. Lehnert and M. H. Ringle, eds, Strategies for Natural Language Processing, 89–147. Lawrence Erlbaum.

Snow, R., S. Prakash, D. Jurafsky, and A. Y. Ng. 2007. Learning to merge word senses. EMNLP/CoNLL.

Snyder, B. and M. Palmer. 2004. The English all-words task. SENSEVAL-3.

Sparck Jones, K. 1986. Synonymy and Semantic Classification. Edinburgh University Press, Edinburgh. Republication of 1964 PhD Thesis.

Tsvetkov, Y., N. Schneider, D. Hovy, A. Bhatia, M. Faruqui, and C. Dyer. 2014. Augmenting English adjective senses with supersenses. LREC.

Vossen, P., A. Görög, F. Laan, M. Van Gompel, R. Izquierdo, and A. Van Den Bosch. 2011. Dutch-semcor: building a semantically annotated corpus for Dutch. Proceedings of eLex.

Weaver, W. 1949/1955. Translation. In W. N. Locke and A. D. Boothe, eds, Machine Translation of Languages, 15–23. MIT Press. Reprinted from a memorandum written by Weaver in 1949.

Wilks, Y. 1975a. An intelligent analyzer and understander of English. CACM, 18(5):264–274.

Wilks, Y. 1975b. Preference semantics. In E. L. Keenan, ed., The Formal Semantics of Natural Language, 329–350. Cambridge Univ. Press.

Wilks, Y. 1975c. A preferential, pattern-seeking, semantics for natural language inference. Artificial Intelligence, 6(1):53–74.

Yarowsky, D. 1995. Unsupervised word sense disambiguation rivaling supervised methods. ACL.

Yu, M. and M. Dredze. 2014. Improving lexical embeddings with semantic knowledge. ACL.

Zhong, Z. and H. T. Ng. 2010. It makes sense: A wide-coverage word sense disambiguation system for free text. ACL.