MIME-Version: 1.0 Server: CERN/3.0 Date: Tuesday, 07-Jan-97 15:45:28 GMT Content-Type: text/html Content-Length: 35843 Last-Modified: Monday, 25-Nov-96 21:50:20 GMT
Papers discussed (incl. some additional papers): [discussed on April 17, 1992] Learning Words from Context, Hastings, Lytinen, & Lindsay, ML-91 Workshop [discussed on April 17, 1992] Sumita, Eiichiro and Iida, Hitoshi, "Experiments and Prospects of Example-Based Machine Translation" Proc 29th Mtng of ACL, 1991, pp 185-192. [discussed on May 1, 1992] W. A. Gale and K. W. Church, "A Program for Aligning sentences in bilingual corpora." ACL-91, pp 177-184. [additional reading] P. Brown, J.c.Lai, & R. Mercer, "Aligning sentences in parallel corpora" ACL-91, pp 169-176 [discussed on May 1, 1992] P. Brown, J. Cocke, S. Della Pietra, F. Jelinek, R. Mercer and P. Rossin, "A Statistical Approach to Machine Translation" COLING-88, pp. 71-76 where they basically treat French as a garbled version of English and use statistical techniques to de-cryptify it. [discussed on May 22, 1992] Steven Pinker, "Language Acquisition", from "Foundations of Cognitive Science", ed. by Michael Posner, MIT Press, 1989, Chapter 9 [distibuted as further reading for May 22, 1992 discussion] Chapter 4 from Slobin, "Psycholinguistics", which "gives some cogent ideas about NL acquisition from the psycholinguistic point of view". [discussed on June 19, 1992] Miniature Language Acquisition: A touchstone for Cognitive Science, Feldman, Lakoff, Stolke, & Weber, COGSCI-90 [discussed on June 19, 1992] "Learning Spatial Concepts Using a Partially-Structured Connectionist Architecture", Terry Regier, Berkeley TR-91-050, Oct. 1991 [further readings on topic discussed on June 19, 1992] [available by ftp from icsi-ftp.berkeley.edu pub/techreports] Andreas Stolcke: Syntactic Category Formation with Vector Space Grammars COGSCI-91, pp.908--912 publ. 1989 Andreas Stolcke: Learning Feature-Based Semantics with Simple Recurrent Networks TR-90-015 Berkeley, CA publ. 1990 Terry Regier: Learning Perceptually Grounded Semantics in the ${L}_0$ Project Proc. 29th Annual Meeting ACL, pp. 138--145 publ. 1991 Terry Regier: Learning Object-Relative Spatial Concepts in the ${L}_0$ Project COGSCI-91, pp.191--196 publ. 1991 [discussed July 7, 1992] Distributed Representations, Simple Recurrent Networks, and Grammatical Structure; Elman; Machine Learning 7, 195-225 (Sept. 1991) [discussed July 31, 1992] Induction of Augmented Transition Networks; Anderson, Cognitive Science 1977 or Readings on Machine Learning, pp. 774-790 [discussed August 21, 1992] Learning Structural Descriptions of grammar rules from examples; Berwick, IJCAI-79 [discussed on Sept. 4, 1992] An architecture combining two RAAMs for translating Spanish<->English. Some surprising results; extreme distributed point of view. My favorite RAAM paper. Lonnie Chrisman: "Learning Recursive Distributed Representations for Holistic Computation", Connection Science, vol. 3, 1992, pages 345--366 [discussed on Sept. 4, 1992] Parsing into RAAM representations. George Berg: "A Connectionist Parser with Recursive Sentence Structure and Lexical Disambiguation", AAAI-92, pages 32--37 (MIT Press) [discussed on Sept. 18, 1992] Lehnert, "Learning to Integrate Syntax and Semantics", ML workshop, 1988. [discussed on Sept. 18, 1992] Zernik, "How Do Machine-Learning Paradigms Fare in Language Acquisition?", ML workshop, 1988. [discussed on Oct. 2, 1992] St. John, Mark F.: "The Story Gestalt: {A} Model of Knowledge-Intensive Processes in Text Comprehension", Cog. Sc. 1992, vol. 16, pp 271-276 [discussed on Oct. 2, 1992] St. John, Mark F.: "Learning Language in the Service of a Task", Cog. Sc. 1992, pp 271-276 [discussed on Oct. 16, 1992] Hobbs, Jerry, "Resolving Pronoun References" from Lingua 1978, reprinted in Grosz et. al., Readings in Natural Language Processing. [discussed on Oct. 16, 1992] Pan, Haihua "Interpreting Intrasentential Anaphora" mss. 1992. [discussed on Oct. 30, 1992] Wolff, J. G. "Language Acquisition, data compression, and Generalization", Language and Communication, 2, 1982. [discussed on Nov. 13, 1992] Anderson, "A Theory of Language Acquisition based on General LEarning Principles", IJCAI, 1981. [discussed on Dec. 11, 1992] Ling, Cherwenka and Marinov, "A General Symbolic Pattern Associator",[discussed on Jan. 15, 1993] Ezra Black, John Lafferty, Salim Roukos, "Development and Evaluation of a Broad-Coverage Probabilistic Grammar of English-Language Computer Manuals" 30th ACL Conf. 1992, pp.185-192 [discussed on Jan. 29, 1993] J. Zelle, R. Mooney: "Learning Semantic Grammars with Constructive Inductive Logic Programming" [Submitted to AAAI '93] [discussed on Feb. 12, 1993] P. Langley and J. Carbonell, "Language Acquisition and Machine Learning" from the book, "Mechanisms of Language Acquisition", 1985 [discussed on Feb. 26, 1993] Berwick, "Parsability and learnability" from the book, "Mechanisms of Language Acquisition", 1985 [discussed on March 12, 1993] Schuetze, Hinrich, "Word Space", from book "Advances in Neural Information Processing Systems 5", ed. C. L. Giles, S. J. Hanson and J. D. Cowan, San Mateo CA: Morgan Kaufmann, 1993 [discussed on March 26, 1993] Claire Cardie, "Learning to Disambiguate Relative Pronouns" AAAI-92 [the following paper is virtually identical:] Claire Cardie, "Corpus-based Acquisition of Relative Pronoun Disambiguation heuristics" ACL-92 [discussed on April 9, 1993] Gregers Koch, "Computational Logico-Semantic Induction", Natural Language Understanding and Logic Programming, II, 1988, pp. 107-133 [discussed on May 21, 1993] Ulf Hermjakob, "Example Based Acquisition of Relevant Features and Grammar Learning for Parsing and Machine Translation." (draft) [discussed on June 4, 1993] From the book, "Mechanisms of Language Acquisition", 1985 - Bates B. and MacWhinney B., "Competition, Variation and Language Learning." (Note: This is more lingusitic/cog sci, not a concrete model) [discussed on June 18, 1993] Donald Hindle and Mats Rooth, "Structural Ambiguity and Lexical Relations", Comp. Ling. March 1993 [discussed on July 2, 1993] Kenneth. W. Church and Robert L. Mercer, "Introduction to the Special Issue on Computational Linguistics Using Large Corpora", Comp. Ling. March 1993 [discussed on July 30, 1993] Rey-Long Liu, Von-Wun Soo, "An Empirical Study on Thematic Knowledge Acquisition Based on Syntactic Clues and Heuristics", ACL Proc. June '93, pp. 243 - 250 [discussed on Aug. 13, 1993] Ted Briscoe and John Carroll, "Generalized Probabilistic LR Parsing of Natural Language (Corpora) with Unification-Based Grammars", Comp. Ling. March 1993 [discussed on Aug. 27, 1993] R. Weischedel, R. Schwarz, J. Palmucci, M. Meteer, L. Ramshaw: "Coping with Ambiguity and Unknown Words through Probabilistic Models", Computational Linguistics June 1993, pp. 359-382 [discussed on Sept. 10, 1993] Shannon D. Moeser and Albert S. Bregman, "Imagery and Language Acquisition", Journal of Verbal Learning and Verbal Behaviour (JVLVB), 1973, vol. 12, pp. 91-98 [related paper (but not discussed):] Shannon D. Moeser and Albert S. Bregman, "The Role of Reference in the Acquisition of a Miniature Artificial Language", Journal of Verbal Learning and Verbal Behaviour (JVLVB), 1972, vol. 11, pp. 759-769 [discussed on Sept. 24, 1993] Risto Miikkulainen: "Subsymbolic Case-role Analysis of Sentences with embedded clauses", TR AI93-202, July 1993 [discussed on Oct. 8, 1993] McMillan, Mozer and Smolensky, "Dynamic Conflict Resolution in a Connectionist Rule-Based System", IJCAI 93, pp1366-1371. [discussed on Oct. 8, 1993] Michael C. Mozer, Sreruupa Das, "A Connectionist Symbol Manipulator That Discovers the Structure of Context-Free Languages", NIPS5, 1993, pp. 863-870 [related paper (but not discussed):] Learning to recognize regular strings from positive and negative examples. @InProceedings{WatrousKuhn:NIPS4, author = "Watrous, Raymond L. and Kuhn, Gary M.", title = "Induction of Finite-State Automata Using Second-Order Recurrent Networks", booktitle = "Advances in Neural Information Processing Systems 4", year = 1992, editor = "Moody, J. E. and Hanson, S. J. and Lippman, R. P.", pages = "309--316", publisher = "Morgan Kaufmann Publishers", address = "San Mateo, California", } [related paper (but not discussed):] Similar to the above, but now they also extract the grammar from the network. @InProceedings{Giles:NIPS4, author = "Giles, C. L. and Miller, C. B. and Chen, D. and Sun, G. Z. and Chen, H. H. and Lee, Y. C.", title = "Extracting and Learning an Unknown Grammar with Recurrent Neural Networks", booktitle = "Advances in Neural Information Processing Systems 4", year = 1992, editor = "Moody, J. E. and Hanson, S. J. and Lippman, R. P.", pages = "317--324", publisher = "Morgan Kaufmann Publishers", address = "San Mateo, California", } [related paper (but not discussed):] This one looks like a pretty complete (35 pages) presentation of their external stack idea. Maybe be more interesting as a NN technique than language learning. We'll read it in my NN meeting this Friday; if it turns out interesting language-acquisition-wise, I'll let you know. @TechReport{sun:pushdown, author = "G.Z. Sun and C.L. Giles and H.H. Chen and Y.C. Lee", title = "The Neural Network Pushdown Automaton: {M}odel, Stack and Learning Simulations", institution = "Department of Computer Science, University of Maryland", year = "1993", number = "UMIACS-TR-93-77", address = "College Park, MD" } [related paper (but not discussed):] Looks like a shorter version of the above. Perhaps more appropriate to this crowd. @InProceedings{das:contextfree, author = "Sreerupa Das and C. Lee Giles and Guo-Zheng Sun", title = "Learning Context-free Grammars: {C}apabilities and Limitations of a Recurrent Neural Network with an External Stack Memory", booktitle = COGSCI-92, year = "1992", publisher = LEA, address = LEA-ADDR } [discussed on Oct. 22, 1993] Brill, E. "Automatic Grammar Induction and Parsing Free Text: A Transformation-Based Approach", ACL 93, pp. 259-265 [discussed on Oct. 22, 1993] Black, Jelinek, et al. "Towards History-Based Grammars: Using Richer Models for Probability-based Parsing", ACL 93, pp. 31-37. [discussed on Nov. 5, 1993] @InCollection{jain:generalization, author = "Ajay N. Jain", title = "Generalization Performance in {PARSEC}---{A} Structured Connectionist Parsing Architecture", booktitle = NIPS4, publisher = KAUF, editor = "John E. Moody and Stephen J. Hanson and Richard P. Lippmann", year = "1992", pages = "209--216", address = KAUF-ADDR } [discussed on Nov. 19, 1993] Pereira, F. and Schabes, Y. "Inside-Outside reestimation from partially bracketed corpora. ACL 1992, 128-135. [discussed on Dec. 3, 1993] Langley, "Language acquisition through error recovery", Cognition and Brain Theory, 5, 1982. [discussed on Jan. 14, 1994] Building a Large Annotated Corpus of English: The Penn Treebank, Marcus, Marcinkiewicz, and Santorini, Comp Ling, 19,2. [discussed on Jan. 28, 1994] Nancy Chindor, Lynette Hirschman, David D. Lewis: "Evaluating Message Understanding Systems: An analysis of the Third Message Understanding Conference (MUC-3)", Comp. Ling. Sept 1993 [discussed on Feb. 11, 1994] Eve V. Clark: "Meanings and Concepts", chapter 12 of book "Cognitive Development", vol. 3 of series "Handbook of Child Psychology", pp. 787-840, Wiley 1983 [discussed on Feb. 25, 1994] Derek Bickerton: "The Language Bioprogram Hypothesis", BBS (journal) 1984, vol.7, pp. 173-221 [Risto: He makes a strong case for the innateness of certain linguistic principles, based on studies on pidgin and creole languages] [discussed on Mar. 11, 1994] Lin and Soo, "Augmenting and Efficiently utilizing Domain Theory in Explanation-Based Natural Language Acquisition", ML92. [discussed on Apr. 1, 1994] Manning, C. "Automatic acquisition of a large subcategorization dictionary from corpora", 235-242, ACL '93 [discussed on Apr. 15, 1994] @InCollection{mclaughlin:effects, author = "Barry McLaughlin", title = "The Effects of Early Bilingualism", booktitle = "Second Language Acquisition in Childhood, {V}olume 1: {P}reschool Children", publisher = LEA, year = "1984", edition = "Second", chapter = "7", address = LEA-ADDR } [discussed on Apr. 29, 1994] Martin Kay and Matin Roescheisen, "Text-Translation Alignment", Comp. Ling. March 1993 [discussed on Sept. 9, 1994] Toward the Essential Nature of Statistical Knowledge in Sense Resolution Jill Lehman Proceedings, AAAI '94, Vol. I, page 734 [discussed on Sept. 23, 1994] "Lexical Acquisition in the Presence of Noise and Homonymy", by Jeffrey M. Siskind, AAAI 94, Vol.I, p. 760 [discussed on Oct. 7, 1994] S Pinker, "Chatterboxes" Chapter in "The Language Instinct," 1994. A nativist argument written for the masses. [discussed on Oct. 21, 1994] R. Kazman, "Simulating the Child's Acquisition of Lexicon and Syntax," Machine Learning, 16,1, 1994. [discussed on Nov. 4, 1994] Paul Bloom "Overview: Controversies in language acquisition" in P. Bloom Ed. "Language Acquisition: Core Readings," 1994, MIT Press. Recent summary, an intro to a book of collected papers. [discussed on Nov. 18, 1994] D. Yarowsky, "Decision Lists for Lexical Ambiguity Resolution", ACL-94. [discussed on Nov. 18, 1994] C. Samuelsson, "Grammar Specialization through Entropy Thresholds", ACL-94. [discussed on Dec. 2, 1994] Louis M. Herman, "Cognition and Language Competences of Bottle-Nosed Dolphins", chapter 10 in book "Dolphin Cognition and Behavior: {A} Comparative Approach", LEA, 1986, R. J. Schusterman and J. A. Thomas and F. G. Wood, editors [discussed on Dec. 16, 1994] Miller, Scott. Bobrow, Robert. Ingria Robert. Schwartz, Richard, "Hidden Understanding Models of Natural Language". 25-32. ACL Proc. of 32nd Annual Meeting, 1994 [discussed on Jan. 20, 1995] Dresher, E. and Kaye, J. (1990) "A computational learning model for metrical phonology" Cognition 34, 137-195 [discussed on Febr. 3, 1995] Gupta, P. and Touretzky, "Connectionist Models and Linguistic Theory: Invesitigations of Stress Systems in Language" Cognitive Science, 18,1, January, 1994. [discussed on Febr. 17, 1995] Daelemans, Gillis, & Durieux, The Acquisition of Stress: A Data Oriented Approach, Computational Linguistics, 20,3, Sept 1994. [discussed on Mar. 3, 1995] Gasser, Michael. "Acquiring Receptive Morphology: A Connectionist Model". 279-86. ACL Proc. of 32nd Annual Meeting, 1994 [discussed on Mar. 24, 1995] Diane J. Litman: "Classifying Cue Phrases in text and Speech using Machine Learning", AAAI94, Vol. I, pp. 806-813 [discussed on Mar. 24, 1995] Eric V. Siegel and Kathleen R. McKeown: "Emergent Linguistic Rules from Inducing Decision Trees: Disambiguating Discourse Clue Words" AAAI 94, Vol. I, pp. 820-826 [discussed on April 7, 1995] Leacock, Towell and Voorhees: "Towards Building Contextual Representations of Word Senses Using Statistical Models" in personal files of Cindi Thompson, from one of the authors [discussed on April 21, 1995] Pat Langley: "Simplicity and Representation Change in Grammar Induction" [From the author via John Zelle, 1995; submitted to the special issue of Machine Learning on Bias Evaluation and Selection; 19 pages] [discussed on May 5, 1995] Garrison W. Cottrell and Kim Plunkett (1994). Acquiring the Mapping from Meaning to Sounds. Connection Science 6:379--412. [discussed on May 19, 1995] Evaluating Automated and Manual Acquisition of Anaphora Resolution Startegies, C. Aone and S. Bennett, to appear ACL-95 [Uses C4.5 to learn decision trees for resolving anaphora.] [~mooney/papers-others/aone-acl95.ps] [discussed on June 2, 1995] David M. Magerman: "Statistical Decision-Tree Models for Parsing" To appear in ACL95 [available at http://xxx.lanl.gov/cmp-lg/ with search for author magerman] [discussed on August 3, 1995] Roland Kuhn & Renato De More: "The Application of Semantic Classification Trees to Natural Language Understanding" IEEE, PAMI 17/5, May 1995