• shareshare
  • link
  • cite
  • add
auto_awesome_motion View all 8 versions
Publication . Article . Preprint . 2021

Modeling Morphology With Linear Discriminative Learning: Considerations and Design Choices

Maria Heitmeier; Yu-Ying Chuang; R. Harald Baayen;
Open Access
Published: 15 Nov 2021 Journal: Frontiers in Psychology, volume 12 (issn: 1664-1078, Copyright policy )
Publisher: Frontiers Media SA

This study addresses a series of methodological questions that arise when modeling inflectional morphology with Linear Discriminative Learning. Taking the semi-productive German noun system as example, we illustrate how decisions made about the representation of form and meaning influence model performance. We clarify that for modeling frequency effects in learning, it is essential to make use of incremental learning rather than the endstate of learning. We also discuss how the model can be set up to approximate the learning of inflected words in context. In addition, we illustrate how in this approach the wug task can be modeled in considerable detail. In general, the model provides an excellent memory for known words, but appropriately shows more limited performance for unseen data, in line with the semi-productivity of German noun inflection and generalization performance of native German speakers.

Comment: 38 pages, 5 figures, 10 tables; acknowledgements added

Subjects by Vocabulary

Microsoft Academic Graph classification: Context (language use) Representation (mathematics) Semantic role labeling Noun Artificial intelligence business.industry business Natural language processing computer.software_genre computer Generalization Set (psychology) Inflection German language.human_language language Psychology

ACM Computing Classification System: InformationSystems_INFORMATIONSTORAGEANDRETRIEVAL


General Psychology, German nouns, linear discriminative learning, semi-productivity, multivariate multiple regression, Widrow-Hoff learning, frequency of occurrence, Psychology, BF1-990, Original Research, semantic roles, wug task, Computation and Language (cs.CL), FOS: Computer and information sciences, Computer Science - Computation and Language

71 references, page 1 of 8

Ackerman, F. and Malouf, R. (2013). Morphological organization: The low conditional entropy conjecture. Language, 89(3):429{464.

Albright, A. and Hayes, B. (2003). Rules vs. analogy in English past tenses: A computational/experimental study. Cognition, 90:119{161.

Arndt-Lappe, S. (2011). Towards an exemplar-based model of stress in english noun-noun compounds. Journal of Linguistics, pages 549{585. [OpenAIRE]

Baayen, R. H., Chuang, Y.-Y., and Blevins, J. P. (2018). In ectional morphology with linear mappings. The Mental Lexicon, 13(2):232{270.

Baayen, R. H., Chuang, Y.-Y., Shafaei-Bajestan, E., and Blevins, J. (2019). The discriminative lexicon: A uni ed computational model for the lexicon and lexical processing in comprehension and production grounded not in (de)composition but in linear discriminative learning. Complexity. [OpenAIRE]

Baayen, R. H., Dijkstra, T., and Schreuder, R. (1997). Singulars and plurals in Dutch: Evidence for a parallel dual route model. Journal of Memory and Language, 36:94{117. [OpenAIRE]

Baayen, R. H., Milin, P., Filipovic Durdevic, D., Hendrix, P., and Marelli, M. (2011). An amorphous model for morphological processing in visual comprehension based on naive discriminative learning. Psychological Review, 118:438{482. [OpenAIRE]

Baayen, R. H., Milin, P., and Ramscar, M. (2016). Frequency in lexical processing. Aphasiology, 30(11):1174{1220. [OpenAIRE]

Baayen, R. H., Piepenbrock, R., and Gulikers, L. (1995). The CELEX lexical database [cd rom]. Philadelphia: Linguistic Data Consortium, University of Pennsylvania.

Baayen, R. H., Wurm, L. H., and Aycock, J. (2007). Lexical dynamics for low-frequency complex words. a regression study across tasks and modalities. The Mental Lexicon, 2:419{463.

Funded by
Wide Incremental learning with Discrimination nEtworks
  • Funder: European Commission (EC)
  • Project Code: 742545
  • Funding stream: H2020 | ERC | ERC-ADG
Validated by funder
Related to Research communities
Digital Humanities and Cultural Heritage
Download fromView all 8 sources