Actions
  • shareshare
  • link
  • cite
  • add
add
Other research product . 2021

Grammatical Categories Determination for Turkish and Kazakh Languages Based on Machine Learning Algorithms and Fulfilling Dictionaries of Link Grammar Parser

Yerimbetova, A. (Aigerim); Tussupova, M. (Madina); Sambetbayeva, M. (Madina); Turdalyuly, M. (Mussa); Sakenov, B. (Bakzhan);
Open Access
Indonesian
Published: 01 Jan 2021
Publisher: PC TECHNOLOGY CENTER
Country: Indonesia
Abstract
This research is aimed at identifying the parts of speech for the Kazakh and Turkish languages in an information retrieval system. The proposed algorithms are based on machine learning techniques. In this paper, we consider the binary classification of words according to parts of speech. We decided to take the most popular machine learning algorithms. In this paper, the following approaches and well-known machine learning algorithms are studied and considered. We defined 7 dictionaries and tagged 135 million words in Kazakh and 9 dictionaries and 50 million words in the Turkish language. The main problem considered in the paper is to create algorithms for the execution of dictionaries of the so-called Link Grammar Parser (LGP) system, in particular for the Kazakh and Turkish languages, using machine learning techniques. The focus of the research is on the review and comparison of machine learning algorithms and methods that have accomplished results on various natural language processing tasks such as grammatical categories determination. For the operation of the LGP system, a dictionary is created in which a connector for each word is indicated – the type of connection that can be created using this word. The authors considered methods of filling in LGP dictionaries using machine learning. The complexities of natural language processing, however, do not exclude the possibility of identifying narrower tasks that can already be solved algorithmically: for example, determining parts of speech or splitting texts into logical groups. However, some features of natural languages significantly reduce the effectiveness of these solutions. Thus, taking into account all word forms for each word in the Kazakh and Turkish languages increases the complexity of text processing by an order of magnitude
Subjects

обработка естественного языка, часть речи, агглютинативный язык, Word2vec, обробка природної мови, частина мови, алгоритми машинного навчання, аглютинативна мова, natural language processing, part-of-speech, machine learning algorithms, agglutinative language, Indonesia, алгоритмы машинного обучения

Related Organizations
Related to Research communities
Digital Humanities and Cultural Heritage
Download from
lock_open
Neliti
2021
Providers: Neliti
moresidebar