Part Of Speech Tagging of Persian Language using Fuzzy Network Model

Q: How can I download an article?

To download an article from SID, first log in to the site, search for the article title, and click on the 'Download Article' option.

Q: How can I download an ISI article?

To download an ISI article on SID, enter the keyword or article title in the search bar, view the relevant results, click on the desired article, and select the 'Download Article' option.

Q: How can I access the SID database?

To access the SID database, visit SID.ir, create an account, and log in to access scientific resources.

Q: Is downloading articles from SID free?

Some articles on SID are available for free, while others require payment. Details are specified on the article's page.

Badpeima Mohammad; HOURALI FATEMEH; HOURALI MARYAM

مرکز اطلاعات علمی Scientific Information Database (SID) - Trusted Source for Research and Academic Resources

Journal Paper

Paper Information

Journal: SIGNAL AND DATA PROCESSING Year:2019 | Volume:15 | Issue:4 (38) Page(s): 123-130

Download Full-Text

Persian Verion

View:

638

Download:

Cites:

Information Journal Paper

Title

Part Of Speech Tagging of Persian Language using Fuzzy Network Model

Author(s)

Badpeima Mohammad | HOURALI FATEMEH | HOURALI MARYAM | Issue Writer Certificate

Keywords

Natural language processingQ2

Part of speech (POS) taggingQ1

Persian languageQ2

FuzzyQ2

Neural networkQ1

Abstract

Part of speech tagging (POS tagging) is an ongoing research in Natural language processing (NLP) applications. The process of classifying words into their parts of speech and labeling them accordingly is known as part-of-speech tagging, POS-tagging, or simply tagging. Parts of speech are also known as word classes or lexical categories. The purpose of POS tagging is determining the grammatical category of the words in a sentence. Grammatical and syntactical features of words are determined based on these tags. The function of existing tagging methods depends on the corpus. As if the educational and test data are extracted from a corpus, the methods are well-functioning, or if the number of educational data is low, especially in probabilistic methods, the accuracy level also decreases. The words used in sentences are often vague. For example, the word 'Mahrami' can be a noun or an adjective. Existing ambiguity can be eliminated by using neighbor words and an appropriate tagging method. Methods in this domain are divided into several categories such as: based on memory [2], rule based methods [5], statistical [6], and Neural network [7]. The precision of more of these methods is an average of 95% [1]. In the paper [13], using the TnT probabilistic tagging and smoothing and variations on the estimation of the three-words likelihood function, a tagging model has been created that has reached 96. 7% in total on the Penn Treebank and NEGRA entities. [14] Using the representation of the dependency network and extensive use of lexical features, such as the conditional continuity of the sequence of words, as well as the effective use of the foreground in the linear models of linear logarithms and fine-grained modeling of the unknown words, on the Penn Treebank WSJ model, 97. 24% accuracy is achieved. The first work in Farsi that has used the word neighborhoods and the similarity distribution between them. The accuracy of the system is 57. 5%. In [19], a Persian open source tagger called HunPoS was proposed. This tag uses the same TnT method based on the Hidden Markov model and a triple sequence of words, and 96. 9% has reached on the ''Bi Jen Khan'' corpus. In this paper a statistical based method is proposed for Persian POS tagging. The limitations of statistical methods are reduced by introducing a Fuzzy network model, such that the model is able to estimate more reliable parameters with a small set of training data. In this method, normalization is done as a preprocessing step and then the frequency of each word is estimated as a Fuzzy function with respect to the corresponding tag. Then the Fuzzy network model is formed and the weight of each edge is determined by means of a Neural network and a membership function. Eventually, after the construction of a Fuzzy network model for a sentence, the Viterbi algorithm as s subset of Hidden Markov Model (HMM) algorithms is used to specify the most probable path in the network. The goal of this paper is to solve a challenge of probabilistic methods when the data is low and estimation made by these models is mistaken. The results of testing this method on ``Bi Jen Khan'' corpus verified that the proposed method has better performance than similar methods, like hidden Markov model, when fewer training examples are available. In this experiment, several times the data is divided into two groups of training and test with different sizes ascending. On the other hand, in the initial experiments, we reduced the train data size and, in subsequent experiments, increased its size and compared with the HMM algorithm. As shown in figure 4, the train and test set and are directly related to each other, as the error rate decreases with increasing the training set and vice versa. In tests, three criteria involving precision, recall and F1 have been used. In Table 4, the implementation of HMM models and a Fuzzy network is compared with each other and the results are shown.

Cites

No record.

References

No record.

Cite

APA: Copy

Badpeima, Mohammad, HOURALI, FATEMEH, & HOURALI, MARYAM. (2019). Part Of Speech Tagging of Persian Language using Fuzzy Network Model. SIGNAL AND DATA PROCESSING, 15(4 (38) ), 123-130. SID. https://sid.ir/paper/160855/en

Vancouver: Copy

Badpeima Mohammad, HOURALI FATEMEH, HOURALI MARYAM. Part Of Speech Tagging of Persian Language using Fuzzy Network Model. SIGNAL AND DATA PROCESSING[Internet]. 2019;15(4 (38) ):123-130. Available from: https://sid.ir/paper/160855/en

IEEE: Copy

Mohammad Badpeima, FATEMEH HOURALI, and MARYAM HOURALI, “Part Of Speech Tagging of Persian Language using Fuzzy Network Model,” SIGNAL AND DATA PROCESSING, vol. 15, no. 4 (38) , pp. 123–130, 2019, [Online]. Available: https://sid.ir/paper/160855/en

Related Journal Papers