Corpus based coreference resolution for Farsi text

Q: How can I download an article?

To download an article from SID, first log in to the site, search for the article title, and click on the 'Download Article' option.

Q: How can I download an ISI article?

To download an ISI article on SID, enter the keyword or article title in the search bar, view the relevant results, click on the desired article, and select the 'Download Article' option.

Q: How can I access the SID database?

To access the SID database, visit SID.ir, create an account, and log in to access scientific resources.

Q: Is downloading articles from SID free?

Some articles on SID are available for free, while others require payment. Details are specified on the article's page.

Rahimi Zeinab; hosseinnejad shadi

مرکز اطلاعات علمی Scientific Information Database (SID) - Trusted Source for Research and Academic Resources

Journal Paper

Paper Information

Journal: SIGNAL AND DATA PROCESSING Year:2020 | Volume:17 | Issue:1 (43) Page(s): 79-97

Download Full-Text

Persian Verion

View:

764

Download:

Cites:

Information Journal Paper

Title

Corpus based coreference resolution for Farsi text

Author(s)

Rahimi Zeinab | hosseinnejad shadi | Issue Writer Certificate

Keywords

Automatic coreference resolutionQ1

Anaphora resolutionQ1

mentionQ1

Abstract

"Coreference resolution" or "finding all expressions that refer to the same entity" in a text, is one of the important requirements in natural language processing. Two words are coreference when both refer to a single entity in the text or the real world. So the main task of coreference resolution systems is to identify terms that refer to a unique entity. A coreference resolution tool could be used in many natural language processing tasks such as machine translation, automatic text summarization, question answering, and information extraction systems. Adding coreference information can increase the power of natural language processing systems. The coreference resolution can be done through different ways. These methods include heuristic rule-based methods and supervised/unsupervised machine learning methods. Corpus based and machine learning based methods are widely used in coreference resolution task in recent years and has led to a good performance. For using such these methods, there is a need for manually labeled corpus with sufficient size. For Persian language, before this research, there exists no such corpus. One of the important targets here, was producing a through corpus that can be used in coreference resolution task and other associated fields in linguistics and computational linguistics. In this coreference resolution research, a corpus of coreference tagged phrases has been generated (manually annotated) that has about one million words. It also has named entity recognition (NER) tags. Named entity labels in this corpus include 7 labels and in coreference task, all noun phrases, pronouns and named entities have been tagged. Using this corpus, a coreference tool was created using a vector space machine, with precision of about 60% on golden test data. As mentioned before, this article presents the procedure for producing a coreference resolution tool. This tool is produced by machine learning method and is based on the tagged corpus of 900 thousand tokens. In the production of the system, several different features and tools have been used, each of which has an effect on the accuracy of the whole tool. Increasing the number of features, especially semantic features, can be effective in improving results. Currently, according to the sources available in the Persian language, there are no suitable syntactic and semantic tools, and this research suffers from this perspective. The coreference tagged corpus produced in this study is more than 500 times bigger than the previous Persian language corpora and at the same time it is quite comparable to the prominent ACE and Ontonotes corpora. The system produced has an f-measure of nearly 60 according to the CoNLL standard criterion. However, other limited studies conducted in Farsi have provided different accuracy from 40 to 90%, which is not comparable to the present study, because the accuracy of these studies has not been measured with standard criterion in the coreference resolution field.

Cites

No record.

References

No record.

Cite

APA: Copy

Rahimi, Zeinab, & hosseinnejad, shadi. (2020). Corpus based coreference resolution for Farsi text. SIGNAL AND DATA PROCESSING, 17(1 (43) ), 79-97. SID. https://sid.ir/paper/375628/en

Vancouver: Copy

Rahimi Zeinab, hosseinnejad shadi. Corpus based coreference resolution for Farsi text. SIGNAL AND DATA PROCESSING[Internet]. 2020;17(1 (43) ):79-97. Available from: https://sid.ir/paper/375628/en

IEEE: Copy

Zeinab Rahimi, and shadi hosseinnejad, “Corpus based coreference resolution for Farsi text,” SIGNAL AND DATA PROCESSING, vol. 17, no. 1 (43) , pp. 79–97, 2020, [Online]. Available: https://sid.ir/paper/375628/en

Related Journal Papers