Design and implementation of Persian spelling detection and correction system based on Semantic

Q: How can I download an article?

To download an article from SID, first log in to the site, search for the article title, and click on the 'Download Article' option.

Q: How can I download an ISI article?

To download an ISI article on SID, enter the keyword or article title in the search bar, view the relevant results, click on the desired article, and select the 'Download Article' option.

Q: How can I access the SID database?

To access the SID database, visit SID.ir, create an account, and log in to access scientific resources.

Q: Is downloading articles from SID free?

Some articles on SID are available for free, while others require payment. Details are specified on the article's page.

Dastgheib Mohammad Bagher; Koleini Sara; FAKHRAHMAD SEYED MOSTAFA

مرکز اطلاعات علمی Scientific Information Database (SID) - Trusted Source for Research and Academic Resources

Journal Paper

Paper Information

Journal: SIGNAL AND DATA PROCESSING Year:2019 | Volume:16 | Issue:3 (41) Page(s): 117-127

Download Full-Text

Persian Verion

View:

649

Download:

Cites:

Information Journal Paper

Title

Design and implementation of Persian spelling detection and correction system based on Semantic

Author(s)

Dastgheib Mohammad Bagher | Koleini Sara | FAKHRAHMAD SEYED MOSTAFA | Issue Writer Certificate

Keywords

Spell Error DetectionQ1

Spell Error CorrectionQ1

Persian spell CheckerQ1

NLPQ2

Persian Language ModelQ1

Abstract

Persian Language has a special feature (grapheme, homophone, and multi-shape clinging characters) in electronic devices. Furthermore, design and implementation of NLP tools for Persian are more challenging than other languages (e. g. English or German). Spelling tools are used widely for editing user texts like emails and text in editors. Also developing Persian tools will provide Persian programs to check spell and reduce errors in electronic texts. In this work, we review the spelling detection and correction methods, especially for the Persian language. The proposed algorithm consists of two steps. The first step is non-word error detection and correction by intelligent scoring algorithm. The second step is read-word error detection and correction. We propose a spelling system "Perspell” for Persian non-word and real-word errors using a hybrid scoring system and optimized language model by lexicon. This scoring system uses a combination of lexical and semantic features optimized by learning dataset. The weight of these features in scoring system is also optimized by learning phase. Perspell is compared with known Persian spellchecker systems and could overcome them in precision of detection and correction. Accordingly, the proposed Persian spell-checker system can also detect and correct real-word errors. This open challenge category of spelling is a complicated and time consuming task in Persian as well as, assessing the proposed method, the F-measure metric has improved significantly (about 10%) for detecting and correcting Persian words. In the proposed method, we used Persian Language Model with bootstrapping and smoothing to overcome data sparseness and lack of data. The bootstrapping is developed using a Persian dictionary and further we used word sense disambiguation to select the correct related replaced word.

Cites

No record.

References

No record.

Cite

APA: Copy

Dastgheib, Mohammad Bagher, Koleini, Sara, & FAKHRAHMAD, SEYED MOSTAFA. (2019). Design and implementation of Persian spelling detection and correction system based on Semantic. SIGNAL AND DATA PROCESSING, 16(3 (41) ), 117-127. SID. https://sid.ir/paper/160767/en

Vancouver: Copy

Dastgheib Mohammad Bagher, Koleini Sara, FAKHRAHMAD SEYED MOSTAFA. Design and implementation of Persian spelling detection and correction system based on Semantic. SIGNAL AND DATA PROCESSING[Internet]. 2019;16(3 (41) ):117-127. Available from: https://sid.ir/paper/160767/en

IEEE: Copy

Mohammad Bagher Dastgheib, Sara Koleini, and SEYED MOSTAFA FAKHRAHMAD, “Design and implementation of Persian spelling detection and correction system based on Semantic,” SIGNAL AND DATA PROCESSING, vol. 16, no. 3 (41) , pp. 117–127, 2019, [Online]. Available: https://sid.ir/paper/160767/en

Related Journal Papers