A Novel Scheme for Improving Accuracy of KNN Classification Algorithm Based on the New Weighting Technique and Stepwise Feature Selection

Q: How can I download an article?

To download an article from SID, first log in to the site, search for the article title, and click on the 'Download Article' option.

Q: How can I download an ISI article?

To download an ISI article on SID, enter the keyword or article title in the search bar, view the relevant results, click on the desired article, and select the 'Download Article' option.

Q: How can I access the SID database?

To access the SID database, visit SID.ir, create an account, and log in to access scientific resources.

Q: Is downloading articles from SID free?

Some articles on SID are available for free, while others require payment. Details are specified on the article's page.

Sheikhi Saeid; Kheirabadi Mohammad Taghi; Bazzazi Amin

مرکز اطلاعات علمی Scientific Information Database (SID) - Trusted Source for Research and Academic Resources

Journal Paper

Paper Information

Journal: Journal of Information Technology Management Year:2020 | Volume:12 | Issue:4 Page(s): 90-104

Download Full-Text

View:

159

Download:

153

Cites:

Information Journal Paper

Title

A Novel Scheme for Improving Accuracy of KNN Classification Algorithm Based on the New Weighting Technique and Stepwise Feature Selection

Author(s)

Sheikhi Saeid | Kheirabadi Mohammad Taghi | Bazzazi Amin | Issue Writer Certificate

Keywords

Data mining

KNN algorithm

Classification algorithm

Weighted KNN

Abstract

K nearest neighbor algorithm is one of the most frequently used techniques in Data mining for its integrity and performance. Though the KNN algorithm is highly effective in many cases, it has some essential deficiencies, which affects the classification accuracy of the algorithm. First, the effectiveness of the algorithm is affected by redundant and irrelevant features. Furthermore, this algorithm does not consider the differences between samples, which led the algorithm to have inaccurate predictions. In this paper, we proposed a novel scheme for improving the accuracy of the KNN Classification algorithm based on the new weighting technique and stepwise feature selection. First, we used a stepwise feature selection method to eliminate irrelevant features and select highly correlated features with the class category. Then a new weighting method was proposed to give authority value to each sample in train dataset based on neighbor categories and Euclidean distances. This weighting approach gives a higher preference to samples that have neighbors with close Euclidean distance while they are in the same category, which can effectively increase the classification accuracy of the algorithm. We evaluated the accuracy rate of the proposed method and analyzed it with the traditional KNN algorithm and some similar works with the use of five real-world UCI datasets. The experiment results determined that the proposed scheme (denoted by WAD-KNN) performed better than the traditional KNN algorithm and considered approaches with the improvement of approximately 10% accuracy.

Multimedia

No record.

Cites

No record.

References

No record.

Cite

APA: Copy

Sheikhi, Saeid, Kheirabadi, Mohammad Taghi, & Bazzazi, Amin. (2020). A Novel Scheme for Improving Accuracy of KNN Classification Algorithm Based on the New Weighting Technique and Stepwise Feature Selection. JOURNAL OF INFORMATION TECHNOLOGY MANAGEMENT, 12(4), 90-104. SID. https://sid.ir/paper/677311/en

Vancouver: Copy

Sheikhi Saeid, Kheirabadi Mohammad Taghi, Bazzazi Amin. A Novel Scheme for Improving Accuracy of KNN Classification Algorithm Based on the New Weighting Technique and Stepwise Feature Selection. JOURNAL OF INFORMATION TECHNOLOGY MANAGEMENT[Internet]. 2020;12(4):90-104. Available from: https://sid.ir/paper/677311/en

IEEE: Copy

Saeid Sheikhi, Mohammad Taghi Kheirabadi, and Amin Bazzazi, “A Novel Scheme for Improving Accuracy of KNN Classification Algorithm Based on the New Weighting Technique and Stepwise Feature Selection,” JOURNAL OF INFORMATION TECHNOLOGY MANAGEMENT, vol. 12, no. 4, pp. 90–104, 2020, [Online]. Available: https://sid.ir/paper/677311/en

Related Journal Papers

No record.

Related Seminar Papers

No record.

Related Plans

No record.

Recommended Workshops