Feature Extraction and Efficiency Comparison Using Dimension Reduction Methods in Sentiment Analysis Context

Q: How can I download an article?

To download an article from SID, first log in to the site, search for the article title, and click on the 'Download Article' option.

Q: How can I download an ISI article?

To download an ISI article on SID, enter the keyword or article title in the search bar, view the relevant results, click on the desired article, and select the 'Download Article' option.

Q: How can I access the SID database?

To access the SID database, visit SID.ir, create an account, and log in to access scientific resources.

Q: Is downloading articles from SID free?

Some articles on SID are available for free, while others require payment. Details are specified on the article's page.

Baradaran Razieh; GOLPAR RABOKY EFFAT

مرکز اطلاعات علمی Scientific Information Database (SID) - Trusted Source for Research and Academic Resources

Journal Paper

Paper Information

Journal: SIGNAL AND DATA PROCESSING Year:2019 | Volume:16 | Issue:3 (41) Page(s): 79-88

Download Full-Text

Persian Verion

View:

594

Download:

Cites:

Information Journal Paper

Title

Feature Extraction and Efficiency Comparison Using Dimension Reduction Methods in Sentiment Analysis Context

Author(s)

Baradaran Razieh | GOLPAR RABOKY EFFAT | Issue Writer Certificate

Keywords

Natural Language ProcessingQ2

Sentiment AnalysisQ1

Opinion MiningQ1

Auto-EncoderQ1

Singular Value DecompositionQ1

Nonnegative Matrix FactorizationQ1

Abstract

Nowadays, users can share their ideas and opinions with widespread access to the Internet and especially social networks. On the other hand, the analysis of people's feelings and ideas can play a significant role in the decision making of organizations and producers. Hence, Sentiment Analysis or Opinion Mining is an important field in Natural Language Processing. One of the most common ways to solve such problems is machine learning methods, which creates a model for mapping features to the desired output. One challenge of using machine learning methods in NLP fields is feature selection and extraction among a large number of early features to achieve models with high accuracy. In fact, the high number of features not only cause computational and temporal problems but also have undesirable effects on model accuracy. Studies show that different methods have been used for feature extraction or selection. Some of these methods are based on selecting important features from feature sets such as Principal Component Analysis (PCA) based methods. Some other methods map original features to new ones with less dimensions but with the same semantic relations like neural networks. For example, sparse feature vectors can be converted to dense embedding vectors using neural network-based methods. Some others use feature set clustering methods and extract less dimension features set like NMF based methods. In this paper, we compare the performance of three methods from these different classes in different dataset sizes. In this study, we use two compression methods using Singular Value Decomposition (SVD) that is based on selecting more important attributes and non-Negative Matrix Factorization (NMF) that is based on clustering early features and one Auto-Encoder based method which convert early features to new feature set with the same semantic relations. We compare these methods performance in extracting more effective and fewer features on Sentiment Analysis task in the Persian dataset. Also, the impact of the compression level and dataset size on the accuracy of the model has been evaluated. Studies show that compression not only reduces computational and time costs but can also increase the accuracy of the model. For experimental analysis, we use the Sentipers dataset that contains more than 19000 samples of user opinions about digital products and sample representation is done with bag-of-words vectors. The size of bag-of-words vectors or feature vectors is very large because it is the same as vocabulary size. We set up our experiment with 4 sub-datasets with different sizes and show the effect of different compression performance on various compression levels (feature count) based on the size of dataset size. According to experiment results of classification with SVM, feature compression using the neural network from 7700 to 2000 features not only increases the speed of processing and reduces storage costs but also increases the accuracy of the model from 77. 05% to 77. 85% in the largest dataset contains about 19000 samples. Also in the small dataset, the SVD approach can generate better results and by 2000 features from 7700 original features can obtain 63. 92 % accuracy compared to 63. 57 % early accuracy. Furthermore, the results indicate that compression based on neural network in large dataset with low dimension feature sets is much better than other approaches, so that with only 100 features extracted by neural network-based Auto-Encoder, the system achieves acceptable 74. 46% accuracy against SVD accuracy 67. 15% and NMF accuracy 64. 09% and the base model accuracy 77. 05% with 7700 features.

Cites

No record.

References

No record.

Cite

APA: Copy

Baradaran, Razieh, & GOLPAR RABOKY, EFFAT. (2019). Feature Extraction and Efficiency Comparison Using Dimension Reduction Methods in Sentiment Analysis Context. SIGNAL AND DATA PROCESSING, 16(3 (41) ), 79-88. SID. https://sid.ir/paper/160771/en

Vancouver: Copy

Baradaran Razieh, GOLPAR RABOKY EFFAT. Feature Extraction and Efficiency Comparison Using Dimension Reduction Methods in Sentiment Analysis Context. SIGNAL AND DATA PROCESSING[Internet]. 2019;16(3 (41) ):79-88. Available from: https://sid.ir/paper/160771/en

IEEE: Copy

Razieh Baradaran, and EFFAT GOLPAR RABOKY, “Feature Extraction and Efficiency Comparison Using Dimension Reduction Methods in Sentiment Analysis Context,” SIGNAL AND DATA PROCESSING, vol. 16, no. 3 (41) , pp. 79–88, 2019, [Online]. Available: https://sid.ir/paper/160771/en

Related Journal Papers