Measuring Similarities between Open Peer Review Comments and Contents of Scientific Articles: a Natural Language Processing Technique Inquiry

Q: How can I download an article?

To download an article from SID, first log in to the site, search for the article title, and click on the 'Download Article' option.

Q: How can I download an ISI article?

To download an ISI article on SID, enter the keyword or article title in the search bar, view the relevant results, click on the desired article, and select the 'Download Article' option.

Q: How can I access the SID database?

To access the SID database, visit SID.ir, create an account, and log in to access scientific resources.

Q: Is downloading articles from SID free?

Some articles on SID are available for free, while others require payment. Details are specified on the article's page.

Rashidi Sharifabad k.; Sotodeh h.; MIRZABEIGI M.; Fakhrahmad s.Mostafa

مرکز اطلاعات علمی Scientific Information Database (SID) - Trusted Source for Research and Academic Resources

Journal Paper

Paper Information

Journal: LIBRARIANSHIP AND INFORMATION ORGANIZATION STUDIES (JOURNAL OF NATIONAL STUDIES ON LIBRARIANSHIP AND INFORMATION ORGANIZATION) Year:2020 | Volume:31 | Issue:2 (122) Page(s): 86-103

Download Full-Text

View:

Download:

Cites:

Information Journal Paper

Title

Measuring Similarities between Open Peer Review Comments and Contents of Scientific Articles: a Natural Language Processing Technique Inquiry

Author(s)

Rashidi Sharifabad k. | Sotodeh h. | MIRZABEIGI M. | Fakhrahmad s.Mostafa | Issue Writer Certificate

Keywords

Comments

Peer reviewing

Natural language processing

Similarity

ROC curve analysis

Abstract

Purpose: The social web provides a platform for publicizing open peer review reports. In this sphere, journal readers, authors, editors, and reviewers can involve in multilateral discussions on the reviewed papers and share their Comments and viewpoints on the merits and probable pitfalls of papers. Open peer review Comments may, hence, reflect the features of their mother articles. To identify this potential, the present study investigates to what extent similar Comments accurately predict similar papers. Methodology: Applying Natural language processing techniques, it analyzes the contents of a sample of papers in medicine and life sciences and the Comments received by them. To do so, a test collection is built from the papers openly published on F1000Research, an open access publishing platform that adheres to an open Peer reviewing process by transparently providing the public with peer review reports, authors’ responses, and users’ Comments. The test collection consists of 2212 papers and their Comments. 100 papers are randomly selected as seed documents that serve as queries. The similarities between the Comments and the contents of the papers are calculated using Cosine Similarity of TF-IDF values. The TF-IDF values are calculated for both unigrams and bigrams extracted from the contents and Comments. The correlation between the content and comment similarities is analyzed using Spearman correlation, given the non-normality of the data distributions. The accuracy of prediction of the papers’ content Similarity by the Similarity of their Comments is tested using Receiver Operating Characteristic (ROC) curves. Findings: The results of the Spearman correlation revealed a significant correlation between the content and comment similarities. This signifies that similar papers are more likely to receive similar Comments and vice versa. The ROC curves show that similar Comments can significantly identify similar papers, either at unigram or bigram level. The prediction is highly accurate. Conclusion: Similar Comments are effective in representing similar papers. In other words, similar Comments are expected to present similar papers. This finding has implications for interactive information retrieval systems, where users are interested in reading experts’ Comments on a given paper before viewing or downloading the paper itself. The findings also may pave the path towards new studies about the application of the Comments in such spheres as information retrieval, evaluation or classification, where content Similarity is of importance.

Cites

The Potentials of Cochrane Reviewers' Comments and Citation Contexts in the Recognition of Randomized Controlled Trials' Texts and their Main Sections

References

No record.

Cite

APA: Copy

Rashidi Sharifabad, k., Sotodeh, h., MIRZABEIGI, M., & Fakhrahmad, s.Mostafa. (2020). Measuring Similarities between Open Peer Review Comments and Contents of Scientific Articles: a Natural Language Processing Technique Inquiry. LIBRARIANSHIP AND INFORMATION ORGANIZATION STUDIES (JOURNAL OF NATIONAL STUDIES ON LIBRARIANSHIP AND INFORMATION ORGANIZATION), 31(2 (122) ), 86-103. SID. https://sid.ir/paper/681412/en

Vancouver: Copy

Rashidi Sharifabad k., Sotodeh h., MIRZABEIGI M., Fakhrahmad s.Mostafa. Measuring Similarities between Open Peer Review Comments and Contents of Scientific Articles: a Natural Language Processing Technique Inquiry. LIBRARIANSHIP AND INFORMATION ORGANIZATION STUDIES (JOURNAL OF NATIONAL STUDIES ON LIBRARIANSHIP AND INFORMATION ORGANIZATION)[Internet]. 2020;31(2 (122) ):86-103. Available from: https://sid.ir/paper/681412/en

IEEE: Copy

k. Rashidi Sharifabad, h. Sotodeh, M. MIRZABEIGI, and s.Mostafa Fakhrahmad, “Measuring Similarities between Open Peer Review Comments and Contents of Scientific Articles: a Natural Language Processing Technique Inquiry,” LIBRARIANSHIP AND INFORMATION ORGANIZATION STUDIES (JOURNAL OF NATIONAL STUDIES ON LIBRARIANSHIP AND INFORMATION ORGANIZATION), vol. 31, no. 2 (122) , pp. 86–103, 2020, [Online]. Available: https://sid.ir/paper/681412/en

Related Journal Papers

No record.

Related Seminar Papers

No record.

Related Plans

No record.

Recommended Workshops