A New Statistical Model for Evaluation Interactive Question Answering Systems Using Regression

Q: How can I download an article?

To download an article from SID, first log in to the site, search for the article title, and click on the 'Download Article' option.

Q: How can I download an ISI article?

To download an ISI article on SID, enter the keyword or article title in the search bar, view the relevant results, click on the desired article, and select the 'Download Article' option.

Q: How can I access the SID database?

To access the SID database, visit SID.ir, create an account, and log in to access scientific resources.

Q: Is downloading articles from SID free?

Some articles on SID are available for free, while others require payment. Details are specified on the article's page.

HOSSEINI MOHAMMAD MEHDI; ZAHEDI MORTEZA; HASSANPOUR HAMID

Scientific Information Database (SID) - Trusted Source for Research and Academic Resources

Journal Paper

Paper Information

Journal: SIGNAL AND DATA PROCESSING Year:2019 | Volume:16 | Issue:3 (41) Page(s): 37-48

Download Full-Text

مرکز اطلاعات علمی Scientific Information Database (SID) - Trusted Source for Research and Academic Resources

Persian Verion

View:

397

Download:

Cites:

Information Journal Paper

Title

A New Statistical Model for Evaluation Interactive Question Answering Systems Using Regression

Author(s)

HOSSEINI MOHAMMAD MEHDI | ZAHEDI MORTEZA | HASSANPOUR HAMID | Issue Writer Certificate

Keywords

EvaluationQ1

Interactive Question Answering SystemsQ1

Nonlinear RegressionQ1

Feature ExtractionQ2

Abstract

The development of computer systems and extensive use of information technology in the everyday life of people have just made it more and more important for them to make quick access to information that has received great importance. Increasing the volume of information makes it difficult to manage or control. Thus, some instruments need to be provided to use this information. The QA system is an automated system for obtaining the correct answers to questions posed by the human in the natural language. In these systems, if the response is found, and if it is not the user's expected response or if it needs more information, there is no possibility of exchanging information between the system and the user to ask more questions and get answers related to it. To solve this problem, interactive Question answering (IQA) systems were created. Interactive question answering (IQA) systems are associated with linguistic ambiguous structures, so these systems are more accurate than QA systems. Regarding the probability of ambiguity (ambiguity in the user question or ambiguity in the answer provided by the system), the repetition is possible in these systems to obtain the clarity. No standard methods have been developed on IQA systems Evaluation, and the existing Evaluation methods have been developed based on the methods used in QA and dialogue systems. In evaluating IQA systems, in addition to quantitative Evaluation, a qualitative Evaluation is used. It requires users’ participation in the Evaluation process to determine the success level of interaction between the system and the user. Evaluation plays an important role in the IQA systems. In the context of evaluating IQA systems, there is partially no specific methodology for evaluating these systems in general. The main problem with designing an assessment method for IQA systems lies in the rare possibility to predict the interaction part. To this end, human needs to be involved in the Evaluation process. In this paper, an appropriate model is presented by introducing a set of built-in features for evaluating IQA systems. To conduct the Evaluation process, four IQA systems were considered based on the conversation exchanged between users and systems. Moreover, 540 samples were considered as suitable data to create a test and training set. The statistical characteristics of each conversation were extracted after performing the preprocessing on them. Then a feature matrix was formed based on the obtained characteristics. Finally, using linear and Nonlinear Regression, human thinking was predicted. As a result, the nonlinear power regression with 0. 13 Root Mean Square Error (RMSE) was the best model.

Cites

No record.

References

No record.

Cite

APA: Copy

HOSSEINI, MOHAMMAD MEHDI, ZAHEDI, MORTEZA, & HASSANPOUR, HAMID. (2019). A New Statistical Model for Evaluation Interactive Question Answering Systems Using Regression. SIGNAL AND DATA PROCESSING, 16(3 (41) ), 37-48. SID. https://sid.ir/paper/160772/en

Vancouver: Copy

HOSSEINI MOHAMMAD MEHDI, ZAHEDI MORTEZA, HASSANPOUR HAMID. A New Statistical Model for Evaluation Interactive Question Answering Systems Using Regression. SIGNAL AND DATA PROCESSING[Internet]. 2019;16(3 (41) ):37-48. Available from: https://sid.ir/paper/160772/en

IEEE: Copy

MOHAMMAD MEHDI HOSSEINI, MORTEZA ZAHEDI, and HAMID HASSANPOUR, “A New Statistical Model for Evaluation Interactive Question Answering Systems Using Regression,” SIGNAL AND DATA PROCESSING, vol. 16, no. 3 (41) , pp. 37–48, 2019, [Online]. Available: https://sid.ir/paper/160772/en

Related Journal Papers