Modified Essay Questions (MEQs) are often included in high-stakes examinations to assess higher-order cognitive skills. If the marking guides for MEQs are inadequate, this can lead to inconsistencies in marking. To ensure the reliability of MEQs as a subjective assessment tool, candidates’ responses are typically evaluated by two or more assessors. Previous studies have examined the impact of marker variance. Current study explores the possibility of assigning a single assessor to mark the students' performances in MEQ based on statistically drawn evidence in the clinical phase of the MBBS program at a private medical school in Malaysia. A robust evaluation method was employed to determine whether to continue with two raters or shift to a single-rater scheme for MEQs, using the Discrepancy-Agreement Grading (DAG) System for evaluation. A low standard deviation was observed across all 11 pairs of scores, with insignificant t-statistics (P>0.05) in 2 pairs (18.18%) and significant t-statistics (P<0.05) in 9 pairs (81.81%). The Intraclass Correlation Coefficient (ICC) results were excellent, ranging from .815 to .997, all with P<0.001. Regarding practical effect size (Cohen’s d), 1 pair (9.09%) was categorized as having a strong effect size (>0.8), 7 pairs (63.63%) as having a moderate effect size (0.5-<0.8), and 3 pairs (27.27%) as having a weak effect size (0.2-<0.5). The data analysis suggests that it is feasible to consider marking MEQ items by a single assessor without negatively impacting the reliability of the MEQ as an assessment tool.

Introduction: Abnormal scapular movements and position is related to shoulder dysfunctions. Lateral scapular slide test is used to determine scapular position in coronal plane; however, different studies have shown conflicting results for the reliability of the test in position of 90 degrees of abduction. According to the more functionality of scaption compare to the abduction as well as scaption is a familiar task for athletes, in current study, 90 degrees of scaption was used instead of 90 degrees of abduction and then the reliability of modified lateral scapular slide test (MLSST) was evaluated.Materials and Methods: Fifteen healthy overhead sport-men, aged 20 to 40, were recruited in the study. The minimal vertical distance between inferior angle of scapula and spinous process of T7 was measured by two examiners in one session and by one examiner in the next week using a caliper in neutral position (arm is relaxed at the side), 90 degrees of scaption and 180 degrees of elevation.Results: Reliability in neutral position was maximum (ICC 0.83 to 0.97, good to high). In 90 degrees of scaption, inter-rater and intra-rater reliability were 0.70 to 0.75 and 0.65 to 0.83, respectively. In 180 degrees of elevation, inter-rater reliability was 0.58 and intra-rater reliability was 0.84 to 0.89.Conclusion: 90 degrees of Scaption and 180 degrees of elevation, as a functional position in the athletes, may be used as choice positions in lateral scapular slide test.