TY - JOUR
T1 - Assessing medical student competency in communication in the pre-clinical phase
T2 - Objective structured video exam and SP exam
AU - Karabilgin, Ozlem Surel
AU - Vatansever, Kevser
AU - Caliskan, Suleyman Ayhan
AU - Durak, Halil Ibrahim
PY - 2012/6
Y1 - 2012/6
N2 - Objective: The aim of our study was to present the structure, process and results of the objective structured video exam and One-Station standardized patient exam that have been used to assess second year medical students' communication skills. Methods: Scores of 1137 students between the years 2007 and 2010 were analyzed. Means and standard deviations were calculated for scores and ratings. Internal consistency was assessed using Cronbach's alpha coefficient. To analyze reliability and generalizability, multivariate generalizability theory was employed. Results: Students' total and item scores on the objective structured video exam (60.5-68.8) were lower than on the One-Station standardized patient exam (90.4-96.6). Internal consistencies of both exams were moderate. Generalizability analysis and D-study results showed that both the objective structured video exam and the One-Station standardized patient exam need improvement. Conclusion: Both exams need measures to improve them, such as increasing the number of video cases or stations, and further standardization of raters. Practice Implications: This study might encourage medical teachers to consider assessing validity and reliability of written and performance exams on the basis of generalizability theory, and to find out feasible actions to improve assessment procedures by conducting a D-study.
AB - Objective: The aim of our study was to present the structure, process and results of the objective structured video exam and One-Station standardized patient exam that have been used to assess second year medical students' communication skills. Methods: Scores of 1137 students between the years 2007 and 2010 were analyzed. Means and standard deviations were calculated for scores and ratings. Internal consistency was assessed using Cronbach's alpha coefficient. To analyze reliability and generalizability, multivariate generalizability theory was employed. Results: Students' total and item scores on the objective structured video exam (60.5-68.8) were lower than on the One-Station standardized patient exam (90.4-96.6). Internal consistencies of both exams were moderate. Generalizability analysis and D-study results showed that both the objective structured video exam and the One-Station standardized patient exam need improvement. Conclusion: Both exams need measures to improve them, such as increasing the number of video cases or stations, and further standardization of raters. Practice Implications: This study might encourage medical teachers to consider assessing validity and reliability of written and performance exams on the basis of generalizability theory, and to find out feasible actions to improve assessment procedures by conducting a D-study.
KW - Assessment
KW - Communication skills
KW - Generalizability theory
KW - Objective structured video exam
KW - Simulated patient
UR - http://www.scopus.com/inward/record.url?scp=84861236004&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84861236004&partnerID=8YFLogxK
U2 - 10.1016/j.pec.2011.10.008
DO - 10.1016/j.pec.2011.10.008
M3 - Article
C2 - 22169634
AN - SCOPUS:84861236004
SN - 0738-3991
VL - 87
SP - 293
EP - 299
JO - Patient Education and Counseling
JF - Patient Education and Counseling
IS - 3
ER -