INDIGO Home University of Illinois at Urbana-Champaign logo uic building uic pavilion uic student center

Constructing and evaluating a validity argument for the final-year ward simulation exercise.

Show full item record

Bookmark or cite this item:

Files in this item

File Description Format
PDF Constructing and Evaluating.pdf (682KB) Manuscript PDF
Title: Constructing and evaluating a validity argument for the final-year ward simulation exercise.
Author(s): Till H; Ker J; Myford C; Stirling K; Mires G
Subject(s): Clinical ability Clinical performance Evaluating medical students’ fitness to practice Generalizability theory Multi-facet Rasch measurement Score interpretation Simulated ward Simulation in assessment of clinical performance Validity argument Validity evidence
Abstract: The authors report final-year ward simulation data from the University of Dundee Medical School. Faculty who designed this assessment intend for the final score to represent an individual senior medical student's level of clinical performance. The results are included in each student's portfolio as one source of evidence of the student's capability as a practitioner, professional, and scholar. Our purpose in conducting this study was to illustrate how assessment designers who are creating assessments to evaluate clinical performance might develop propositions and then collect and examine various sources of evidence to construct and evaluate a validity argument. The data were from all 154 medical students who were in their final year of study at the University of Dundee Medical School in the 2010-2011 academic year. To the best of our knowledge, this is the first report on an analysis of senior medical students' clinical performance while they were taking responsibility for the management of a simulated ward. Using multi-facet Rasch measurement and a generalizability theory approach, we examined various sources of validity evidence that the medical school faculty have gathered for a set of six propositions needed to support their use of scores as measures of students' clinical ability. Based on our analysis of the evidence, we would conclude that, by and large, the propositions appear to be sound, and the evidence seems to support their proposed score interpretation. Given the body of evidence collected thus far, their intended interpretation seems defensible.
Issue Date: 2015-03-26
Publisher: Springer Verlag
Citation Info: Till, H., Ker, J., Myford, C., Stirling, K. and Mires, G. Constructing and evaluating a validity argument for the final-year ward simulation exercise. Advances in Health Sciences Education. 2015. 20(5): 1263-1289. doi: 10.1007/s10459-015-9601-5.
Type: Article
Description: Post print version of article may differ from published version. The final publication is available at; DOI: 10.1007/s10459-015-9601-5
ISSN: 1382-4996
Date Available in INDIGO: 2016-09-12

This item appears in the following Collection(s)

Show full item record


Country Code Views
United States of America 59
China 31
Ukraine 24
Russian Federation 10
Germany 9


My Account


Access Key