Original Research

Inter-examiner reliability when using the Objective Structured Practical Examination (OSPE) mark sheet for physiotherapy practical

B. Olivier, V. Naidoo, C. Humphries, L. Godlwana, M. Romm, V. Ntsiea, H. van Aswegen, H. Myezwa, R. Roos, W. Mudzi, J. Potterton, B Watt, D. Maleka, S. Mtshali, A. Stewart
South African Journal of Physiotherapy | Vol 69, No 4 | a375 | DOI: https://doi.org/10.4102/sajp.v69i4.375 | © 2013 B. Olivier, V. Naidoo, C. Humphries, L. Godlwana, M. Romm, V. Ntsiea, H. van Aswegen, H. Myezwa, R. Roos, W. Mudzi, J. Potterton, B Watt, D. Maleka, S. Mtshali, A. Stewart | This work is licensed under CC Attribution 4.0
Submitted: 14 November 2013 | Published: 16 January 2013

About the author(s)

B. Olivier, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand
V. Naidoo, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa
C. Humphries, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa
L. Godlwana, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa
M. Romm, King’s College London, United Kingdom
V. Ntsiea, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa
H. van Aswegen, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa
H. Myezwa, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa
R. Roos, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa
W. Mudzi, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa
J. Potterton, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa
B Watt, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa
D. Maleka, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa
S. Mtshali, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa
A. Stewart, Physiotherapy Department, Faculty of Health Sciences, University of the Witwatersrand, South Africa

Full Text:

PDF (568KB)

Abstract

The Objective Structured Practical Examination (OSPE) format is used during practical examinations as part of the physiotherapy undergraduate curriculum at the University of the Witwatersrand. Various factors influence inter-examiner reliability and investigating the inter-examiner reliability when using the OSPE can lead to improvement of the examination process. The aim of this study was to establish inter-examiner reliability when using the OSPE mark sheet. Methods: Twelve examiners participated in this study. Thirty-three second year PT students were examined at six stations and by two examiners at each station. The Spearman’s correlation test was used to establish inter-examiner reliability. Results: The general inter-examiner reliability of the OSPE mark sheet was high. There was a high correlation between examiners who had the same level of experience (r=0.79 to r=0.93; p<0.001). The background knowledge section of the OSPE mark sheet showed the greatest inter-examiner reliability (r=0.75 to r=0.91; p<0.001). Discussion: In general, a high inter-examiner reliability was found. Examiners with the same level of experience seemed to generally have better inter-examiner reliability when using the OSPE mark sheet. Furthermore, a well-described, operationalised list of micro-skills also improved inter-examiner reliability. Conclusion: The OSPE mark sheet aids inter-examiner reliability. The use of this method of examination should be encouraged.

Keywords

Objective structured practical examinations; Inter-examiner reliability, Practical skills; Health sciences

Metrics

Total abstract views: 2112
Total article views: 1390


Crossref Citations

No related citations found.