TY - JOUR
T1 - Examining the examiners
T2 - How inexperienced examiners approach the assessment of research theses
AU - Kiley, Margaret
AU - Mullins, Gerry
PY - 2004
Y1 - 2004
N2 - Earlier research by Mullins and Kiley (2002) [Studies in higher education, 27(4), 369-386] reported on the processes that experienced examiners go through when they assess research theses. Since that study two further studies have been undertaken, interviews with novice Australian examiners, reported here, and the analysis of approximately 100 examiners' reports (Kiley, 2004). These studies now allow us to address the comment made by many of the experienced examiners who were interviewed that it was not wise to send a research thesis, particularly one which is not strong, to inexperienced examiners. We also wanted to determine the extent to which less experienced examiners follow the same processes and use the same criteria as their more experienced colleagues, and whether there was any basis for the experienced examiners' comments. This paper draws particularly on the results of the interviews with 26 examiners and supervisors which indicated that by comparison with experienced examiners, less experienced examiners paid more attention to institutional criteria and the summative dimension of assessment; were unsure of the boundary conditions relating to very good or poor theses; and were more likely to refer back to their own postgraduate experience when reflecting on their approach to both supervision and examination.
AB - Earlier research by Mullins and Kiley (2002) [Studies in higher education, 27(4), 369-386] reported on the processes that experienced examiners go through when they assess research theses. Since that study two further studies have been undertaken, interviews with novice Australian examiners, reported here, and the analysis of approximately 100 examiners' reports (Kiley, 2004). These studies now allow us to address the comment made by many of the experienced examiners who were interviewed that it was not wise to send a research thesis, particularly one which is not strong, to inexperienced examiners. We also wanted to determine the extent to which less experienced examiners follow the same processes and use the same criteria as their more experienced colleagues, and whether there was any basis for the experienced examiners' comments. This paper draws particularly on the results of the interviews with 26 examiners and supervisors which indicated that by comparison with experienced examiners, less experienced examiners paid more attention to institutional criteria and the summative dimension of assessment; were unsure of the boundary conditions relating to very good or poor theses; and were more likely to refer back to their own postgraduate experience when reflecting on their approach to both supervision and examination.
KW - Examiner experience
KW - Higher education
KW - Interview data
KW - Research training
KW - Thesis assessment
UR - http://www.scopus.com/inward/record.url?scp=20444448089&partnerID=8YFLogxK
U2 - 10.1016/j.ijer.2005.04.009
DO - 10.1016/j.ijer.2005.04.009
M3 - Article
SN - 0883-0355
VL - 41
SP - 121
EP - 135
JO - International Journal of Educational Research
JF - International Journal of Educational Research
IS - 2 SPEC. ISS.
ER -