Collaborative Group for Research in Mathematics Education


COMPLETED RESEARCH PROJECTS


The validity and reliability of the inspection procedures for initial teacher education

Project team: Keith Jones, Ann Sinkinson (University of Cambridge)

This project was carried out in collaboration with the University of Cambridge.

Publications

Sinkinson, A. and Jones, K. (2001), The Validity and Reliability of OFSTED Judgements of the Quality of Secondary Mathematics Initial Teacher Education Courses, Cambridge Journal of Education, 31(2), 221-237.
Abstract: The inspection by OFSTED's Initial Teacher Education and Training (ITET) team of courses of initial teacher education is high stakes. An unsatisfactory report can lead to course closure. Even a satisfactory report can lead to reductions in quota resulting in a spiral of decline in course viability. The high stakes nature of the inspection means that there has to be complete confidence in the level of validity and reliability of the inspection process. This paper presents an analysis of the complete cohort of published inspection reports of providers of secondary mathematics initial teacher education Post-graduate Certificate of Education (PGCE) courses carried out by the OFSTED ITET team in the period 1996-1998. The analysis demonstrates that there is considerable variation in the reports in terms of word length, how particular criteria seem to be applied and how judgements are expressed. With the complexity of the framework for inspection it is impossible, given the current model of inspection report, to properly distinguish between consistency of application and the loading given to any particular criterion. Attention to the transparency of the inspection process and to matters of validity and reliability is crucial if there is to be confidence in the inspection system.
Click here for full article in pdf format.

Jones, K. and Sinkinson, A., (2000), A Critical Analysis of Ofsted Judgements of the Quality of Secondary Mathematics Initial Teacher Education Courses, Evaluation and Research in Education, 40(2), 79-93.
Abstract: The quality of initial teacher education courses has been the subject of adverse comment and media speculation for some time. During 1996/7, OFSTED began a comprehensive round of inspections of secondary initial teacher education providers using an extensive framework of inspection. This paper reports the results of the first round of inspection of secondary mathematics PGCE providers. Almost three-quarters were judged to be good or better. In examining the inspection reports from a critical perspective, this paper focuses on the level of consistency in the judgements made in the published inspection reports. The analysis demonstrates that there is considerable variation in the reports, in terms of word length, how particular criteria seem to be applied, and how judgements are expressed. With the complexity of the framework for inspection, it is impossible, given the current model of inspection report, to properly distinguish between consistency of application and the loading given to any particular criterion. Attention to the transparency of the inspection process is crucial if there is to be confidence in the inspection system.
Click here for full article in pdf format.

Conference Presentations

Sinkinson, A. and Jones, K. (2000), The Validity and Reliability of OFSTED Judgements of the Quality of Secondary Mathematics Initial Teacher Education Courses. Paper presented at the Symposium on 'Critical Issues in Mathematics Initial Teacher Education' at the British Educational Research Association Annual Conference, The University of Wales, Cardiff, September 7th - 9th, 2000.

Jones, K. and Sinkinson, A. (1999), A Critical Analysis of OFSTED Judgements of the Quality of Secondary Mathematics Initial Teacher Education Courses. Paper presented at the Symposium on 'Critical Issues in Mathematics Initial Teacher Education' at the British Educational Research Association Annual Conference, The University of Sussex, Brighton, September 2nd - 5th, 1999.


Back to CRME research projects

HomeBack to CRME Home Page