We work very hard to ensure that examinations and assessments are fair for everybody. To help us do this, we employ rigorous quality control measures.
Some examples of our quality control measures are as follows:
Design of Questions
- The Progress Test and AKT questions are derived from the Medical Schools Council Assessment Alliance (MSC-AA) database (www.medschools.ac.uk/). MSC-AA is committed to the highest standards of quality assurance and full details are shown on their website.
- The Years 1 and 2 Semester tests are designed by examination teams within the Programme from our own database, also held securely by the MSC-AA. Following each assessment, the performance of each question is analysed carefully.
- CCA stations are chosen from our extensive question banks. New stations are added every year by teams of trained doctors, health professionals and other academic staff, following detailed guidance.
- We use blueprints to ensure that our assessments appropriately assess the intended learning outcomes of the curriculum.
Review of Questions
- Written assessments and CCA stations are reviewed by assessment leads and their teams to ensure they are fair and appropriate.
- They are also reviewed by external examiners. These are experienced academic staff from other universities. They help to ensure that our examinations are set at the right level and conform to GMC standards and guidance (see External Examiners).
Setting the Pass Mark
- We use appropriate systems to set the pass mark for individual assessments to ensure that only safe, competent students pass. We follow the same systems used in other medical schools in the UK and around the world.
Marking the Assessments
- All CCAs are marked using trained and suitably qualified examiners. All new CCA examiners must undergo specific training before taking part in their first CCA. Experienced examiners undergo regular refresher training. In addition, a briefing is given to examiners before each CCA cycle. For the CCAs, examiners record their judgements and feedback electronically using iPads.
- The Progress Test and Semester Tests mark sheets are scored using automated systems (approved optical mark reader / electronic web delivery) supplemented by additional manual checks.
- During the CCA itself, senior internal and external examiners monitor the performance of examiners to ensure they are following the guidance given and marking fairly and appropriately.
- The data that arises from Progress Tests, Semester Tests and CCAs are processed using automated systems. Quality control processes ensure reliability of the data collection and processing.
Reviewing the Assessments
- After each assessment, we perform detailed statistical analysis. This includes a comparison of the performance of different examiners at different hospitals and on different days to ensure that marking was fair to all groups of students.
- After each CCA, we ask examiners and simulated patients for feedback about individual stations. External examiners send detailed reports. We also carefully review concerns sent in by students. In the light of all these comments, we amend our stations or assessment procedures to ensure we continue to set the highest possible standards.
Plagiarism Detection
Written assessments are submitted through automated plagiarism detection software, see Academic Malpractice.