1.
dos S. Ribeiro C, van de Burgwal LHM, Regeer BJ. Overcoming challenges for designing and implementing the One Health approach: A systematic review of the literature. One Health. 2019;7. doi:10.1016/j.onehlt.2019.100085
2.
Hodges BD. A Practical Guide for Medical Teachers. Fifth edition. (Dent JA, Harden RM, Hunt D, eds). Elsevier; 2017. https://www.vlebooks.com/vleweb/product/openreader?id=GlasgowUni&isbn=9780702068935
3.
Association for the Study of Medical Education. Understanding Medical Education: Evidence, Theory, and Practice. Third edition. (Swanwick T, Forrest K, O’Brien BC, eds). Wiley-Blackwell; 2019. https://ezproxy.lib.gla.ac.uk/login?url=https://dx.doi.org/10.1002/9781119373780
4.
Marshall S, ed. A Handbook for Teaching and Learning in Higher Education: Enhancing Academic Practice. Fifth edition. Routledge; 2020. https://ebookcentral.proquest.com/lib/gla/detail.action?docID=5983041
5.
Holmboe EricS, Durning SJ. Practical Guide to the Assessment of Clinical Competence. Third Edition.; 2024.
6.
Norcini J, Anderson B, Bollela V, et al. Criteria for good assessment: Consensus statement and recommendations from the Ottawa 2010 Conference. Medical Teacher. 2011;33(3):206-214. doi:10.3109/0142159X.2011.551559
7.
Van Der Vleuten CPM. The assessment of professional competence: Developments, research and practical implications. Advances in Health Sciences Education. 1996;1(1):41-67. doi:10.1007/BF00596229
8.
van der Vleuten CPM, Schuwirth LWT. Assessing professional competence: from methods to programmes. Medical Education. 2005;39(3):309-317. doi:10.1111/j.1365-2929.2005.02094.x
9.
Schuwirth LW, van der Vleuten CP. How to Design a Useful Test: The Principles of Assessment. In: Swanwick T, ed. Understanding Medical Education. 3rd ed. Wiley-Blackwell; 2019:277-289. doi:10.1002/9781119373780.ch20
10.
van der Vleuten CPM, Schuwirth LWT, Driessen EW, et al. A model for programmatic assessment fit for purpose. Medical Teacher. 2012;34(3):205-214. doi:10.3109/0142159X.2012.652239
11.
Biggs J. Enhancing Teaching through Constructive Alignment. Higher Education. 1996;32(3):347-364. https://www.jstor.org/stable/3448076
12.
Miller G. The assessment of clinical skills/competence/performance. Academic Medicine. 1990;65(9). https://ezproxy.lib.gla.ac.uk/login?url=https://oce.ovid.com/article/00001888-199009000-00045/PDF
13.
Schuwirth LWT, van der Vleuten CPM. Programmatic assessment and Kane’s validity perspective. Medical Education. 2012;46(1):38-48. doi:10.1111/j.1365-2923.2011.04098.x
14.
Epstein RM. Defining and Assessing Professional Competence. JAMA. 2002;287(2). doi:10.1001/jama.287.2.226
15.
ten Cate O. Nuts and Bolts of Entrustable Professional Activities. Journal of Graduate Medical Education. 2013;5(1):157-158. doi:10.4300/JGME-D-12-00380.1
16.
Ten Cate O. Competency-Based Postgraduate Medical Education: Past, Present and Future. GMS Journal for Medical Education. 2017;34(5). doi:10.3205/zma001146
17.
Cruess RL, Cruess SR, Steinert Y. Amending Miller’s Pyramid to Include Professional Identity Formation. Academic Medicine. 2016;91(2):180-185. doi:10.1097/ACM.0000000000000913
18.
Cobb KA, Brown G, Jaarsma DADC, Hammond RA. The educational impact of assessment: A comparison of DOPS and MCQs. Medical Teacher. 2013;35(11):e1598-e1607. doi:10.3109/0142159X.2013.803061
19.
Jolly B, Dalton MJ. Written Assessment. In: Swanwick T, Forrest K, O’Brien BC, eds Understanding Medical Education. 3rd ed. John Wiley & Sons, Ltd; 2018:291-317. doi:10.1002/9781119373780.ch21
20.
Jolly B. Written Assessment. In: Swanwick T, ed. Understanding Medical Education. 3rd ed. Wiley-Blackwell; 2019:261-261. doi:10.1002/9781119373780.ch21
21.
Epstein RM. Assessment in Medical Education. New England Journal of Medicine. 2007;356(4):387-396. doi:10.1056/NEJMra054784
22.
Hift RJ. Should essays and other "open-ended”-type questions retain a place in written summative assessment in clinical medicine? BMC Medical Education. 2014;14(1). doi:10.1186/s12909-014-0249-2
23.
Paniagua M, Swygert K, eds. The Gold Book - constructing written test questions for the basic and clinical sciences. https://www.nbme.org/sites/default/files/2020-01/IWW_Gold_Book.pdf
24.
Schuwirth LWT, van der Vleuten CPM. ABC of learning and teaching in medicine: Written assessment. BMJ. 2003;326(7390):643-645. doi:10.1136/bmj.326.7390.643
25.
Schuwirth LWT, van der Vleuten CPM. Different written assessment methods: what can be said about their strengths and weaknesses? Medical Education. 2004;38(9):974-979. doi:10.1111/j.1365-2929.2004.01916.x
26.
Schuwirth LWT, van der Vleuten CPM. General overview of the theories used in assessment: AMEE Guide No. 57. Medical Teacher. 2011;33(10):783-797. doi:10.3109/0142159X.2011.611022
27.
Charlin B, Roy L, Brailovsky C, Goulet F, van der Vleuten C. The Script Concordance Test: A Tool to Assess the Reflective Clinician. Teaching and Learning in Medicine. 2000;12(4):189-195. doi:10.1207/S15328015TLM1204_5
28.
Fournier J, Demeester A, Charlin B. Script Concordance Tests: Guidelines for Construction. BMC Medical Informatics and Decision Making. 2008;8. doi:10.1186/1472-6947-8-18
29.
Case SM, Swanson DB. Extended‐matching items: A practical alternative to free‐response questions. Teaching and Learning in Medicine. 1993;5(2):107-115. doi:10.1080/10401339309539601
30.
Dory V, Gagnon R, Vanpee D, Charlin B. How to construct and implement script concordance tests: insights from a systematic review. Medical Education. 2012;46(6):552-563. doi:10.1111/j.1365-2923.2011.04211.x
31.
Farmer EA, Page G. A practical guide to assessing clinical decision-making skills using the key features approach. Medical Education. 2005;39(12):1188-1194. doi:10.1111/j.1365-2929.2005.02339.x
32.
FENDERSON B. The virtues of extended matching and uncued tests as alternatives to multiple choice questions. Human Pathology. 1997;28(5):526-532. doi:10.1016/S0046-8177(97)90073-3
33.
Haladyna TM, Downing SM, Rodriguez MC. A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment. Applied Measurement in Education. 2002;15(3):309-333. doi:10.1207/S15324818AME1503_5
34.
McCoubrie P. Improving the fairness of multiple-choice questions: a literature review. Medical Teacher. 2004;26(8):709-712. doi:10.1080/01421590400013495
35.
Miller MD, Linn RL, Gronlund NE. Measurement and Assessment in Teaching. 11th ed., International ed. Pearson Education; 2013.
36.
Palmer EJ, Devitt PG. Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions?: research paper. BMC Medical Education. 2007;7(1). doi:10.1186/1472-6920-7-49
37.
Lubarsky S, Dory V, Meterissian S, Lambert C, Gagnon R. Examining the effects of gaming and guessing on script concordance test scores. Perspectives on Medical Education. 2018;7(3):174-181. doi:10.1007/s40037-018-0435-8
38.
Anderson LW, Bloom BS. A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. Abridged ed. Longman; 2001.
39.
Sam AH, Field SM, Collares CF, et al. Very-short-answer questions: reliability, discrimination and acceptability. Medical Education. 2018;52(4):447-455. doi:10.1111/medu.13504
40.
Cotton DRE, Cotton PA, Shipway JR. Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International. 2024;61(2):228-239. doi:10.1080/14703297.2023.2190148
41.
Boursicot KAM, Roberts TE, Burdick WP. Structured Assessments of Clinical Competence. In: Swanwick T, Forrest K, O’Brien BC, eds Understanding Medical Education. John Wiley & Sons, Ltd; 2018:335-345. doi:10.1002/9781119373780.ch23
42.
Schoonheim-Klein M, Muijtjens A, Habets L, Manogue M, Van Der Vleuten C, Van Der Velden U. Who will pass the dental OSCE? Comparison of the Angoff and the borderline regression standard setting methods. European Journal of Dental Education. 2009;13(3):162-171. doi:10.1111/j.1600-0579.2008.00568.x
43.
Regehr G1, MacRae H, Reznick RK, Szalay D. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med. Published online 1998. https://www.ncbi.nlm.nih.gov/pubmed/9759104
44.
Harden RM. Misconceptions and the OSCE. Medical Teacher. 2015;37(7):608-610. doi:10.3109/0142159X.2015.1042443
45.
Carraccio, Carol;Wolfsthal, Susan D.;Englander, Robert;Ferentz, Kevin;Martin, Christine. Shifting Paradigms: From Flexner to Competencies. Academic Medicine. 77(5). https://journals.lww.com/academicmedicine/Fulltext/2002/05000/Shifting_Paradigms__From_Flexner_to_Competencies.3.aspx
46.
Rushforth HE. Objective structured clinical examination (OSCE): Review of literature and implications for nursing education. Nurse Education Today. 2007;27(5):481-490. doi:10.1016/j.nedt.2006.08.009
47.
Spielman A, Fulmer T, Eisenberg E, Alfano M. Dentistry, Nursing, and Medicine: A Comparisaon of Core Competencies. Journal of Dental Education. 2005;69(11):1257-1271. https://pubmed.ncbi.nlm.nih.gov/16275689/
48.
Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. BMJ. 1975;1(5955):447-451. doi:10.1136/bmj.1.5955.447
49.
Watson R, Stimpson A, Topping A, Porock D. Clinical competence assessment in nursing: a systematic review of the literature. Journal of Advanced Nursing. 2002;39(5):421-431. doi:10.1046/j.1365-2648.2002.02307.x
50.
Williams DM, Davies S, Horner M, Handley J. Peer and near-peer OSCE examiners. Medical Teacher. 2016;38(2):212-213. doi:10.3109/0142159X.2015.1072266
51.
Brown C, Ross S, Cleland J, Walsh K. Money makes the (medical assessment) world go round: The cost of components of a summative final year Objective Structured Clinical Examination (OSCE). Medical Teacher. 2015;37(7):653-659. doi:10.3109/0142159X.2015.1033389
52.
Meskell P, Burke E, Kropmans TJB, Byrne E, Setyonugroho W, Kennedy KM. Back to the future: An online OSCE Management Information System for nursing OSCEs. Nurse Education Today. 2015;35(11):1091-1096. doi:10.1016/j.nedt.2015.06.010
53.
Tavakol M, Doody GA. A novel psychometric programme for the rapid analysis of OSCE data. Medical Teacher. 2016;38(1):104-105. doi:10.3109/0142159X.2015.1062085
54.
Eva KW, Rosenfeld J, Reiter HI, Norman GR. An admissions OSCE: the multiple mini-interview. Medical Education. 2004;38(3):314-326. doi:10.1046/j.1365-2923.2004.01776.x
55.
Lane P. Recruitment into training for general practice—the winds of change or a breath of fresh air? BMJ. 2005;331(7520):s153-s153. doi:10.1136/bmj.331.7520.s153
56.
Hodges B, Regehr G, McNaughton N, Tiberius R, Hanson M. OSCE checklists do not capture increasing levels of expertise. 1999;74(10). https://journals.lww.com/academicmedicine/abstract/1999/10000/osce_checklists_do_not_capture_increasing_levels.17.aspx
57.
Hodges B, McIlroy JH. Analytic global OSCE ratings are sensitive to level of training. Medical Education. 2003;37(11):1012-1016. doi:10.1046/j.1365-2923.2003.01674.x
58.
Ma IWY, Zalunardo N, Pachev G, et al. Comparing the use of global rating scale with checklists for the assessment of central venous catheterization skills using simulation. Advances in Health Sciences Education. 2012;17(4):457-470. doi:10.1007/s10459-011-9322-3
59.
Wood TJ, Humphrey-Murto SM, Norman GR. Standard Setting in a Small Scale OSCE: A Comparison of the Modified Borderline-Group Method and the Borderline Regression Method. Advances in Health Sciences Education. 2006;11(2):115-122. doi:10.1007/s10459-005-7853-1
60.
Harden RM. Revisiting ‘Assessment of clinical competence using an objective structured clinical examination (OSCE)’. Medical Education. 2016;50(4):376-379. doi:10.1111/medu.12801
61.
Harden RM, Lilley P, Patricio M, Norman GR. The Definitive Guide to the OSCE: The Objective Structured Clinical Examination as a Performance Assessment. Elsevier; 2016. https://www.vlebooks.com/vleweb/product/openreader?id=GlasgowUni&isbn=9780702055492
62.
Denison A, Bate E, Thompson J. Tablet versus paper marking in assessment: feedback matters. Perspectives on Medical Education. 2016;5(2):108-113. doi:10.1007/s40037-016-0262-8
63.
ten Cate O. Nuts and Bolts of Entrustable Professional Activities. Journal of Graduate Medical Education. 2013;5(1):157-158. doi:10.4300/JGME-D-12-00380.1
64.
Harden RM. Learning outcomes as a tool to assess progression. Medical Teacher. 2007;29(7):678-682. doi:10.1080/01421590701729955
65.
Ross M. Entrustable professional activities. The Clinical Teacher. 2015;12(4):223-225. doi:10.1111/tct.12436
66.
ten Cate O, Young JQ. The patient handover as an entrustable professional activity: adding meaning in teaching and practice. BMJ Quality & Safety. 2012;21(Suppl 1):i9-i12. doi:10.1136/bmjqs-2012-001213
67.
Aylward M, Nixon J, Gladding S. An Entrustable Professional Activity (EPA) for Handoffs as a Model for EPA Assessment Development. Academic Medicine. 2014;89(10):1335-1340. doi:10.1097/ACM.0000000000000317
68.
Hauer KE, Soni K, Cornett P, et al. Developing Entrustable Professional Activities as the Basis for Assessment of Competence in an Internal Medicine Residency: A Feasibility Study. Journal of General Internal Medicine. 2013;28(8):1110-1114. doi:10.1007/s11606-013-2372-x
69.
Orsini C, Binnie VI. Entrustment decisions in dental education: Is it time to start formalising? Medical Teacher. 2016;38(3):322-322. doi:10.3109/0142159X.2015.1114598
70.
Auewarakul C, Downing SM, Praditsuwan R, Jaturatamrong U. Item Analysis to Improve Reliability for an Internal Medicine Undergraduate OSCE. Advances in Health Sciences Education. 2005;10(2):105-113. doi:10.1007/s10459-005-2315-3
71.
NEWBLE DI, SWANSON DB. Psychometric characteristics of the objective structured clinical examination. Medical Education. 1988;22(4):325-334. doi:10.1111/j.1365-2923.1988.tb00761.x
72.
Sturpe DA. Objective Structured Clinical Examinations in Doctor of Pharmacy Programs in the United States. American journal of pharmaceutical education. 2010;74(8). doi:10.5688/aj7408148
73.
Snell LS, Frank JR. Competencies, the tea bag model, and the end of time. Medical Teacher. 2010;32(8):629-630. doi:10.3109/0142159X.2010.500707
74.
Gravina EW. Competency-Based Education and Its Effect on Nursing Education: A Literature Review. Teaching and Learning in Nursing. 2017;12(2):117-121. doi:10.1016/j.teln.2016.11.004
75.
Read EK, Bell C, Rhind S, Hecker KG. The Use of Global Rating Scales for OSCEs in Veterinary Medicine. PLOS ONE. 2015;10(3). doi:10.1371/journal.pone.0121000
76.
Wood TJ, Pugh D. Are rating scales really better than checklists for measuring increasing levels of expertise? Medical Teacher. 2020;42(1):46-51. doi:10.1080/0142159X.2019.1652260
77.
Hagel CM, Hall AK, Dagnone JD. Queen’s University Emergency Medicine Simulation OSCE: an Advance in Competency-Based Assessment. CJEM. 2016;18(3):230-233. doi:10.1017/cem.2015.34
78.
Tekian A, Ten Cate O, Holmboe E, Roberts T, Norcini J. Entrustment decisions: Implications for curriculum development and assessment. Medical Teacher. Published online 15 March 2020:1-7. doi:10.1080/0142159X.2020.1733506
79.
Peters H, Holzhausen Y, Boscardin C, ten Cate O, Chen HC. Twelve tips for the implementation of EPAs for assessment and entrustment decisions. Medical Teacher. 2017;39(8):802-807. doi:10.1080/0142159X.2017.1331031
80.
Kakadia R, Chen E, Ohyama H. Implementing an online OSCE during the COVID‐19 pandemic. Journal of Dental Education. Published online 23 July 2020. doi:10.1002/jdd.12323
81.
Ryan A, Carson A, Reid K, Smallwood D, Judd T. Fully online OSCEs: A large cohort case study. MedEdPublish. 2020;9(1). doi:10.15694/mep.2020.000214.1
82.
J. G. Boyle. Viva la VOSCE? BMC Medical Education. 2020;20(1). https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-020-02444-3
83.
Hopwood J, Myers G, Sturrock A. Twelve tips for conducting a virtual OSCE. Medical Teacher. 2021;43(6):633-636. doi:10.1080/0142159X.2020.1830961
84.
Norcini JJ. The Mini-CEX: A Method for Assessing Clinical Skills. Annals of Internal Medicine. 2003;138(6). doi:10.7326/0003-4819-138-6-200303180-00012
85.
Kessel D, Jenkins J, Neville E. Workplace based assessments are no more. BMJ. Published online 26 September 2012. doi:10.1136/bmj.e6193
86.
Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Medical Teacher. 2007;29(9-10):855-871. doi:10.1080/01421590701775453
87.
Elstein AS, Sprafka SA, Shulman LS. Medical Problem Solving: An Analysis of Clinical Reasoning.
88.
Noel GL. How Well Do Internal Medicine Faculty Members Evaluate the Clinical Skills of Residents? Annals of Internal Medicine. 1992;117(9). doi:10.7326/0003-4819-117-9-757
89.
Kogan JR, Bellini LM, Shea JA. Feasibility, Reliability, and Validity of the Mini-Clinical Evaluation Exercise (mCEX) in a Medicine Core Clerkship. Academic Medicine. 2003;78(10). https://journals.lww.com/academicmedicine/Fulltext/2003/10001/Feasibility,_Reliability,_and_Validity_of_the.11.aspx
90.
Durning SJ, Cation LJ, Markert RJ, Pangaro LN. Assessing the Reliability and Validity of the Mini-Clinical Evaluation Exercise for Internal Medicine Residency Training. Academic Medicine. 2002;77(9). https://journals.lww.com/academicmedicine/pages/articleviewer.aspx?year=2002&issue=09000&article=00020&type=abstract
91.
Holmboe ES, Huot S, Chung J, Norcini J, Hawkins RE. Construct Validity of the MiniClinical Evaluation Exercise (miniCEX). Academic Medicine. 2003;78(8). https://journals.lww.com/academicmedicine/pages/articleviewer.aspx?year=2003&issue=08000&article=00018&type=abstract
92.
Torsney KM, Cocker DM, Slesser AAP. The Modern Surgeon and Competency Assessment: Are the Workplace-Based Assessments Evidence-Based? World Journal of Surgery. 2015;39(3):623-633. doi:10.1007/s00268-014-2875-6
93.
Mitchell C, Bhat S, Herbert A, Baker P. Workplace-based assessments of junior doctors: do scores predict training difficulties? Medical Education. 2011;45(12):1190-1198. doi:10.1111/j.1365-2923.2011.04056.x
94.
Williams RG, Verhulst S, Colliver JA, Dunnington GL. Assuring the reliability of resident performance appraisals: More items or more observations? Surgery. 2005;137(2):141-147. doi:10.1016/j.surg.2004.06.011
95.
Murphy DJ, Bruce DA, Mercer SW, Eva KW. The reliability of workplace-based assessment in postgraduate medical education and training: a national evaluation in general practice in the United Kingdom. Advances in Health Sciences Education. 2009;14(2):219-232. doi:10.1007/s10459-008-9104-8
96.
Archer JC. Use of SPRAT for peer review of paediatricians in training. BMJ. 2005;330(7502):1251-1253. doi:10.1136/bmj.38447.610451.8F
97.
Quantrill SJ, Tun JK. Workplace-based assessment as an educational tool. Guide supplement 31.5 – Viewpoint. Medical Teacher. 2012;34(5):417-418. doi:10.3109/0142159X.2012.668234
98.
Hurst YK, Prescott-Clements LE, Rennie JS. The patient assessment questionnaire: A new instrument for evaluating the interpersonal skills of vocational dental practitioners. British Dental Journal. 2004;197(8):497-500. doi:10.1038/sj.bdj.4811750
99.
Humphrey-Murto S, Côté M, Pugh D, Wood TJ. Assessing the Validity of a Multidisciplinary Mini-Clinical Evaluation Exercise. Teaching and Learning in Medicine. 2018;30(2):152-161. doi:10.1080/10401334.2017.1387553
100.
Rekman J, Hamstra SJ, Dudek N, Wood T, Seabrook C, Gofton W. A New Instrument for Assessing Resident Competence in Surgical Clinic: The Ottawa Clinic Assessment Tool. Journal of Surgical Education. 2016;73(4):575-582. doi:10.1016/j.jsurg.2016.02.003
101.
Sutherland RM, Reid KJ, Chiavaroli NG, Smallwood D, McColl GJ. Assessing Diagnostic Reasoning Using a Standardized Case-Based Discussion. Journal of Medical Education and Curricular Development. 2019;6. doi:10.1177/2382120519849411
102.
Driessen EW, Muijtjens AMM, van Tartwijk J, van der Vleuten CPM. Web- or paper-based portfolios: is there a difference? Medical Education. 2007;41(11):1067-1073. doi:10.1111/j.1365-2923.2007.02859.x
103.
Driessen E, van Tartwijk J. Portfolios in personal and professional development. In: Swanwick T, ed. Understanding Medical Education. 3rd ed. Wiley-Blackwell; 2013:255-262. doi:10.1002/9781119373780.ch18
104.
Siau K, Dunckley P, Valori R, et al. Changes in scoring of Direct Observation of Procedural Skills (DOPS) forms and the impact on competence assessment. Endoscopy. 2018;50(08):770-778. doi:10.1055/a-0576-6667
105.
Martinsen SSS, Espeland T, Berg EAR, Samstad E, Lillebo B, Slørdahl TS. Examining the educational impact of the mini-CEX: a randomised controlled study. BMC Medical Education. 2021;21(1). doi:10.1186/s12909-021-02670-3
106.
Cohen L, Manion L, Morrison K. Research Methods in Education. Eighth edition. Routledge; 2018. https://www.vlebooks.com/vleweb/product/openreader?id=GlasgowUni&isbn=9781315456522
107.
Joanna Briggs Institute QARI. https://jbi.global/
108.
Buckley S, Coleman J, Davison I, et al. The educational effects of portfolios on undergraduate student learning: A Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11. Medical Teacher. 2009;31(4):282-298. doi:10.1080/01421590902889897
109.
Brookfield S. Developing Critical Thinkers: Challenging Adults to Explore Alternative Ways of Thinking and Acting. Open University Press; 1987.
110.
Burls A. What is critical appraisal? Published online 2009. https://www.academia.edu/92786872/What_Is_Critical_Appraisal
111.
The Campbell Collaboration. http://www.campbellcollaboration.org/
112.
CASP Critical Appraisal Skills Programme Oxford UK. http://www.casp-uk.net/
113.
Cochrane | Trusted evidence. Informed decisions. Better health. http://www.cochrane.org/
114.
Kee F, Bickle I. Critical thinking and critical appraisal: the chicken and the egg? QJM. 2004;97(9):609-614. doi:10.1093/qjmed/hch099
115.
Da Silva A, Dennick R. Corpus analysis of problem-based learning transcripts: an exploratory study. Medical Education. 2010;44(3):280-288. doi:10.1111/j.1365-2923.2009.03575.x
116.
Garrison DR. Critical thinking and adult education: a conceptual model for developing critical thinking in adult learners. International Journal of Lifelong Education. 1991;10(4):287-303. doi:10.1080/0260137910100403
117.
Hammick M, Dornan T, Steinert Y. Conducting a best evidence systematic review. Part 1: From idea to data coding. BEME Guide No. 13. Medical Teacher. 2010;32(1):3-15. doi:10.3109/01421590903414245
118.
Horsley T, Hyde C, Santesso N, Parkes J, Milne R, Stewart R. Teaching critical appraisal skills in healthcare settings. Cochrane Database of Systematic Reviews. Published online 1 September 1996. doi:10.1002/14651858.CD001270.pub2
119.
Huang GC, Newman LR, Schwartzstein RM. Critical Thinking in Health Professions Education: Summary and Consensus Statements of the Millennium Conference 2011. Teaching and Learning in Medicine. 2014;26(1):95-102. doi:10.1080/10401334.2013.857335
120.
Jenicek M. The hard art of soft science: Evidence-Based Medicine, Reasoned Medicine or both? Journal of Evaluation in Clinical Practice. 2006;12(4):410-419. doi:10.1111/j.1365-2753.2006.00718.x
121.
Kirkpatrick D. Great Ideas Revisited: Revisiting Kirkpatrick’s Four-Level Model. Training and Development. 1996;50(1):54-59. https://ezproxy.lib.gla.ac.uk/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=tfh&AN=9602066395&site=ehost-live
122.
Missimer CA. Good Arguments: An Introduction to Critical Thinking. 3rd ed. Prentice Hall; 1995.
123.
Moore TJ. Critical thinking and disciplinary thinking: a continuing debate. Higher Education Research & Development. 2011;30(3):261-274. doi:10.1080/07294360.2010.501328
124.
Paul R. Critical Thinking: How to Prepare Students for a Rapidly Changing World. foundation for critical thinking; 1995.
125.
Paul R, Elder L. The Miniature Guide to Critical Thinking: Concepts and Tools. Published online 2006. https://www.criticalthinking.org/files/Concepts_Tools.pdf
126.
Yardley S, Dornan T. Kirkpatrick’s levels and education ‘evidence’. Medical Education. 2012;46(1):97-106. doi:10.1111/j.1365-2923.2011.04076.x
127.
Devine OP, Harborne AC, McManus IC. Assessment at UK medical schools varies substantially in volume, type and intensity and correlates with postgraduate attainment. BMC Medical Education. 2015;15(1). doi:10.1186/s12909-015-0428-9
128.
Ertmer PA, Richardson JC, Belland B, et al. Using Peer Feedback to Enhance the Quality of Student Online Postings: An Exploratory Study. Journal of Computer-Mediated Communication. 2007;12(2):412-433. doi:10.1111/j.1083-6101.2007.00331.x
129.
Nicol DJ, Macfarlane‐Dick D. Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice. Studies in Higher Education. 2006;31(2):199-218. doi:10.1080/03075070600572090
130.
Piedra N, Chicaiza J, Lopez J, Romero A, Tovar E. Measuring collaboration and creativity skills through rubrics: Experience from UTPL collaborative social networks course. In: IEEE EDUCON 2010 Conference. IEEE; 2010:1511-1516. doi:10.1109/EDUCON.2010.5492349
131.
De Wever B, Van Keer H, Schellens T, Valcke M. Assessing collaboration in a wiki: The reliability of university students’ peer assessment. The Internet and Higher Education. 2011;14(4):201-206. doi:10.1016/j.iheduc.2011.07.003
132.
Verkerk MA, de Bree MJ, Mourits MJE. Reflective professionalism: interpreting CanMEDS’ ‘professionalism’. Journal of Medical Ethics. 2007;33(11):663-666. doi:10.1136/jme.2006.017954
133.
Cleland JA, Knight LV, Rees CE, Tracey S, Bond CM. Is it me or is it them? Factors that influence the passing of underperforming students. Medical Education. 2008;42(8):800-809. doi:10.1111/j.1365-2923.2008.03113.x
134.
Cruess R. The Professionalism Mini-Evaluation Exercise: A Preliminary Investigation. Academic Medicine. 81(10). https://journals.lww.com/academicmedicine/Fulltext/2006/10001/The_Professionalism_Mini_Evaluation_Exercise__A.19.aspx
135.
Goldie J. Assessment of professionalism: A consolidation of current thinking. Medical Teacher. 2013;35(2):e952-e956. doi:10.3109/0142159X.2012.714888
136.
van Mook WNKA, Gorter SL, O’Sullivan H, Wass V, Schuwirth LW, van der Vleuten CPM. Approaches to professional behaviour assessment: Tools in the professionalism toolbox. European Journal of Internal Medicine. 2009;20(8):e153-e157. doi:10.1016/j.ejim.2009.07.012
137.
Ginsburg S, Regehr G, Lingard L. Basing the evaluation of professionalism on observable behaviours: a cautionary tale. Academic Medicine. 2004;79(10):S1-S4. https://ezproxy.lib.gla.ac.uk/login?url=https://journals.lww.com/academicmedicine/Fulltext/2004/10001/Basing_the_Evaluation_of_Professionalism_on.1.aspx
138.
Hodges BD, Ginsburg S, Cruess R, et al. Assessment of professionalism: Recommendations from the Ottawa 2010 Conference. Medical Teacher. 2011;33(5):354-363. doi:10.3109/0142159X.2011.577300
139.
Schubert S, Ortwein H, Dumitsch A, et al. A situational judgement test of professional behaviour: development and validation. Medical Teacher. 2008;30(5):528-533. doi:10.1080/01421590801952994
140.
Arnold L, Shue CK, Kritt B, Ginsburg S, Stern DT. Medical students’ views on peer assessment of professionalism. Journal of General Internal Medicine. 2005;20(9):819-824. doi:10.1111/j.1525-1497.2005.0162.x
141.
Arnold L, Shue CK, Kalishman S, et al. Can There Be a Single System for Peer Assessment of Professionalism among Medical Students? A Multi-Institutional Study. Academic Medicine. 2007;82(6):578-586. doi:10.1097/ACM.0b013e3180555d4e
142.
Finn G, Sawdon M, Clipsham L, McLachlan J. Peer estimation of lack of professionalism correlates with low Conscientiousness Index scores. Medical Education. 2009;43(10):960-967. doi:10.1111/j.1365-2923.2009.03453.x
143.
Gaufberg E, Fitzpatrick A. The favour: a professional boundaries OSCE station. Medical Education. 2008;42(5):529-530. doi:10.1111/j.1365-2923.2008.03067.x
144.
Ginsburg S. Context, Conflict, and Resolution: A New Conceptual Framework for Evaluating Professionalism. Academic Medicine. 75(10). https://journals.lww.com/academicmedicine/Fulltext/2000/10001/Context,_Conflict,_and_Resolution__A_New.3.aspx
145.
Ginsburg S, Regehr G, Mylopoulos M. From behaviours to attributions: further concerns regarding the evaluation of professionalism. Medical Education. 2009;43(5):414-425. doi:10.1111/j.1365-2923.2009.03335.x
146.
Ginsburg S, van der Vleuten C, Eva KW, Lingard L. Hedging to save face: a linguistic analysis of written comments on in-training evaluation reports. Advances in Health Sciences Education. 2016;21(1):175-188. doi:10.1007/s10459-015-9622-0
147.
GMC. Development of generic professional capabilities. http://www.gmc-uk.org/education/23581.asp
148.
Kelly M, O’Flynn S, McLachlan J, Sawdon MA. The Clinical Conscientiousness Index. Academic Medicine. 2012;87(9):1218-1224. doi:10.1097/ACM.0b013e3182628499
149.
McCormack WT, Lazarus C, Stern D, Small PA. Peer Nomination: A Tool for Identifying Medical Student Exemplars in Clinical Competence and Caring, Evaluated at Three Medical Schools. Academic Medicine. 2007;82(11):1033-1039. doi:10.1097/01.ACM.0000285345.75528.ee
150.
McLachlan JC, Finn G, Macnaughton J. The Conscientiousness Index: A Novel Tool to Explore Students’ Professionalism. Academic Medicine. 2009;84(5):559-565. doi:10.1097/ACM.0b013e31819fb7ff
151.
Norcini JJ. Peer assessment of competence. Medical Education. 2003;37(6):539-543. doi:10.1046/j.1365-2923.2003.01536.x
152.
Papadakis MA, Teherani A, Banach MA, et al. Disciplinary Action by Medical Boards and Prior Behavior in Medical School. New England Journal of Medicine. 2005;353(25):2673-2682. doi:10.1056/NEJMsa052596
153.
Pohl CA, Hojat M, Arnold L. Peer Nominations as Related to Academic Attainment, Empathy, Personality, and Specialty Interest. Academic Medicine. 2011;86(6):747-751. doi:10.1097/ACM.0b013e318217e464
154.
Ramsey PG. Use of Peer Ratings to Evaluate Physician Performance. JAMA: The Journal of the American Medical Association. 1993;269(13). doi:10.1001/jama.1993.03500130069034
155.
Royal College of Physicians. Doctors in Society: Medical professionalism in a changing world. Published online 2005. https://cdn.shopify.com/s/files/1/0924/4392/files/doctors_in_society_reportweb.pdf?15745311214883953343
156.
Stern DT, Frohna AZ, Gruppen LD. The prediction of professional behaviour. Medical Education. 2005;39(1):75-82. doi:10.1111/j.1365-2929.2004.02035.x
157.
Stern DT. Measuring Medical Professionalism. Oxford University Press; 2006. https://ebookcentral.proquest.com/lib/gla/detail.action?docID=3053707
158.
van Mook WNKA, van Luijk SJ, O’Sullivan H, Wass V, Schuwirth LW, van der Vleuten CPM. General considerations regarding assessment of professional behaviour. European Journal of Internal Medicine. 2009;20(4):e90-e95. doi:10.1016/j.ejim.2008.11.011
159.
Wilkinson TJ, Wade WB, Knock LD. A Blueprint to Assess Professionalism: Results of a Systematic Review. Academic Medicine. 2009;84(5):551-558. doi:10.1097/ACM.0b013e31819fbaa2
160.
Zijlstra-Shaw S, Robinson PG, Roberts T. Assessing professionalism within dental education; the need for a definition. European Journal of Dental Education. 2012;16(1):e128-e136. doi:10.1111/j.1600-0579.2011.00687.x
161.
Patterson F, Zibarras L, Ashworth V. Situational judgement tests in medical education and training: Research, theory and practice: AMEE Guide No. 100. Medical Teacher. 2016;38(1):3-17. doi:10.3109/0142159X.2015.1072619
162.
Gorania R. Situational judgement stress. British Dental Journal. 2021;231(8):426-426. doi:10.1038/s41415-021-3577-8
163.
Royal College of Physicians. Advancing medical professionalism. 2018. https://www.healthcarevalues.ox.ac.uk/files/ampsummarypdf
164.
Rimmer A. Situational judgment test is scrapped under new system for allocating foundation training places. BMJ. Published online 2 June 2023. doi:10.1136/bmj.p1269
165.
McKinley DW, Norcini JJ. How to set standards on performance-based examinations: AMEE Guide No. 85. Medical Teacher. 2014;36(2):97-110. doi:10.3109/0142159X.2013.853119
166.
Ben-David MF. AMEE Guide No. 18: Standard setting in student assessment. Medical Teacher. 2000;22(2):120-130. doi:10.1080/01421590078526
167.
De Champlain AF. Standard Setting Methods in Medical Education. In: Swanwick T, ed. Understanding Medical Education. Wiley-Blackwell; 2019:347-359. doi:10.1002/9781119373780.ch24
168.
Cohen-Schotanus J, van der Vleuten CPM. A standard setting method with the best performing students as point of reference: Practical and affordable. Medical Teacher. 2010;32(2):154-160. doi:10.3109/01421590903196979
169.
Downing SM, Tekian A, Yudkowsky R. RESEARCH METHODOLOGY: Procedures for Establishing Defensible Absolute Passing Scores on Performance Examinations in Health Professions Education. Teaching and Learning in Medicine. 2006;18(1):50-57. doi:10.1207/s15328015tlm1801_11
170.
Hofstee WKB. The Case for Compromise in Educational Selection and Grading. On Educational Testing. Published online 1984. https://benwilbrink.nl/publicaties/83hofstee_compromise.htm
171.
Fowell SL, Fewtrell R, McLaughlin PJ. Estimating the Minimum Number of Judges Required for Test-centred Standard Setting on Written Assessments. Do Discussion and Iteration have an Influence? Advances in Health Sciences Education. 2008;13(1):11-24. doi:10.1007/s10459-006-9027-1
172.
Taylor CA. Development of a modified Cohen method of standard setting. Medical Teacher. 2011;33(12):e678-e682. doi:10.3109/0142159X.2011.611192
173.
Karantonis A, Sireci SG. The Bookmark Standard-Setting Method: A Literature Review. Educational Measurement: Issues and Practice. 2006;25(1):4-12. doi:10.1111/j.1745-3992.2006.00047.x
174.
Puryer J, O’Sullivan D. An introduction to standard setting methods in dentistry. BDJ. 2015;219(7):355-358. doi:10.1038/sj.bdj.2015.755
175.
Linn AMJ, Tonkin A, Duggan P. Standard setting of script concordance tests using an adapted Nedelsky approach. Medical Teacher. 2013;35(4):314-319. doi:10.3109/0142159X.2012.746446
176.
Woodhouse, L. Comparison of Cohen and Angoff methods of standard setting: is Angoff worth it? European Board of Medical Assessors Annual Academic Conference: Crossing Boundaries: Assessment in Medical Education. https://eprints.ncl.ac.uk/251674
177.
Barbara S. Plake, James C. Impara and Patrick M. Irwin. Consistency of Angoff-Based Predictions of Item Performance: Evidence of Technical Quality of Results from the Angoff Standard Setting Method. Journal of Educational Measurement. 2000;37(4). https://www.jstor.org/stable/1435245
178.
IC McManus. Implementing statistical equating for MRCP(UK) parts 1 and 2. BMC Medical Education. 2014;14(1). https://bmcmededuc.biomedcentral.com/articles/10.1186/1472-6920-14-204
179.
Wood DF. Formative Assessment. In: Swanwick T, ed. Understanding Medical Education. John Wiley & Sons, Ltd; 2019:317-328. doi:10.1002/9781119373780.ch25
180.
Bing-You RG. Why Medical Educators May Be Failing at Feedback. JAMA. 2009;302(12). doi:10.1001/jama.2009.1393
181.
Ramani S, Krackov SK. Twelve tips for giving feedback effectively in the clinical environment. Medical Teacher. 2012;34(10):787-791. doi:10.3109/0142159X.2012.684916
182.
Van De Ridder JMM, Stokking KM, McGaghie WC, Ten Cate OTJ. What is feedback in clinical education? Medical Education. 2008;42(2):189-197. doi:10.1111/j.1365-2923.2007.02973.x
183.
Rushton A. Formative assessment: a key to deep learning? Medical Teacher. 2005;27(6):509-513. doi:10.1080/01421590500129159
184.
Sender Liberman A, Liberman M, Steinert Y, McLeod P, Meterissian S. Surgery residents and attending surgeons have different perceptions of feedback. Medical Teacher. 2005;27(5):470-472. doi:10.1080/0142590500129183
185.
Duers LE, Brown N. An exploration of student nurses’ experiences of formative assessment. Nurse Education Today. 2009;29(6):654-659. doi:10.1016/j.nedt.2009.02.007
186.
Olson BL, McDonald JL. Influence of Online Formative Assessment Upon Student Learning in Biomedical Science Courses. Journal of Dental Education. 2004;68(6):656-659. doi:10.1002/j.0022-0337.2004.68.6.tb03783.x
187.
Garrison C, Ehringhaus M. Formative and Summative Assessments in the Classroom. Published online 2007. https://www.amle.org/portals/0/pdf/articles/Formative_Assessment_Article_Aug2013.pdf
188.
Sadler DR. Formative Assessment: revisiting the territory. Assessment in Education: Principles, Policy & Practice. 1998;5(1):77-84. doi:10.1080/0969595980050104
189.
Ditchfield C. How do learners make sense of the formative assessment opportunities available to inform their learning in a PBL course. Published online 2007.
190.
Weaver MR. Do students value feedback? Student perceptions of tutors’ written responses. Assessment & Evaluation in Higher Education. 2006;31(3):379-394. doi:10.1080/02602930500353061
191.
Ferrell G. Supporting assessment and feedback practice with technology: from tinkering to transformation. Published online 2013. https://repository.jisc.ac.uk/5450/
192.
Black P, Wiliam D. Assessment and Classroom Learning. Assessment in Education: Principles, Policy & Practice. 1998;5(1):7-74. doi:10.1080/0969595980050102
193.
Sadler DR. Formative assessment and the design of instructional systems. Instructional Science. 1989;18(2):119-144. doi:10.1007/BF00117714
194.
Elnicki DM, Layne RD, Ogden PE, Morris DK. Oral versus written feedback in medical clinic. Journal of General Internal Medicine. 1998;13(3):155-158. doi:10.1046/j.1525-1497.1998.00049.x
195.
Norcross WA. The Consultation: An Approach to Learning and Teaching. JAMA: The Journal of the American Medical Association. 1985;253(3). doi:10.1001/jama.1985.03350270123038
196.
Jackson JL, Kay C, Jackson WC, Frank M. The Quality of Written Feedback by Attendings of Internal Medicine Residents. Journal of General Internal Medicine. 2015;30(7):973-978. doi:10.1007/s11606-015-3237-2
197.
Rudolph J, Raemer D, Shapiro J. We know what they did wrong, but not why : the case for ‘frame-based’ feedback. The Clinical Teacher. 2013;10(3):186-189. doi:10.1111/j.1743-498X.2012.00636.x
198.
Scally G, Donaldson LJ. Looking forward: Clinical governance and the drive for quality improvement in the new NHS in England. BMJ. 1998;317(7150):61-65. doi:10.1136/bmj.317.7150.61
199.
Shaw S. Research governance: where did it come from, what does it mean? Journal of the Royal Society of Medicine. 2005;98(11):496-502. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1275997/pdf/496.pdf
200.
Dimensions of Quality. Published online 2010. https://www.advance-he.ac.uk/knowledge-hub/dimensions-quality
201.
Anderson D, Ackerman-Anderson LS. Beyond Change Management: How to Achieve Breakthrough Results through Conscious Change Leadership. Vol 36. 2nd ed. Pfeiffer; 2010. https://ebookcentral.proquest.com/lib/gla/detail.action?docID=624404
202.
Hay D, Kinchin I, Lygo‐Baker S. Making learning visible: the role of concept mapping in higher education. Studies in Higher Education. 2008;33(3):295-311. doi:10.1080/03075070802049251
203.
Hay DB, Tan PL, Whaites E. Non‐traditional learners in higher education: comparison of a traditional MCQ examination with concept mapping to assess learning in a dental radiological science course. Assessment & Evaluation in Higher Education. 2010;35(5):577-595. doi:10.1080/02602931003782525
204.
Richstone L, Schwartz MJ, Seideman C, Cadeddu J, Marshall S, Kavoussi LR. Eye Metrics as an Objective Assessment of Surgical Skill. Annals of Surgery. 2010;252(1):177-182. doi:10.1097/SLA.0b013e3181e464fb
205.
Suetsugu N, Ohki M, Kaku T. Quantitative Analysis of Nursing Observation Employing a Portable Eye-Tracker. Open Journal of Nursing. 2016;06(01):53-61. doi:10.4236/ojn.2016.61006
206.
Gould J, Day P. Hearing you loud and clear: student perspectives of audio feedback in higher education. Assessment & Evaluation in Higher Education. 2013;38(5):554-566. doi:10.1080/02602938.2012.660131
207.
Frost J, de Pont G, Brailsford I. Expanding assessment methods and moments in history. Assessment & Evaluation in Higher Education. 2012;37(3):293-304. doi:10.1080/02602938.2010.531247
208.
Harrison CJ, Molyneux AJ, Blackwell S, Wass VJ. How we give personalised audio feedback after summative OSCEs. Medical Teacher. 2015;37(4):323-326. doi:10.3109/0142159X.2014.932901
209.
Voelkel S, Mello LV. Audio Feedback – Better Feedback? Bioscience Education. 2014;22(1):16-30. doi:10.11120/beej.2014.00022
210.
Ashraf H, Sodergren MH, Merali N, Mylonas G, Singh H, Darzi A. Eye-tracking technology in medical education: A systematic review. Medical Teacher. 2018;40(1):62-69. doi:10.1080/0142159X.2017.1391373
211.
Mayer RE. Cognitive Learning. In: Encyclopedia of the Sciences of Learning. Springer; 2012. https://ezproxy.lib.gla.ac.uk/login?url=https://link.springer.com/referenceworkentry/10.1007/978-1-4419-1428-6_390
212.
Ho VW, Harris PG, Kumar RK, Velan GM. Knowledge maps: a tool for online assessment with automated feedback. Medical Education Online. 2018;23(1). doi:10.1080/10872981.2018.1457394
213.
Guraya SY. The Desired Concept Maps and Goal Setting for Assessing Professionalism in Medicine. JOURNAL OF CLINICAL AND DIAGNOSTIC RESEARCH. Published online 2016. doi:10.7860/JCDR/2016/19917.7832
214.
Kassab SE, Fida M, Radwan A, Hassan AB, Abu-Hijleh M, O’Connor BP. Generalisability theory analyses of concept mapping assessment scores in a problem-based medical curriculum. Medical Education. 2016;50(7):730-737. doi:10.1111/medu.13054
215.
Courteille O, Bergin R, Courteille O, et al. The use of a virtual patient case in an OSCE-based exam – A pilot study. Medical Teacher. 2008;30(3):e66-e76. doi:10.1080/01421590801910216
216.
Downing SM. Guessing on selected-response examinations. Medical Education. 2003;37(8):670-671. doi:10.1046/j.1365-2923.2003.01585.x
217.
Ingrid Tonni, Cynthia C. Gadbury‐Amyot, Marjan Govaerts, Olle ten Cate, Joan Davis, Lily T. Garcia, Richard W. Valachovic. ADEA‐ADEE Shaping the Future of Dental Education III. Journal of Dental Education. 2020;84(1):97-104. doi:10.1002/jdd.12024
