Fresno test of competency as a formative assessment tool as an aid to learning process
Abstract
Background: To study the use of “Fresno Test of Competency†for assessing evidence based medicine (EBM) course as a formative assessment tool as an aid to learning process.
Methods: Fifteen Postgraduate students attending EBM course spanning two semesters (6 months each) were recruited. To formatively assess students’ skills one month after the start and at the end of the course, Fresno test of competency was applied. Mean scores with standard deviations were compared between pre- and post-course results.
Results: Response rate was 55%, only 8 out of 15 students completed both parts of the study. Evidence based medicine skills and knowledge improved in 7 out of 12 questions assessing different EBM skills (formulating focussed research question, sorting evidence, literature search using different tools, epidemiology, and understanding confidence intervals). The scores in assessing critical appraisal (relevance, validity and magnitude) were lower in post course test. Paired sample correlation of pre and post course tests shows a significantly higher positive correlation (r=0.945, p <0.0001).
Conclusion: The improved scores of students in different skills show that this test can be applied, with modifications, to assess the students formatively in Evidence Based Medicine, in terms of their ability to develop research question, sort the evidence, and understand its epidemiological application to the general population. Â However, larger studies are suggested to prove the generalizability of this assertion.
Keywords: Fresno test, competence model, formative assessmentReferences
Timmermans S, Mauck A. The promises and pitfalls of evidence-based medicine. Health Affairs. 2005;24(1):18-28.
Dawes M, Summerskill W, Glasziou P, Cartabellotta A, Martin J, Hopayian K, et al. Sicily statement on evidence-based practice. BMC medical education. 2005;5(1):1.
Straus SE, Richardson WS, Glasziou P, Haynes RB. Evidence-based medicine: how to practice and teach EBM. 2005.
Jonsson A, Svingby G. The use of scoring rubrics: Reliability, validity and educational consequences. Educational research review. 2007;2(2):130-44.
Ramos KD, Schafer S, Tracz SM. Validation of the Fresno test of competence in evidence based medicine. Bmj. 2003;326(7384):319-21.
Argimon-Pallàs JM, Flores-Mateo G, Jiménez-Villa J, Pujol-Ribera E. Psychometric properties of a test in evidence based practice: the Spanish version of the Fresno test. BMC medical education. 2010;10(1):45.
Lai NM TC. Competence in evidence-based medicine of senior medical students following a clinically integrated training programme. Hong Kong Med J. 2009;15(5):332-8.
Tilson JK. Validation of the modified Fresno test: assessing physical therapists' evidence based practice knowledge and skills. BMC medical education. 2010;10(1):38.
Morris J, Maynard V. The feasibility of introducing an evidence based practice cycle into a clinical area: An evaluation of process and outcome. Nurse education in practice. 2009;9(3):190-8.
Holmboe ES, Hawkins RE. Methods for evaluating the clinical competence of residents in internal medicine: a review. Annals of internal Medicine. 1998;129(1):42-8.
McCluskey A, Lovarini M. Providing education on evidence-based practice improved knowledge but did not change behaviour: a before and after study. BMC Medical Education. 2005;5(1):40.
Aronoff SC, Evans B, Fleece D, Lyons P, Kaplan L, Rojas R. Integrating evidence based medicine into undergraduate medical education: combining online instruction with clinical clerkships. Teaching and learning in medicine. 2010;22(3):219-23.
Dory V, Gagnon R, De Foy T, Duyver C, Leconte S. A novel assessment of an evidence-based practice course using an authentic assignment. Medical teacher. 2010;32(2):e65-e70.
McCluskey A, Bishop B. The Adapted Fresno Test of competence in evidenceâ€based practice. Journal of Continuing Education in the Health Professions. 2009;29(2):119-26.
Ilic D. Assessing competency in Evidence Based Practice: strengths and limitations of current tools in practice. BMC medical education. 2009;9(1):53.
