Office of Assessment and Evaluation Studies
The Office of Assessment and Evaluation is involved in various projects within medical simulation at the Center for Human Simulation and Patient Safety. Research includes development and validation of assessment tools for measuring surgical skills, teamwork, decision making and technical skills. Other work includes projects in human factors and patient safety on various health system projects. An overarching goal is to conduct research in and implement evidence based assessment tools and methods for medical simulation training, research and development.
Tracking and evaluation for Clinical and Translational Research Science Award (CTSA)
Projects include identifying and tracking clinical and translational research activities as part of a 5-year, $20 million grant. Currently, a 7-level outcomes framework (Moore, 2009) is being used for evaluating the impact on multiple outcomes including translational research activities and transdisciplinary team processes.
M3 Longitudinal Curriculum
An ongoing evaluation of the M3 longitudinal patient safety curriculum, Science, Systems and the Patient, designed to assess change in student attitudes around patient safety issues and behaviors including error recognition and error reporting. Data are collected at the beginning and end of the M3 year and at the end of the M4 year.
Systematic Review of Instrument Development
A review of peer-reviewed instrument development articles in medical education employing exploratory factor analysis (2006-10) to assess consistency of instrument development procedures, specifically factor analysis methods and reported reliability and validity evidence, with best practices.
Curriculum Assessment Inventory
A review of all undergraduate summative assessments pre and post curriculum redesign to evaluate change in the distribution of measured educational outcomes using the Moore et al. (2009) Outcomes Framework.
A longitudinal investigation of medical student orientation toward lifelong learning using the revised Jefferson Scale of Physician Lifelong Learning – Medical Student version.
Selection Methods for Medical School Admissions
Investigating the validity of cognitive, non cognitive and environmental predictors of medical student success. Current projects include evaluating the impact of conducting multiple applicant interviews as part of the medical school admission process and investigating selection tools in predicting student outcomes. The overall goal of this area of research is to continuously seek to improve and monitor the effectiveness and fairness of the selection process into medical school.
Systematic Review of Education Interventions on Team Competence and Team Performance
What are the effects of educational interventions such as reading, lectures, and audit and feedback on team behavior in controlled settings and on team performance in actual practice? These questions are being addressed through a systematic review carried out with faculty and staff of the VCU Center for Human Simulation and Patient Safety.
Comparative Effectiveness Research
The Agency for Healthcare Research and Quality (AHRQ) is supporting the John M. Eisenberg Center for Decisions and Communications Science, the Association of American Medical Colleges, and the Society for Academic Continuing Medical Education, in testing the feasibility of medical school sponsored continuing medical education for disseminating comparative effectiveness topics developed in the AHRQ Effective Health Care Program. The VCU Office of Assessment and Evaluation Studies participate in design and implementation of the project evaluation.