Assessing The Clinical Performance Of Learners
Validity in Practice-Based Assessments
Tanner (2006) defined clinical judgment as “an interpretation or conclusion about a patient’s needs, concerns, or health problems, and/or the decision to take action (or not), use or modify standard approaches, or improvise new ones as deemed appropriate by the patient’s response” (p. 204).Clinical judgment needs to be flexible, not linear, using a variety of ways of knowing, including theoretical knowledge and practical experience (Benner, Tanner, & Chesla, 2009). Validity theory has evolved significantly over the past 30 years in response to the increased use of assessments across scientific, social and educational settings. The overarching trajectory of this evolution reflects a shift from a purely quantitative, positivistic approach to a conception of validity reliant on the interpretation of multiple evidence sources integrated into validity arguments. Moreover, within contemporary validity, interpretation has been emphasised as a central process; however, despite this emphasis, there have been few explicit articulations of specific interpretive methodologies applicable to the practice of validation. Reliability is a measure of consistency. Many factors enter into makingAssessing The Clinical Performance Of Learners
Clinical judgments that cannot be measured or represented in a rubric (Lasater, 2011; Tanner, 2006); therefore, evaluation data from the LCJR should be considered as one component or a snapshot in time, of a broader evaluation picture. Second, as evidenced by the results from the studies described in this article, reliability results are affected by characteristics of both the raters and the scenarios. In classical test theory, the observed score is a result of a combination of the true score, along with any error in measurement. A limitation of classical test theory is that error measurement is viewed as a single entity. However, when the goal of the performance appraisal is to evaluate the ability of the learner to respond to a clinical problem that is presented in the highly realistic setting of simulation, identifying extraneous sources of variability becomes important. In performance-based evaluations, there are several sources of variability, including the raters, the simulation case, and the learner’s …Assessing The Clinical Performance Of Learners