Presented by: Dr. Connie Schimtz
The most frequently asked questions of the National Center for Interprofessional Practice and Education concern the assessment of learners and the evaluation of interprofessional education programs or collaborative practice (IPECP). “How can I assess IPECP?” “How can I select the right tool?” “What tools do you recommend?” While a number of tools exist, the potential number of relevant tools is vast. While we all want a “magic bullet,” the process of assessment and evaluation begins with having clear ideas of what we expect to accomplish via IPECP. For practitioners, the challenge then becomes understanding how to appraise the relevance of a given instrument for their own specific purposes and the strength of its validity evidence.
This session is based on a recently released e-pub by the National Center entitled, “Evaluating Interprofessional Education and Collaborative Practice: What Should I Consider When Selecting a Measurement Tool?” (Schmitz and Cullen, 2015). Following some opening didactics on the meaning of “validity” and five sources of validity evidence, we will discuss a measurement tool (“Nurse-Physician Questionnaire”) designed to assess teamwork in the ICU. Participants are welcome to read the publication in advance of the session.
Learning Objectives: upon completion of this session learners will:
- Appreciate how validity data are used to examine the assumptions that we – as educators and researchers – have about what instruments are measuring
- Recognize five sources of validity evidence
- Apply a guide to instrument selection based on its relevance, evidence of validity, and operational considerations
Advance Reading: Shortell SM, Rousseau DM, Gillies RR, Devers MA, Simons TL. Organizational assessment in intensive care units (ICUs): Construct development, reliability and validity of the ICU Nurse-Physician Questionnaire. Med Care, 1991;29(8):709-26.