Live SessionModule #10
Patient Safety at a Glance:
Chapter 17 Technology in
Healthcare and E-Iatrogenesis
HCM520
Quality and Patient Safety
Overview
►
►
International struggle to cope with demand
►
Increasing population
►
Demographic changes
►
Greater numbers of elderly
►
Patients with multiple long-term conditions
Seeking new/innovative ways to cope
►
Technological innovation
► Reduce risks with care provision
►
Improving communication
►
Promoting accessibility
►
Assisting with decision making
► Inadvertent error risk occurs
Course Code and Title
Epidemiology of IT-Related
Errors
►
►
Healthcare Technology
►
Used by all healthcare professionals in developed countries
►
Increasingly used in developing countries
Technical Complications
►
Account for 13% of adverse healthcare events
►
~400 patients/year die in UK due to medical devices
►
Expected to increase
►
Lack of understanding
Course Code and Title
Nature of Technology-Related
Errors in Healthcare Settings
►
Key Term
►
►
►
E-iatrogenesis: errors and adverse events resulting from
the use of technology
Can involve software/hardware
►
Needed but unavailable
►
Malfunctions during use
►
Used in ways other than intended
►
Interacts with other technology in unintended ways
Results due to design and implementation in an
organization
Course Code and Title
Technological Design: Latent
Example
►
►
Technology
►
Designed with safety in mind
►
Help address surrounding error producing conditions
►
Help address human shortcomings
►
Not fool-proof, may bring inherent risks
Latent Condition Example
►
Bar-code verification technology
► Help reduce medication errors
► Identifies correct patient, correct medication
► Scans patient wristband against medication to be
administered
► Minimize risk of confusing patients/doses
Course Code and Title
Technological Design: Human
Cognition Example
►
Prescribing systems
► Holding prescribing-related information
► Alert prescribers to incorrect dose, contraindications,
allergies
►
Display of info can impact behavior
► Large pop-up alerts become tiring (alert fatigue)
►
Usability analysis: Heuristic Evaluation
► Minimize design-related errors thru assessment:
Course Code and Title
►
Simple dialogue, Minimize memory load
►
Consistent feedback
►
Shortcuts
►
Effective error messages
►
Prevent errors
►
Facilitate documentation
Need for Human-Centered Design
Course Code and Title
Implementation
►
►
E-iatrogenesis can be result of implementation
►
If users are not trained
►
If system does not fit with work practices
►
Unintended patterns of usage may result
Workarounds get created
►
►
Eg: system requires large number of clicks
►
May delay data entry until later in workday
►
May result in out-of-date records
►
Inability to access important information
Mitigating strategies
►
Include process mapping
►
Assess existing workflows
►
Re-design process
►
Course Code and Title
Consult users
Reduce Technology-Related Errors:
Safe implementation
► Toolkits for change
► Guide implementers through whole cycle
► Conception, planning, implementation,
onging maintenance
► Example: Stratis Health’s Health
Information Technology Toolkit for Critical
Access and Small Hospitals
► http://www.stratishealth.org/expertise/h
ealthit/hospitals/htoolkit.html
► Based on US context, transferable to other
countries
Course Code and Title
Reduce Technology-Related
Errors: National Guidelines
►
Aim to reduce errors
►
2010 UK’s NPSA guidelines for safe on-screen display
►
Advice for designers
► Displaying text, symbol, drug names, numbers, units of measure,
etc
► Eg: busy users misread numbers due to trailing zeros
►
►
5.0mg may be read as 50mg resulting in overdose
►
NPSA recommends leaving trailing zeros out
NPSA’s guide to design of infusion devices
► Hardware, software specification/recommendation
► Some
devices do not alert if syringe/plunger not secured
► Potential for disengaging
Course Code and Title
Reduce Technology-Related Errors:
Safe Implementation/Design
►
Global initiatives for implementation/design sources of
error
►
WHO Dept of Essential Health Technologies
►
Oversee international efforts
►
Develop policies/guidelines for use/implementation of
technology on empirical evidence
►
4 sub-streams
► Blood Transfusion Safety
► Clinical Procedures
► Diagnostic Imaging/Medical Devices
► Diagnostics/Laboratory Technology
►
Strengthen existing technology within economic ability
Course Code and Title
Function of IT Systems in
Healthcare
Course Code and Title
Assumptions Underlying Intro
of IT in Healthcare
Course Code and Title
Conclusion
►
Tech systems made headway to ensure care is
safe/efficient
►
Can introduce new sources of error
►
Can introduce potentially avoidable harm
►
Design- and implementation- related initiatives
►
►
Reduce risk
Technology is tool
►
Not fool-proof to eliminate human error/latent error
Health Administration Press
Chapter 3: Variation in Medical Practice and
Implications for Quality
Chapter Outline
• Background Variation in Medical Practice
• Variation in Healthcare
• Analyzing Variation
• Using Variation Data to Drive Healthcare Quality Initiatives
• Baylor Scott & White Health Case Study
• Conclusion
• Study Questions
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
1
Health Administration Press
Background:
Random Versus Assignable Variation
• Variation is the difference between an observed event
and a standard or norm.
• Random variation is an attribute of the event or
process, adheres to the laws of probability, and cannot
be traced to a root cause.
• Assignable variation arises from a single or small set of
causes that are not part of the event or process and can
be traced and identified and then implemented or
eliminated.
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
2
Health Administration Press
Background:
Process, Outcome, and Performance Variation
• Process variation refers to different usage of a therapeutic
or diagnostic procedure in an organization, geographic
area, or other grouping of healthcare providers.
• E.g., fecal occult blood testing, sigmoidoscopy, colonoscopy, or a combination of
these options for screening for colorectal cancer
• Outcome variation occurs when different results follow
from a single process.
• Performance variation is the difference between any given
result and the optimal result.
• It is arguably the most important category of variation.
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
3
Health Administration Press
Variation in Medical Practice:
Warranted vs. Unwarranted Variation
• Warranted variation is based on differences in patient
preference, disease prevalence, or other patient-related
factors.
• Unwarranted variation is variation that cannot be
explained by patient preference or condition or
evidence-based medicine.
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
4
Health Administration Press
Variation in Medical Practice:
Wennberg’s Three Categories
• Wennberg has identified three categories of care in
which unwarranted variation indicates different
possible problems:
• Effective care
• Preference-sensitive care
• Supply-sensitive care
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
5
Health Administration Press
Variation in Medical Practice:
Sources of Unwarranted Variation in Medical Practice
• Potential sources of unwarranted variation:
• Inadequate patient involvement in decision making
• Inequitable access to resources
• Poor communication
• Role confusion
• Misinterpretation or misapplication of clinical evidence
• Clinician uncertainty
• Economic incentives
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
6
Health Administration Press
Variation in Medical Care:
Tools for Quality Improvement
• Where best practices have been identified:
• Clinical guidelines
• Benchmarking and report cards
• Academic detailing
• Pay-for-performance
• When care is “preference sensitive”:
• Comparative effectiveness research
• Initiatives to increase patient engagement
• When care is “supply sensitive”:
• Outcomes research and effectiveness research
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
7
Health Administration Press
Analyzing Variation:
The Challenge of Attribution
• Particularly in the context of population health, multiple
providers may have had the opportunity to influence the
outcome of interest.
• Where patients are retrospectively attributed to providers for
performance measurement, the rules used for that attribution
can greatly influence how providers appear to perform.
• E.g., compared to a “default” attribution rule, 11 alternative rules tested in
the context of using commercial health plan claims data to assign
Massachusetts physicians to the categories of “low cost,” “average cost,”
“high cost,” and “low sample size” assigned 17% to 61% of physicians to a
different performance category.*
*Mehrotra, A., J. L. Adams, J. W. Thomas, and E. A. McGlynn. “The effect of different attribution rules on individual physician
cost profiles.” Ann Intern Med 152, no. 10 (May 18 2010): 649-54.
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
8
Health Administration Press
Analyzing Variation:
The Challenge of Attribution
• Careful thought needs to go into the design/choice of
any retrospective attribution rule to ensure the
resulting performance measurement holds the relevant
provider(s) accountable for quality or cost.
• Different attribution rules may, therefore, need to be
applied to different measures contributing to the overall
evaluation of the quality or cost of care provided to a
population.
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
9
Health Administration Press
Analyzing Variation: Tools for Analysis
• League tables and caterpillar charts, which order
providers from lowest to highest performers on a
chosen measure, are frequently used to examine
variation.
• They are vulnerable to misinterpretation, as the instinct is to focus on
numeric ordering, missing the uncertainty around each provider’s point
estimate and thus the fact that much of the ordering reflects random
variation.
• Better tools are forest and funnel plots.
• Both can avoid the ranking issue.
• Funnel plot makes clear allowance for additional variability among providers
with small volume.
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
10
Health Administration Press
Analyzing Variation: Tools for Analysis
Forest plot showing
variation in heart
failure 30-day riskstandardized
mortality in
Medicare patients
for hospitals in
Dallas County (July
2013 – June 2016)
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
11
Health Administration Press
Analyzing Variation: Tools for Analysis
Funnel plot showing
variation in heart
failure 30-day riskstandardized mortality
in Medicare patients
for hospitals in Dallas
County (July 2013 –
June 2016)
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
12
Health Administration Press
Analyzing Variation: Tools for Analysis
• Statistical process control (SPC) is an approach adopted from
industrial manufacturing that appeals widely across healthcare
improvement activities.
• It combines statistical significance tests with graphical analysis of
summary data as the data are produced, most often in control charts,
which plot measured points together with upper and lower reference
thresholds (calculated using historical data) that define the range of
the random variation.
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
13
Health Administration Press
Analyzing Variation: Tools for Analysis
• SPC can provide the time sensitivity so important to pragmatic
improvement.
• BUT, having originated in a setting characterized by repetitive
manufacturing of identical products, care must be taken in its
application to healthcare, where individual patient characteristics
vary widely and influence both the appropriateness of delivery of
certain processes of care and the outcomes that can be expected
from that care.
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
14
Health Administration Press
Using Variation Data to Drive Healthcare Quality
Initiatives
• National quality improvement efforts applying variation
include:
• Medicare’s Hospital Value-Based Purchasing Program
• Medicare’s Hospital Readmissions Reduction Program
• Individual hospitals and healthcare systems with the
capacity and infrastructure for quality monitoring and
improvement use variation data to identify opportunities
for quality improvement and/or evaluate the effectiveness
of quality initiatives.
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
15
Health Administration Press
Case Study: Baylor Scott & White Health
• Increasing use of evidence-based heart failure therapies
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
16
Health Administration Press
Conclusion
• Keys to successful management (rather than
elimination) of variation in pursuit of quality healthcare
include the ability to
• identify variation;
• distinguish between random and assignable
variation;
• determine the meaning, importance, or value of the
observed variation relative to some standard; and
• implement methods that will take advantage of or
rectify what the variation reveals.
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
17
Health Administration Press
Study Questions
1. While exploring opportunities to improve processes of care for a
group practice, you find no variability in compliance with the US
Preventive Services Task Force’s recommendations for colorectal
cancer screening across the practice’s physician over time. Is this
absence of variation optimal? Why or why not?
2. Distinguish between random and assignable variation. Discuss the
relevance of each of these to measuring quality of care and to the
design and evaluation of quality improvement initiatives.
3. Describe the three categories of care identified by Wennberg
(2011), the possible opportunities for improvement unwarranted
variation might indicate in each of these categories, and the goals of
health services research and quality improvement initiatives in each
category.
Copyright 2019 Foundation of the American College
of Healthcare Executives. Not for sale.
18