PHM15: A Closer Look at Quality Indicators, Evaluation Tools


Session: Let’s Measure Our Own Performance: Propose and Evaluate Pediatric Hospital Medicine Quality Indicators

Summary: During this workshop, a staff of multiple, nationally-recognized quality leaders led a group to review, help develop, and help validate quality measures. The workshop was facilitated via the use of interactive survey tools, didactic sessions, and small groups.

Presenters discussed why quality measures are important and relevant. These included:

  1. Improved quality of care,
  2. Demonstration of value,
  3. Third-party pay for performance indicators,
  4. Determining our own indicators (versus being chosen for us), and
  5. Performance incentives.

As part of the introduction to the workshop, the various quality measure validation methods were reviewed. These consisted of methods such as UCLA/RAND and Delphi Panel, as a means to determine validation and feasibility.

Validation was discussed in terms of what is being measured is the true outcome that was hoped to be achieved. The feasibility component used to make sure that the data used for quality measures, or process to be implemented for improvement, can easily be acquired to determine adherence, and that data is free of error. Facilitators reviewed various examples of validity and feasibility of quality measures with direct examples and discussions with attendees.

During the first breakout session, the groups were separated into teams focused on 1. care transitions, 2. safety, and 3. clinical care. The groups were asked to determine three quality indicators per individual, discuss the top five indicators voted on by the group, and than to review and discuss as a group the validity and feasibility of the measures using a scoring tool of 1-3: Not Valid/Feasible, 4-6: Equivocal, 7-9: Valid/Feasible. At the end, a delegated group speaker was asked to discuss either the pros/cons of one of their measures in regards to validity and feasibility to the total audience. Facilitators assisted on clarifying the reasons of why validity and feasibility metrics were appropriate.

During the final parts of workshop, positive and negatives of quality metrics determination methodology were discussed. The attendees reflected on the process of how quality measures are determined along with how these may be used within their settings.

Key Takeaways

Clearly determining the validity and feasibility of quality metrics for pediatrics has become an important topic. It not only has significant ramifications to the value we provide to our patients, but also the financial sustainability of programs and institutions, especially with the current changes in payment models. The workshop gave a clear and concise way of how to come up with quality metrics and the facilitators greatly added to the understanding of how we can “raise the floor” and “raise the ceiling” of pediatric care. TH

Dr. Alvarez is a pediatric hospitalist and medical director of community hospital services at Children’s National Health System in Washington, D.C.

Next Article:

   Comments ()