Making Data Count Intervention Evaluation

University of Warwick

Status: Completed

Conditions: Statistical Process Control Charts

Treatments: Behavioral: Making Data Count Training intervention

Study type: Interventional

Funder types: Other

Identifiers

NCT04977414

BSREC 100/20-21

Details and patient eligibility

About

Hospitals collect copious amounts of data to share with their board for quality assurance and improvement purposes. The way these data are presented can influence board members' decisions. For example, time-series charts highlight the highest and lowest data but do not clarify whether those data lie outside expected or 'common cause' variation. Statistical process control charts make this clarification and, in so doing, guide quality assurance and improvements in a more targeted fashion.

A previous study showed that data suitable for presentation as a control chart are seldom presented in that format. A training intervention called 'Making Data Count' was created to improve the uptake of statistical process control charts by hospitals in England. The current study will use a randomized design to evaluate whether the intervention increases control charts in hospitals that were not early adopters of the training intervention.

This study is a parallel cluster randomized trial (with baseline-line measurements) across 20 National Health Service (NHS) hospitals in England. The hospitals will be randomly split into two groups. One group will be scheduled to experience the training intervention, and the other group will be placed on a waiting list to experience the training later. The primary analysis will compare the difference in the use of control charts between waitlist and intervention hospitals (adjusting for pre-intervention use) reported with 95% confidence intervals. A qualitative thematic analysis of feedback forms will be conducted.

The present research will evaluate the impact of the training intervention on the use of control charts. The results will apply to institutions that are not early adopters of this training intervention.

Enrollment: 15 patients

Sex: All

Volunteers: Accepts Healthy Volunteers

Inclusion and exclusion criteria

Inclusion Criteria:

• NHS Hospital
• Placed on a red-list for predominantly using R-A-G or two-point data presentations in their board papers.

Trial design

Primary purpose: Health Services Research

Allocation: Randomized

Interventional model: Parallel Assignment

Masking: None (Open label)

---

15 participants in 2 patient groups

Waitlist control group

No Intervention group

Description:

Hospitals assigned to this group will be placed in on a waitlist to receive the training intervention at a later date

"Making data count" intervention group

Experimental group

Description:

The Making Data Count training intervention was designed by NHS-Improvement to improve knowledge about SPC charts and to increase their uptake. Training sessions are tailored for two sets of attendees: board members and data analysts. Board member and analyst training sessions are delivered as close as possible in time, typically within the same month. Training sessions for board members are usually delivered over about one-and-a-half hours and focus more heavily on the benefits of control charts compared to other charts. Training sessions for analysts are usually delivered over three hours and focus more heavily on the structure and interpretation of the individual and moving range charts (X-mR charts).

Treatment:

Behavioral: Making Data Count Training intervention