Assessment of the Efficacy of ChatGPT in Detecting Surgical Site Infections Following Elective Colorectal Surgery (ChatCCR)

Hospital de Granollers

Status: Completed

Conditions: Surgical Site Infection

Treatments: Diagnostic Test: Diagnosis of SSI

Study type: Observational

Funder types: Other

Identifiers

NCT06556017

HGG2024_03

Details and patient eligibility

About

Epidemiological surveillance is one of the eight core components of the World Health Organization Infection Prevention and Control Programmes. These include surveillance programmes for surgical site infection (SSI).

At present, for SSI surveillance, infection control teams perform a manual time-consuming work, which could make a transition to automated surveillance leveraging the new information technology.

This study aimed to evaluate the ability of ChatGPT-4o to detect surgical site infection at the three anatomical levels.

Full description

Healthcare-associated infections (HAIs) have a negative impact on patient health, represent a significant healthcare and economic burden on healthcare systems and are considered the most preventable cause of serious adverse events in hospitalised patients.

Epidemiological surveillance is one of the eight core components of the World Health Organization (WHO) Infection Prevention and Control Programmes. These include surveillance programmes for surgical site infection (SSI), which have proven to be effective in all types of surgery and in a variety of settings.

For a programme to be effective, surveillance for HCAIs must be active, prospective and continuous, comprising a surveillance period up to 30-90 days post-intervention, to cover the high rate of SSIs detected after discharge.

At present, infection control teams perform a manual, prospective, time-consuming and almost artisanal work, which should make a transition to automated or semi-automated surveillance that leverages the possibilities offered by today's information technology.

The evolution of surveillance systems should benefit from this new possibilities offered by artificial intelligence, allowing automated detection of suspected SSI adverse events from clinical course text, microbiology reports or coding of diagnoses, procedures, complications and readmissions.

This pilot study aims to evaluate the ability of ChatGPT to detect surgical site infections (SSI) at the three anatomical levels described by the CDC. The aim is to retrospectively compare the results of the AI chatbot in diagnosing SSI, trained using the US CDC definition criteria, with a cohort of elective colorectal surgery patients evaluated through a nationwide nosocomial infection surveillance system.

Enrollment: 122 patients

Sex: All

Ages: 18+ years old

Volunteers: No Healthy Volunteers

Inclusion criteria

• Elective colorectal resection

Exclusion criteria

• Emergency surgery
• Infection present at operation
• Previous intestinal stoma

Trial design

122 participants in 2 patient groups

Patients assessed for ILQ using the standard manual surveillance method

Description:

Patients undergoing colorectal surgery enrolled in the nationwide ILQ surveillance programme and assessed for ILQ using the standard manual surveillance method.

Treatment:

Diagnostic Test: Diagnosis of SSI

ILQ patients assessed by Open IA's ChatGPT 4 chatbot

Description:

Patients undergoing colorectal surgery enrolled in the nationwide ILQ surveillance programme and assessed for ILQ using the Open IA's ChatGPT 4 chatbot.

Treatment:

Diagnostic Test: Diagnosis of SSI