Artificial Intelligence-powered Virtual Assistant for Emergency Triage in Neurology (AIDEN)

Fundación para la Lucha contra las Enfermedades Neurológicas de la Infancia

Status and phase: Completed; Early Phase 1

Conditions: Subarachnoid Hemorrhage; Status Epilepticus; Vertigo Benign Positional; Meningitis; Delirium; Guillain-Barre Syndrome; Stroke; Trigeminal Neuralgia; Facial Palsy; Migraine

Treatments: Diagnostic Test: Virtual Assistant

Study type: Interventional

Funder types: Other

Identifiers

NCT06334796

10476 (Registry Identifier)

Details and patient eligibility

About

This study examines the use of an AI-powered virtual assistant for quickly identifying and handling neurological emergencies, particularly in places with limited medical resources. The research aimed to check if this AI tool is safe and accurate enough to move on to more advanced testing stages. In a first-of-its-kind trial, the virtual assistant was tested with patients having urgent neurological issues. Neurologists first reviewed the AI's recommendations using clinical records and then assessed its performance directly with patients. The findings were as follows: neurologists agreed with the AI's decisions nearly all the time, and the AI outperformed earlier versions of Chat GPT in every tested aspect. Patients and doctors found the AI to be highly effective, rating it as excellent or very good in most cases. This suggests the AI could significantly enhance how quickly and accurately neurological emergencies are dealt with, although further trials are needed before it can be widely used.

Full description

Background and Objectives: Neurological emergencies pose significant challenges in medical care, especially in resource-limited countries. Artificial Intelligence (AI), particularly health chatbots, offers a promising solution. However, rigorous validation is required to ensure safety and accuracy. The objective of our work is to evaluate the diagnostic accuracy and resolution effectiveness of an AI-powered virtual assistant designed for the triage of emergency neurological pathologies, to ensure the minimum standard of safety that allows for the progression to successive validation tests.

Methods: This Phase 1 trial evaluates the performance of an AI-powered virtual assistant for emergency neurological triage. Ten patients over 18 years old with urgent neurological pathologies were selected. In the first stage, nine neurologists assessed the safety of the virtual assistant using their clinical records. In the second part, the assistant's accuracy when used by patients was evaluated. Finally, its performance was compared with Chat GPT 3.5 and 4.

Enrollment: 10 patients

Sex: All

Ages: 18+ years old

Volunteers: No Healthy Volunteers

Inclusion criteria

• Patients over 18 years old consulting in the ER due to a neurological emergency

Exclusion criteria

• Pregnancy

Trial design

Primary purpose: Diagnostic

Allocation: Non-Randomized

Interventional model: Single Group Assignment

Masking: None (Open label)

---

10 participants in 3 patient groups

Virtual Assistant

Experimental group

Description:

Patients answer question with a virtual assistant about their recent visit to the ER.

Treatment:

Diagnostic Test: Virtual Assistant

ChatGPT 3.5

Active Comparator group

Description:

Patients answer question with ChatGPT about their recent visit to the ER.

Treatment:

Diagnostic Test: Virtual Assistant

ChatGPT 4

Active Comparator group

Description:

Patients answer question with ChatGPT about their recent visit to the ER.

Treatment:

Diagnostic Test: Virtual Assistant