ChatGPT Versus Physical Medicine and Rehabilitation Residents

Sisli Hamidiye Etfal Training and Research Hospital

Status: Completed

Conditions: Resident Education; Artificial Intelligence (AI)

Treatments: Other: resident exam

Study type: Observational

Funder types: Other

Identifiers

NCT06775938

31.12.2024-2873

Details and patient eligibility

About

The aim of this study was to assess the performance of ChatGPT on examinations administered to physical medicine and rehabilitation (PMR) residents.

Full description

These exams for resident physicians are annual exams administered throughout the training period, which constitute a fundamental component of the training process towards becoming a PMR physician. In this study, we evaluated the performance of ChatGPT in these exams, made separate assessments for each training year, and compared the results of ChatGPT with the results of residents who passed the same exam.

Enrollment: 314 patients

Sex: All

Volunteers: No Healthy Volunteers

Inclusion criteria

• Physical medicine and rehabilitation residents exam results in May 2024

Exclusion criteria

Trial design

314 participants in 2 patient groups

Physical medicine and rehabilitation residents

Description:

The residents enrolled in the PMR specialization training program held throughout Turkey in May 2024

Treatment:

Other: resident exam

ChatGPT

Description:

A new user was created for the free version of the ChatGPT-4o application, and a series of questions belonging to four distinct education levels were posed to it, one by one. For each question, ChatGPT was instructed to select only one option out of five.

Treatment:

Other: resident exam