Human Doctors or AI: Evaluating Patient Satisfaction in Urinary Stone Disease Consultations

Abant Izzet Baysal University

Status: Completed

Conditions: Patient Satisfaction

Treatments: Behavioral: Medical Consultation

Study type: Interventional

Funder types: Other

Identifiers

NCT07111845

20243209

Details and patient eligibility

About

The goal of this observational study is to understand how satisfied patients are after getting medical advice about urinary stone disease from either a real doctor or an artificial intelligence (AI) chatbot. We want to learn whether people feel more satisfied with the information and support they get from human doctors or from AI tools like ChatGPT, Gemini, Perplexity, or Copilot.

The main questions it aims to answer are:

• Are patients more satisfied after consulting a real doctor or an AI chatbot?
• Does the time spent in the consultation affect satisfaction?

Researchers will compare doctor consultations with consultations from different AI chatbots to see if there are differences in patient satisfaction.

Participants will:

• Ask all their medical questions about urinary stones to one of the sources (a doctor or a specific AI chatbot)
• Fill out a short questionnaire (CSQ-8) to rate how satisfied they felt with the answers they received

Enrollment: 100 patients

Sex: All

Ages: 18+ years old

Volunteers: No Healthy Volunteers

Inclusion criteria

• Newly diagnosed with urinary stone disease,
• Aged 18 years or older,
• Provided written informed consent to participate in the study.

Exclusion criteria

• History of previous urinary stone disease, stone-related procedures,
• Presence of other acute medical conditions unrelated to urinary stone disease,
• Cognitive or communication impairments,
• Pregnancy.

Trial design

Primary purpose: Health Services Research

Allocation: Randomized

Interventional model: Parallel Assignment

Masking: None (Open label)

---

100 participants in 5 patient groups

Doctors Group

Experimental group

Description:

Participants consult a real urologist.

Treatment:

Behavioral: Medical Consultation

ChatGPT Group

Experimental group

Description:

Participants ask all questions to ChatGPT.

Treatment:

Behavioral: Medical Consultation

Gemini Group

Experimental group

Description:

Participants ask all questions to Gemini.

Treatment:

Behavioral: Medical Consultation

Perplexity Group

Experimental group

Description:

Participants ask all questions to Perplexity.

Treatment:

Behavioral: Medical Consultation

Copilot Group

Experimental group

Description:

Participants ask all questions to Microsoft Copilot.

Treatment:

Behavioral: Medical Consultation