Impact of GPT Use on Essay Writing Performance and Cognitive Abilities

University Hospital Heidelberg

Status: Completed

Conditions: Cognitive Change; Well-Being, Psychological

Treatments: Behavioral: GPT Support

Study type: Interventional

Funder types: Other

Identifiers

NCT06511102

S-117/2024

Details and patient eligibility

About

The goal of this randomized controlled lab experiment is to examine if using generated artificial intelligence (AI) technology will affect people's academic performance and cognitive abilities in the context of analytical writing among college students. The main questions it aims to answer are:

1. Does using the technology affect students' writing performance?
2. Does using the technology affect students' cognitive effort during the writing process?

Participants will be randomly assigned to either a control group, which is writing without AI assistance, or an experimental group, which is writing with the assistance of ChatGPT. Researchers will compare the two groups to see if ChatGPT affects students' writing performance and cognitive effort.

For each participant, the lab experiment will last for no more than 1.5 hours. An eye-tracker will monitor the participant's gaze activities and pupil size. A functional near-infrared spectroscopy (fNIRS) will monitor the participant's brain activities in the frontal lobe. During the experiment, participants will be asked to:

1. Read learning materials on analytical writing techniques.
2. Based on the previously provided materials, complete an analytical writing assignment that will take approximately 30 minutes either with or without the aid of ChatGPT.
3. Answer survey questions about their experience with the writing assignment, attitudes on using ChatGPT, and demographic backgrounds.

Enrollment: 160 patients

Sex: All

Ages: 18 to 35 years old

Volunteers: Accepts Healthy Volunteers

Inclusion and exclusion criteria

Inclusion Criteria:

• Full-time university student.
• Able to read and write in English.
• Use the computer most days of the week.
• Have not taken, nor currently preparing for, the Graduate Record Examinations (GRE).
• Do not wear glasses (contact lenses are allowed).
• Have no eye impairment.
• Not currently taking any opioids, epinephrine, or anti-hypertensive drugs.
• During the experiment, not wearing any makeup around the eyes.

Trial design

Primary purpose: Other

Allocation: Randomized

Interventional model: Parallel Assignment

Masking: Single Blind

---

160 participants in 2 patient groups

Intervention arm

Experimental group

Description:

In the intervention arm, participants are instructed to use ChatGPT for assistance to complete an analytical writing task.

Treatment:

Behavioral: GPT Support

Control arm

No Intervention group

Description:

In the control arm, participants are instructed to complete an analytical writing task independently without access to any technology assistance.