Evaluation of a Vaccine Chatbot on HPV Vaccine Confidence and Hesitancy

Fudan University

Status: Not yet enrolling

Conditions: HPV Vaccine

Treatments: Behavioral: LLM-Powered HPV Vaccine Chatbot

Study type: Interventional

Funder types: Other; Industry

Identifiers

NCT07200570

Fudan-HPV LLM chatbot

Details and patient eligibility

About

The goal of this clinical trial is to learn if a chatbot powered by artificial intelligence works to improve HPV vaccination among females aged 15 to 26 in China. A randomized controlled trial and implementation science study will be conducted targeting females as participants. The main questions it aims to answer are:

1. Does the vaccine chatbot influence women's confidence, literacy, hesitancy, and uptake of the HPV vaccine.
2. What are the public acceptance of chatbot and the facilitators and barriers to its implementation in a real-world setting.

Researchers will compare a group of women who use the chatbot with a group who do not use it to see if the chatbot is effective at helping women feel confident and willing to get vaccinated against HPV.

Participants will:

1. Be recruited and randomly allocated into one of two groups. One group will be invited to use the HPV vaccine chatbot and the other group will not get access to the vaccine chatbot until the end of the trial.
2. Complete a questionnaire survey on their confidence, literacy, and hesitancy on the HPV vaccine.
3. Have their vaccination status checked at the end of trial.

Full description

A randomized controlled trial with 2 arms will be conducted to evaluate the effectiveness of an LLM-powered chatbot on improving HPV vaccination among females aged 15 to 26, followed by a pragmatic implementation science study to assess the public acceptance of chatbot and to identify the facilitators and barriers to its implementation in a real-world setting.

The sample size is calculated based on the primary outcome of the HPV vaccination uptake among females aged 15 to 26 in China. This uptake is around 10% according to the China CDC estimation, and we assume that it can increase to 15% following the intervention. With a significance level (α) of 0.05 and 80% power (1-β=0.8), a sample size of at least 683 per group is needed to detect a 5% absolute difference in vaccination rate (from an assumed baseline rate of 10% to 15% post-intervention). The sample size is inflated to 900 per group to account for potential loss to follow-up and to ensure adequate power for a multi-center design.

Participant recruitment will be conducted across three representative regions of China. For those aged 15 to 18, their parents will be also enrolled. A randomization method will be employed to ensure balanced allocation across two groups, and the randomization sequence will be generated by an independent statistician to ensure a 1:1 allocation ratio.

Participants in the intervention group will be invited to use the HPV vaccine chatbot. The chatbot powered by a large language model (LLM), offers a scalable, accessible, and interactive platform around the HPV vaccine information. The control group will not get access to the vaccine chatbot until the end of the trial. Following the intervention, all participants will complete a questionnaire survey on their confidence, literacy, and hesitancy on the HPV vaccine. And their vaccination status will be obtained from official vaccination records at the end of trial.

The intention-to-treat (ITT) analysis will be used to evaluate the effectiveness of the intervention. Between-group comparisons will use t-tests for continuous variables and chi-square tests for categorical variables. To adjust for potential confounders, generalized estimating equation (GEE) models will be employed to provide robust effect estimates. Timing of vaccination will be evaluated using Kaplan-Meier survival curves and log-rank tests, with Cox proportional hazards models to estimate intervention effects on time-to-vaccination. Subgroup analyses will assess heterogeneity of intervention effects across populations stratified by baseline characteristics.

Enrollment: 1,800 estimated patients

Sex: Female

Ages: 15 to 26 years old

Volunteers: Accepts Healthy Volunteers

Inclusion criteria

• Female, aged 15 to 26 years, inclusive.
• Not previously vaccinated against HPV.
• Reports no contraindications to HPV vaccination.
• Has no mental, visual, or reading impairments that would preclude cooperation with study activities.
• Is willing and able to provide informed consent.

Exclusion criteria

• Male.
• Age under 15 or over 26 years.
• Has a history of prior HPV vaccination.
• Has a known contraindication to HPV vaccination.
• Unable to comply with study procedures.
• Is unwilling or unable to provide informed consent.

Trial design

Primary purpose: Health Services Research

Allocation: Randomized

Interventional model: Parallel Assignment

Masking: Single Blind

---

1,800 participants in 2 patient groups

Chatbot Intervention Group

Experimental group

Description:

Participants in this arm will be granted access to an interactive, LLM-powered HPV vaccine chatbot for a period of three months. They are invited to use the chatbot to ask any questions related to HPV and HPV vaccine to receive personalized and accurate information. The chatbot invitation will be sent every weeks to reinforce the intervention within the first month.

Treatment:

Behavioral: LLM-Powered HPV Vaccine Chatbot

Control Group

No Intervention group

Description:

Participants assigned to the control arm will receive standard care but will not have access to the HPV vaccine chatbot during the study period. For ethical considerations, participants in this arm will be offered access to the chatbot after the end of the study.