Clinical Application of Automated Interpretation System for Chest X-Ray Images Based on Multimodal Large Models

Union Hospital, Tongji Medical College, Huazhong University of Science and Technology

Status: Completed

Conditions: Radiology; X-Ray; AI (Artificial Intelligence)

Treatments: Other: radiologists reference AI reports

Study type: Interventional

Funder types: Other

Identifiers

NCT07117266

Janus Pro 1B-CXR

Details and patient eligibility

About

There's a global shortage of radiologists. Radiology AI's automatic reporting is key for boosting efficiency and meeting patient needs, especially in resource-poor areas. Multimodal large models enable medical image auto-reporting systems. ChatGPT 4o can diagnose medical images but has issues like being closed-source and "hallucinations." The new open-source Janus Pro 1B-with strong performance, "any-to-any" capability, low cost, and open access-shows potential for medical imaging tasks with training. But little research explores its use here; most models are general, lacking field-specific optimization and systematic evaluation. This study will develop Janus Pro 1B-CXR (a medical image-specific model) via public data, test its value in diagnosis and reporting, and build an efficient automated system.

Full description

There is a global shortage of radiologists, and the automatic report generation function of radiology AI systems is crucial for improving medical efficiency and meeting patient needs, especially those in areas with scarce medical resources. Multimodal large models have made it possible to develop automatic report generation systems for medical images. Although ChatGPT 4o has certain capabilities in medical image diagnosis, it has issues such as being closed-source and hallucination. The recently launched open-source multimodal large model Janus-Pro has advantages including high performance, "Any to any", low cost, and open-source; after training and fine-tuning, it has the potential for medical image diagnosis and report generation. However, there is currently a lack of research on the application of Janus Pro 1B in image diagnosis; existing models are mostly general-purpose, lacking in-depth optimization for specific fields and systematic multi-dimensional evaluation methods. This study aims to develop a large model specialized in medical images, Janus Pro 1B-CXR, using public databases, verify its application value in image diagnosis and radiology report generation, and construct an efficient and accurate automated medical image analysis and diagnostic assistance system.

Enrollment: 296 patients

Sex: All

Volunteers: Accepts Healthy Volunteers

Inclusion criteria

1. clinically suspected thoracic diseases (such as pneumonia, tuberculosis, or lung cancer) requiring CXR-assisted diagnosis;
2. patients providing written informed consent for research data use;
3. complete clinical records (including chief complaints, medical history, and laboratory test results);
4. patients with no historical chest X-ray images and no need for comparison with previous chest X-ray images;
5. Patients who underwent only posteroanterior (PA) chest X-rays without lateral chest X-rays.

Exclusion criteria

1. substandard CXR image quality (including severe motion artifacts, over-/underexposure, or missing anatomical structures);
2. pregnant or lactating women.

Trial design

Primary purpose: Diagnostic

Allocation: Randomized

Interventional model: Parallel Assignment

Masking: Double Blind

---

296 participants in 2 patient groups

AI-assisted group

Experimental group

Description:

Radiologists generate reports with reference to AI reports

Treatment:

Other: radiologists reference AI reports

Standard care group

No Intervention group

Description:

Radiologists generate reports independently without referencing AI reports, following standard clinical procedures.