RESEARCH PAPER
 
KEYWORDS
TOPICS
ABSTRACT
Introduction and objective:
ChatGPT can generate reliable medical information in gynaecology and obstetrics,but the content is often difficult to understand for patients with lower educational levels. The aim of the study is to evaluate the impact of Audience Persona Prompting on the simplification and readability of ChatGPT-generated medical information on cervical cancer screening (MICC_GPT) in Polish.

Material and methods:
392 MICC_GPT were analyzed, with 196 generated using Zero-Shot Prompting (STANDARD) and 196 generated using Audience Persona Prompting (EASY). The Audience Persona prompts included instructions to simplify the content: ‘Explain as if to an average Polish woman with only primary education’ (8 years of formal schooling). Readability was assessed using 24 objective linguistic indicators available at Jasnopis.pl. Statistica 13 (StatSoft, Poliand), the Brunner-Munzel test, p < 0.05.

Results:
The average difficulty level of STANDARD output was 5.32 (at least 15 years of formal education), while EASY output averaged 4.15 (12 years of formal education). Of the 24 indicators, 21 showed statistically significant improvements in the simplification of EASY output (p < 0.05). While ChatGPT significantly simplified MICC_GPT, the readability levels remained too high for patients with only primary education.

Conclusions:
ChatGPT shows promise in tailoring medical information on cervical cancer (CC) screening for the needs of Polish patients with varying educational backgrounds, with the use of advanced prompt engineering techniques. However, further research is required to refine prompt engineering methods and develop effective strategies for generating information on cervical cancer screening that is accessible to individuals with only primary education.
REFERENCES (22)
1.
Plackett R, Kaushal A, Kassianos AP, et al. Use of Social Media to Promote Cancer Screening and Early Diagnosis: Scoping Review. J Med Internet Res. 2020;22(11):e21582, doi: 10.2196/21582.
 
2.
Lyson HC, Le GM, Zhang J, et al. Social Media as a Tool to Promote Health Awareness: Results from an Online Cervical Cancer Prevention Study. J Canc Educ. 2019; 34: 819–822. https://doi.org/10.1007/s13187....
 
3.
Zheng F, Wang K. The impact of social media on guideline-concordant cervical cancer-screening: insights from a national survey. Public Health. 2023 Oct;223:50–56. doi: 10.1016/j.puhe.2023.07.025.
 
4.
Ayoub NF, Lee YJ, Grimm D, et al. Comparison between ChatGPT and Google search as sources of postoperative patient instructions. JAMA Otolaryngol Head Neck Surg. 2023;149(6):556–558.
 
5.
Burns C, Bakaj A, Berishaj A, et al. Use of generative AI for improving health literacy in reproductive health: case study. JMIR Form Res. 2024;8(1):e59434.
 
6.
Ye Z, Zhang B, Zhang K, et al. An assessment of ChatGPT’s responses to frequently asked questions about cervical and breast cancer. BMC Womens Health. 2024;24(1):482.
 
7.
Deng J, Lin Y. The benefits and challenges of ChatGPT: An overview. Front Comput Intell Syst. 2022;2(2):81–83.
 
8.
Medjedovic E, Stanojevic M, Jonuzovic-Prosic S, et al. Artificial intelligence as a new answer to old challenges in maternal-fetal medicine and obstetrics. Technol Health Care. 2024;32(3):1273–1287.
 
9.
Bachmann M, Duta I, Mazey E, et al. Exploring the capabilities of ChatGPT in women’s health: obstetrics and gynaecology. NPJ Womens Health. 2024;2(1):26.
 
10.
Eoh KJ, Kwon GY, Lee EJ, et al. Efficacy of large language models and their potential in Obstetrics and Gynecology education. Obstet Gynecol Sci. 2024;67(6):550–556.
 
11.
Grünebaum A, Dudenhausen J, Chervenak FA. Enhancing patient understanding in obstetrics: The role of generative AI in simplifying informed consent for labor induction with oxytocin. J Perinat Med. 2024.
 
12.
Haver HL, Gupta AK, Ambinder EB, et al. Evaluating the use of ChatGPT to accurately simplify patient-centered information about breast cancer prevention and screening. Radiol Imaging Cancer. 2024;6(2):e230086.
 
13.
Sallam M, Barakat M, Sallam M. A Preliminary Checklist (METRICS) to standardize the design and reporting of studies on generative artificial intelligence–based models in health care education and practice: development study involving a literature review. Interact J Med Res. 2024;13(1):e54704.
 
14.
White J, Fu Q, Hays S, et al. A prompt pattern catalog to enhance prompt engineering with ChatGPT. arXiv. 2023;2302.11382.
 
15.
Rezaie-Chamani S, Mohammad-Alizadeh-Charandabi S, Kamalifard M. Knowledge, attitudes, and practice about Pap smear among women referring to a public hospital. J Family Reprod Health. 2012;6(4):177–182.
 
16.
Al Ghamdi NH. Knowledge of human papilloma virus (HPV), HPV vaccine, and Pap smear among adult Saudi women. J Family Med Prim Care. 2022;11(6):2989–2999.
 
17.
Deguara M, Calleja N, England K. Cervical cancer and screening: knowledge, awareness and attitudes of women in Malta. J Prev Med Hyg. 2021;61(4):E584–E592.
 
18.
Michalska A, Stefaniak M, Gotlib-Małkowska J. Can ChatGPT provide clear/patient-friendly and reliable information on cervical cancer screening? A study of ChatGPT-generated information in Polish. Med Sci Monit. 2025;in press.
 
19.
Statistica 13 Software, StatSoft, Poland Sp. z o.o. https://www.statsoft.pl/. Available at: https://www.statsoft.pl/. Accessed January 14, 2025.
 
20.
Schmidt S, Zimmerer A, Cucos T, et al. Simplifying radiologic reports with natural language processing: a novel approach using ChatGPT in enhancing patient understanding of MRI results. Arch Orthop Trauma Surg. 2024;144(2):611–618. doi:10.1007/s00402-023-05113-4.
 
21.
Lyu Q, Tan J, Zapadka ME, et al. Translating radiology reports into plain language using ChatGPT and GPT-4 with prompt learning: results, limitations, and potential. Vis Comput Ind Biomed Art. 2023;6(1):9. doi:10.1186/s42492-023-00136-5.
 
22.
Jeblick K, Schachtner B, Dexl J, et al. ChatGPT makes medicine easy to swallow: an exploratory case study on simplified radiology reports. Eur Radiol. 2024;34(5):2817–2825. doi:10.1007/s00330-023-10213-1.
 
eISSN:1898-2263
ISSN:1232-1966
Journals System - logo
Scroll to top