ChatGPT在护理问题和护理措施自主回答中的应用性研究

doi:10.3761/j.issn.1672-9234.2025.04.003

Abstract

Abstract:

Objective To evaluate the accuracy of ChatGPT-4 in autonomously answering nursing questions and measures for surgical patients，and to provide a reference for the intelligent reform of nursing education.Methods Thirty inpatient cases from a tertiary first-class hospital in 2024 were selected as analytical data. Nursing problems and measures were generated following steps of pre-training input，writing instructional prompts，and inputting instructions. Five nursing experts evaluated the accuracy based on a unified scoring standard，and consistency was tested using Fleiss’s Kappa test and Cronbach’s α coefficient.Results The accuracy of nursing questions and measures for the 30 cases was rated as “excellent” at 85.3% and 80.0%，respectively. The Fleiss’s Kappa test values for pairwise comparison of expert scores for each case ranged from 0.433 to 0.763，and the overall Cronbach’s α coefficients for nursing questions and measures across all cases were 0.908 and 0.943，respectively.Conclusion The overall accuracy of autonomously generated nursing questions and measures by ChatGPT-4 is acceptable，reflecting the potential of large language models to serve as teaching aids. However，further judgment of the generated information is necessary，which can provide a reference for the further application and development of artificial intelligence in the field of nursing education.

Key words: ChatGPT-4, Artificial Intelligence, Nursing problems, Nursing measures, Accuracy

LI Peng, ZHANG Yuanhui, TANG Long, LIU Shan, ZHENG Xiaoni, Jianchun Ji, LIU Jian, LONG Teng. Application of ChatGPT in self-directed answers to nursing problems and measures for surgical patients[J].Chinese Journal of Nursing Education, 2025, 22(4): 398-402.

References 21

[1]	Totlis T, Natsis K, Filos D, et al. The potential role of ChatGPT and artificial intelligence in anatomy education:a conversation with ChatGPT[J]. Surg Radiol Anat, 2023, 45(10):1321-1329. doi: 10.1007/s00276-023-03229-1
[2]	Karabacak M, Ozkara BB, Margetis K, et al. The advent of generative language models in medical education[J]. JMIR Med Educ, 2023, 9:e48163.
[3]	Kung TH, Cheatham M, Medenilla A, et al. Performance of ChatGPT on USMLE:potential for AI-assisted medical education using large language models[J]. PLoS Digit Health, 2023, 2(2):e0000198.
[4]	Misra SM, Suresh S. Artificial intelligence and objective structured clinical examinations:using ChatGPT to revolutionize clinical skills assessment in medical education[J]. J Med Educ Curric Dev, 2024, 11:23821205241263475.
[5]	Weidener L, Fischer M. Artificial intelligence in medicine:cross-sectional study among medical students on application,education,and ethical aspects[J]. JMIR Med Educ, 2024, 10:e51247.
[6]	Touma NJ, Caterini J, Liblk K. Is ChatGPT ready for primetime? Performance of artificial intelligence on a simulated Canadian urology board exam[J]. Can Urol Assoc J, 2024, 18(10):329-332.
[7]	Barlas T, Altinova AE, Akturk M, et al. Credibility of ChatGPT in the assessment of obesity in type 2 diabetes according to the guidelines[J]. Int J Obes(Lond), 2024, 48(2):271-275.
[8]	Gan RK, Uddin H, Gan AZ, et al. ChatGPT’s performance before and after teaching in mass casualty incident triage[J]. Sci Rep, 2023, 13(1):20350.
[9]	Aboalshamat K, Alhuzali R, Alalyani A, et al. Medical and dental professionals readiness for artificial intelligence for Saudi Arabia vision 2030[J]. Int J Pharm Res Allied Sci, 11(4):52-59.
[10]	Ghanem YK, Rouhi AD, Al-Houssan A, et al. Dr. google to dr. ChatGPT:assessing the content and quality of artificial intelligence-generated medical information on appendicitis[J]. Surg Endosc, 2024, 38(5):2887-2893. doi: 10.1007/s00464-024-10739-5 pmid: 38443499
[11]	Karacan E. Evaluating the quality of postpartum hemorrhage nursing care plans generated by artificial intelligence models[J]. J Nurs Care Qual, 2024, 39(3):206-211. doi: 10.1097/NCQ.0000000000000766 pmid: 38701406
[12]	Çakıroğlu KI, Öztürk A. Validity and reliability of the Turkish Adaptation of the Store Personality Scale[J]. BMIJ, 2020, 8(5):4273-4299.
[13]	穆兰, 徐文博, 王学通. 类ChatGPT大语言模型在护理教育中应用的实证探讨与前景展望[J]. 卫生职业教育, 2024, 42(20):4-7.
	Mu L, Xu WB, Wang XT. Empirical exploration and prospect on the application of ChatGPT-like large language model in nursing education[J]. Health Vocat Educ, 2024, 42(20):4-7.
[14]	徐文博, 陈凤敏, 王超, 等. GPT-4大语言模型对护理知识理解的测试研究[J]. 护理学杂志, 2024, 39(19):93-96.
	Xu WB, Chen FM, Wang C, et al. Testing research of GPT-4 large language model on nursing knowledge comprehension[J]. J Nurs Sci, 2024, 39(19):93-96.
[15]	王超, 孔祥辉. 大型预训练语言模型在网络健康信息鉴别中的应用探讨[J]. 农业图书情报学报, 2023, 35(6):51-59. doi: 10.13998/j.cnki.issn1002-1248.23-0288
[16]	Thirunavukarasu AJ, Hassan R, Mahmood S, et al. Trialling a large language model(ChatGPT) in general practice with the applied knowledge test:observational study demonstrating opportunities and limitations in primary care[J]. JMIR Med Educ, 2023, 9:e46599.
[17]	王雅琦, 高洁, 王克芳. 生成式人工智能在护理模拟教学中的潜在应用价值、挑战和展望[J]. 中华护理教育, 2024, 21(9):1076-1081.
	Wang YQ, Gao J, Wang KF. Potential application value,challenges,and prospects of generative artificial intelligence in nursing simulation education[J]. Chin J Nurs Educ, 2024, 21(9):1076-1081.
[18]	Branum C, Schiavenato M. Can ChatGPT accurately answer a PICOT question? Assessing AI response to a clinical question[J]. Nurse Educ, 2023, 48(5):231-233.
[19]	Elango A, Kannan N, Anandan I, et al. Testing the knowledge and interpretation skills of ChatGPT in pharmacology examination of phase Ⅱ MBBS[J]. Indian J Pharmacol, 2023, 55(4):266-267.
[20]	李晓文, 徐媛媛, 翟雪松, 等. 生成式人工智能赋能高校学生发展:国际经验与中国路径[J]. 中国远程教育, 2024(12):36-49.
	Li XW, Xu YY, Zhai XS, et al. International experience and China’s approach in empowering college students’ development through generative artificial intelligence[J]. Chin J Distance Educ, 2024(12):36-49.
[21]	刘婷, 杨富国, 杨丽, 等. 护理硕士研究生使用人工智能生成内容工具体验的质性研究[J]. 中华护理教育, 2024, 21(9):1046-1051.
	Liu T, Yang FG, Yang L, et al. A descriptive qualitative study on the experience of using artificial intelligence generated content tools among nursing postgraduate students[J]. Chin J Nurs Educ, 2024, 21(9):1046-1051.

Application of ChatGPT in self-directed answers to nursing problems and measures for surgical patients

HTML

PDF(PC)

Like

Knowledge

Abstract

Cite this article

share this article

References 21

Related Articles 13

Metrics

Comments

Recommended 10

[1]	WU Nenping, CHEN Shaohua, YU Biaojun, CHEN Xiaojing. The current situation and reflection on the application of generative artificial intelligence assisted learning for vocational nursing students [J]. Chinese Journal of Nursing Education, 2025, 22(4): 403-408.
[2]	CHEN Hong, YU Ting, XU Ke, WANG Cong, LIU Shanshan, JIANG Yan. Applications and recommendations of artificial intelligence in the smart education of nursing students [J]. Chinese Journal of Nursing Education, 2025, 22(4): 409-415.
[3]	CAO Jing, YANG Lei, LI Xiaomei. Practical pathways and future prospects of AI-powered nursing education [J]. Chinese Journal of Nursing Education, 2025, 22(4): 389-392.
[4]	WANG Mengjia, BAO Yingying, WANG Bei, ZHANG Ruixing. Research on the application of AI-assisted teaching in undergraduate Nursing Psychology course [J]. Chinese Journal of Nursing Education, 2025, 22(4): 393-397.
[5]	LIU Jingbang, XIA Yeru, WANG Li, WU Lili, GONG Xiaoyan, CAO Qinli, MAO Xiawen, ZHUANG Yiyu. Study on the effects of generative artificial intelligence in ICU novice simulation instructor case design training [J]. Chinese Journal of Nursing Education, 2025, 22(3): 272-277.
[6]	WU Juemin, WEN Fule, ZHANG Yuanyuan, ZHANG Yaqing, NIU Xiaoyin. Current status and suggestions for the development of online teaching resources for nursing education [J]. Chinese Journal of Nursing Education, 2025, 22(1): 10-15.
[7]	LIU Ting, YANG Fuguo, YANG Li, YANG Xiuling, HAN Jing, WANG Aimin. A descriptive qualitative study on the experience of using artificial intelligence generated content tools among nursing postgraduate students [J]. Chinese Journal of Nursing Education, 2024, 21(9): 1046-1051.
[8]	LI Jinliang, FAN Xiuzhen. Application of artificial intelligence in career planning and its implications for nursing education [J]. Chinese Journal of Nursing Education, 2024, 21(9): 1072-1075.
[9]	WANG Yaqi, GAO Jie, WANG Kefang. Potential application value，challenges，and prospects of generative artificial intelligence in nursing simulation education [J]. Chinese Journal of Nursing Education, 2024, 21(9): 1076-1081.
[10]	JIN Rongxiu, GUO Jingjing, LIU Suqiong, PENG Weiqun. Construction of standardized nursing language for hospitalized patients with type 2 diabetes [J]. Chinese Journal of Nursing Education, 2024, 21(7): 887-891.
[11]	ZHONG Wenxi, MAO Xianjun, CHENG Jing, MA Li, CHEN Yanhua, HU Weili. SWOT analysis of the application of GAI to the development of cross-professional communication skills in nursing [J]. Chinese Journal of Nursing Education, 2024, 21(3): 282-288.
[12]	LUO Huayu, XU Min, ZENG Chaorong, TIAN Xiaoyu, LI Xin. Prospects and challenges of ChatGPT application in the nursing field [J]. Chinese Journal of Nursing Education, 2023, 20(12): 1520-1523.
[13]	. [J]. Chinese Journal of Nursing Education, 2020, 17(10): 891-896.