收稿日期: 2025-01-02
网络出版日期: 2025-04-16
基金资助
湖南省教育厅教学改革项目(ZJGB2024324);湖南省社会科学成果评审委员会课题(XSP24YBC210)
Application of ChatGPT in self-directed answers to nursing problems and measures for surgical patients
目的 评估ChatGPT-4在外科疾病患者护理问题和护理措施自主回答的准确性,为护理教育的智能化改革提供参考。方法 选取某三级甲等医院2024年的30例外科住院患者病例为分析资料,按输入前训练、编写指令提示语、输入指令的步骤生成护理问题和护理措施,由5名护理专家根据统一的评分标准进行准确性评价,采用Fleiss’s Kappa检验和Cronbach’s α系数进行一致性检验。结果 30个案例护理问题和护理措施的准确性评为“非常好”分别占比85.3%、80.0%。每个病例的专家评分两两比较Fleiss’s Kappa检验值为0.433~0.763,所有病例护理问题和护理措施的总Cronbach’s α系数分别为0.908、0.943。结论 ChatGPT-4自主生成护理问题和护理措施的准确性整体可接受,反映出大语言模型具有成为教学辅助工具的潜力,但还需对其生成信息进一步判断,可为人工智能在护理教育领域的进一步应用和发展提供参考。
李鹏 , 张源慧 , 唐龙 , 刘杉 , 郑晓妮 , 刘坚 , 龙腾 . ChatGPT在护理问题和护理措施自主回答中的应用性研究[J]. 中华护理教育, 2025 , 22(4) : 398 -402 . DOI: 10.3761/j.issn.1672-9234.2025.04.003
Objective To evaluate the accuracy of ChatGPT-4 in autonomously answering nursing questions and measures for surgical patients,and to provide a reference for the intelligent reform of nursing education.Methods Thirty inpatient cases from a tertiary first-class hospital in 2024 were selected as analytical data. Nursing problems and measures were generated following steps of pre-training input,writing instructional prompts,and inputting instructions. Five nursing experts evaluated the accuracy based on a unified scoring standard,and consistency was tested using Fleiss’s Kappa test and Cronbach’s α coefficient.Results The accuracy of nursing questions and measures for the 30 cases was rated as “excellent” at 85.3% and 80.0%,respectively. The Fleiss’s Kappa test values for pairwise comparison of expert scores for each case ranged from 0.433 to 0.763,and the overall Cronbach’s α coefficients for nursing questions and measures across all cases were 0.908 and 0.943,respectively.Conclusion The overall accuracy of autonomously generated nursing questions and measures by ChatGPT-4 is acceptable,reflecting the potential of large language models to serve as teaching aids. However,further judgment of the generated information is necessary,which can provide a reference for the further application and development of artificial intelligence in the field of nursing education.
Key words: ChatGPT-4; Artificial Intelligence; Nursing problems; Nursing measures; Accuracy
| [1] | Totlis T, Natsis K, Filos D, et al. The potential role of ChatGPT and artificial intelligence in anatomy education:a conversation with ChatGPT[J]. Surg Radiol Anat, 2023, 45(10):1321-1329. |
| [2] | Karabacak M, Ozkara BB, Margetis K, et al. The advent of generative language models in medical education[J]. JMIR Med Educ, 2023, 9:e48163. |
| [3] | Kung TH, Cheatham M, Medenilla A, et al. Performance of ChatGPT on USMLE:potential for AI-assisted medical education using large language models[J]. PLoS Digit Health, 2023, 2(2):e0000198. |
| [4] | Misra SM, Suresh S. Artificial intelligence and objective structured clinical examinations:using ChatGPT to revolutionize clinical skills assessment in medical education[J]. J Med Educ Curric Dev, 2024, 11:23821205241263475. |
| [5] | Weidener L, Fischer M. Artificial intelligence in medicine:cross-sectional study among medical students on application,education,and ethical aspects[J]. JMIR Med Educ, 2024, 10:e51247. |
| [6] | Touma NJ, Caterini J, Liblk K. Is ChatGPT ready for primetime? Performance of artificial intelligence on a simulated Canadian urology board exam[J]. Can Urol Assoc J, 2024, 18(10):329-332. |
| [7] | Barlas T, Altinova AE, Akturk M, et al. Credibility of ChatGPT in the assessment of obesity in type 2 diabetes according to the guidelines[J]. Int J Obes(Lond), 2024, 48(2):271-275. |
| [8] | Gan RK, Uddin H, Gan AZ, et al. ChatGPT’s performance before and after teaching in mass casualty incident triage[J]. Sci Rep, 2023, 13(1):20350. |
| [9] | Aboalshamat K, Alhuzali R, Alalyani A, et al. Medical and dental professionals readiness for artificial intelligence for Saudi Arabia vision 2030[J]. Int J Pharm Res Allied Sci, 11(4):52-59. |
| [10] | Ghanem YK, Rouhi AD, Al-Houssan A, et al. Dr. google to dr. ChatGPT:assessing the content and quality of artificial intelligence-generated medical information on appendicitis[J]. Surg Endosc, 2024, 38(5):2887-2893. |
| [11] | Karacan E. Evaluating the quality of postpartum hemorrhage nursing care plans generated by artificial intelligence models[J]. J Nurs Care Qual, 2024, 39(3):206-211. |
| [12] | ?ak?ro?lu KI, ?ztürk A. Validity and reliability of the Turkish Adaptation of the Store Personality Scale[J]. BMIJ, 2020, 8(5):4273-4299. |
| [13] | 穆兰, 徐文博, 王学通. 类ChatGPT大语言模型在护理教育中应用的实证探讨与前景展望[J]. 卫生职业教育, 2024, 42(20):4-7. |
| [13] | Mu L, Xu WB, Wang XT. Empirical exploration and prospect on the application of ChatGPT-like large language model in nursing education[J]. Health Vocat Educ, 2024, 42(20):4-7. |
| [14] | 徐文博, 陈凤敏, 王超, 等. GPT-4大语言模型对护理知识理解的测试研究[J]. 护理学杂志, 2024, 39(19):93-96. |
| [14] | Xu WB, Chen FM, Wang C, et al. Testing research of GPT-4 large language model on nursing knowledge comprehension[J]. J Nurs Sci, 2024, 39(19):93-96. |
| [15] | 王超, 孔祥辉. 大型预训练语言模型在网络健康信息鉴别中的应用探讨[J]. 农业图书情报学报, 2023, 35(6):51-59. |
| [16] | Thirunavukarasu AJ, Hassan R, Mahmood S, et al. Trialling a large language model(ChatGPT) in general practice with the applied knowledge test:observational study demonstrating opportunities and limitations in primary care[J]. JMIR Med Educ, 2023, 9:e46599. |
| [17] | 王雅琦, 高洁, 王克芳. 生成式人工智能在护理模拟教学中的潜在应用价值、挑战和展望[J]. 中华护理教育, 2024, 21(9):1076-1081. |
| [17] | Wang YQ, Gao J, Wang KF. Potential application value,challenges,and prospects of generative artificial intelligence in nursing simulation education[J]. Chin J Nurs Educ, 2024, 21(9):1076-1081. |
| [18] | Branum C, Schiavenato M. Can ChatGPT accurately answer a PICOT question? Assessing AI response to a clinical question[J]. Nurse Educ, 2023, 48(5):231-233. |
| [19] | Elango A, Kannan N, Anandan I, et al. Testing the knowledge and interpretation skills of ChatGPT in pharmacology examination of phase Ⅱ MBBS[J]. Indian J Pharmacol, 2023, 55(4):266-267. |
| [20] | 李晓文, 徐媛媛, 翟雪松, 等. 生成式人工智能赋能高校学生发展:国际经验与中国路径[J]. 中国远程教育, 2024(12):36-49. |
| [20] | Li XW, Xu YY, Zhai XS, et al. International experience and China’s approach in empowering college students’ development through generative artificial intelligence[J]. Chin J Distance Educ, 2024(12):36-49. |
| [21] | 刘婷, 杨富国, 杨丽, 等. 护理硕士研究生使用人工智能生成内容工具体验的质性研究[J]. 中华护理教育, 2024, 21(9):1046-1051. |
| [21] | Liu T, Yang FG, Yang L, et al. A descriptive qualitative study on the experience of using artificial intelligence generated content tools among nursing postgraduate students[J]. Chin J Nurs Educ, 2024, 21(9):1046-1051. |
/
| 〈 |
|
〉 |