ISSN 2097-6054(网络) ISSN 1672-9234(印刷) CN 11-5289/R
主管:中国科学技术协会 主办:中华护理学会
出版:中华护理杂志社
收录:中国科学引文数据库(CSCD)来源期刊
   中国期刊全文数据库
   中国核心期刊(遴选)数据库
   Scopus
专题策划——人工智能赋能护理教育

ChatGPT在护理问题和护理措施自主回答中的应用性研究

  • 李鹏 ,
  • 张源慧 ,
  • 唐龙 ,
  • 刘杉 ,
  • 郑晓妮 ,
  • 刘坚 ,
  • 龙腾
展开
  • 413000 湖南省益阳市 湖南益阳医学高等专科学校护理学院(李鹏,郑晓妮);541001 桂林市 桂林医学院附属医院急诊医学科(张源慧),重症医学科一病区(唐龙);413000 湖南省益阳市 湖南益阳市中心医院体检中心(刘杉);澳大利亚墨尔本护理联盟Alliance Nursing Melbourne Australia(Jianchun Ji);413000 湖南省益阳市 益阳医学高等专科学校附属医院放射科(刘坚,龙腾)
李鹏,男,博士,副教授,E-mail:451792921@qq.com

收稿日期: 2025-01-02

  网络出版日期: 2025-04-16

基金资助

湖南省教育厅教学改革项目(ZJGB2024324);湖南省社会科学成果评审委员会课题(XSP24YBC210)

Application of ChatGPT in self-directed answers to nursing problems and measures for surgical patients

  • Peng LI ,
  • Yuanhui ZHANG ,
  • Long TANG ,
  • Shan LIU ,
  • Xiaoni ZHENG ,
  • Ji Jianchun ,
  • Jian LIU ,
  • Teng LONG
Expand

Received date: 2025-01-02

  Online published: 2025-04-16

摘要

目的 评估ChatGPT-4在外科疾病患者护理问题和护理措施自主回答的准确性,为护理教育的智能化改革提供参考。方法 选取某三级甲等医院2024年的30例外科住院患者病例为分析资料,按输入前训练、编写指令提示语、输入指令的步骤生成护理问题和护理措施,由5名护理专家根据统一的评分标准进行准确性评价,采用Fleiss’s Kappa检验和Cronbach’s α系数进行一致性检验。结果 30个案例护理问题和护理措施的准确性评为“非常好”分别占比85.3%、80.0%。每个病例的专家评分两两比较Fleiss’s Kappa检验值为0.433~0.763,所有病例护理问题和护理措施的总Cronbach’s α系数分别为0.908、0.943。结论 ChatGPT-4自主生成护理问题和护理措施的准确性整体可接受,反映出大语言模型具有成为教学辅助工具的潜力,但还需对其生成信息进一步判断,可为人工智能在护理教育领域的进一步应用和发展提供参考。

本文引用格式

李鹏 , 张源慧 , 唐龙 , 刘杉 , 郑晓妮 , 刘坚 , 龙腾 . ChatGPT在护理问题和护理措施自主回答中的应用性研究[J]. 中华护理教育, 2025 , 22(4) : 398 -402 . DOI: 10.3761/j.issn.1672-9234.2025.04.003

Abstract

Objective To evaluate the accuracy of ChatGPT-4 in autonomously answering nursing questions and measures for surgical patients,and to provide a reference for the intelligent reform of nursing education.Methods Thirty inpatient cases from a tertiary first-class hospital in 2024 were selected as analytical data. Nursing problems and measures were generated following steps of pre-training input,writing instructional prompts,and inputting instructions. Five nursing experts evaluated the accuracy based on a unified scoring standard,and consistency was tested using Fleiss’s Kappa test and Cronbach’s α coefficient.Results The accuracy of nursing questions and measures for the 30 cases was rated as “excellent” at 85.3% and 80.0%,respectively. The Fleiss’s Kappa test values for pairwise comparison of expert scores for each case ranged from 0.433 to 0.763,and the overall Cronbach’s α coefficients for nursing questions and measures across all cases were 0.908 and 0.943,respectively.Conclusion The overall accuracy of autonomously generated nursing questions and measures by ChatGPT-4 is acceptable,reflecting the potential of large language models to serve as teaching aids. However,further judgment of the generated information is necessary,which can provide a reference for the further application and development of artificial intelligence in the field of nursing education.

参考文献

[1] Totlis T, Natsis K, Filos D, et al. The potential role of ChatGPT and artificial intelligence in anatomy education:a conversation with ChatGPT[J]. Surg Radiol Anat, 2023, 45(10):1321-1329.
[2] Karabacak M, Ozkara BB, Margetis K, et al. The advent of generative language models in medical education[J]. JMIR Med Educ, 2023, 9:e48163.
[3] Kung TH, Cheatham M, Medenilla A, et al. Performance of ChatGPT on USMLE:potential for AI-assisted medical education using large language models[J]. PLoS Digit Health, 2023, 2(2):e0000198.
[4] Misra SM, Suresh S. Artificial intelligence and objective structured clinical examinations:using ChatGPT to revolutionize clinical skills assessment in medical education[J]. J Med Educ Curric Dev, 2024, 11:23821205241263475.
[5] Weidener L, Fischer M. Artificial intelligence in medicine:cross-sectional study among medical students on application,education,and ethical aspects[J]. JMIR Med Educ, 2024, 10:e51247.
[6] Touma NJ, Caterini J, Liblk K. Is ChatGPT ready for primetime? Performance of artificial intelligence on a simulated Canadian urology board exam[J]. Can Urol Assoc J, 2024, 18(10):329-332.
[7] Barlas T, Altinova AE, Akturk M, et al. Credibility of ChatGPT in the assessment of obesity in type 2 diabetes according to the guidelines[J]. Int J Obes(Lond), 2024, 48(2):271-275.
[8] Gan RK, Uddin H, Gan AZ, et al. ChatGPT’s performance before and after teaching in mass casualty incident triage[J]. Sci Rep, 2023, 13(1):20350.
[9] Aboalshamat K, Alhuzali R, Alalyani A, et al. Medical and dental professionals readiness for artificial intelligence for Saudi Arabia vision 2030[J]. Int J Pharm Res Allied Sci, 11(4):52-59.
[10] Ghanem YK, Rouhi AD, Al-Houssan A, et al. Dr. google to dr. ChatGPT:assessing the content and quality of artificial intelligence-generated medical information on appendicitis[J]. Surg Endosc, 2024, 38(5):2887-2893.
[11] Karacan E. Evaluating the quality of postpartum hemorrhage nursing care plans generated by artificial intelligence models[J]. J Nurs Care Qual, 2024, 39(3):206-211.
[12] ?ak?ro?lu KI, ?ztürk A. Validity and reliability of the Turkish Adaptation of the Store Personality Scale[J]. BMIJ, 2020, 8(5):4273-4299.
[13] 穆兰, 徐文博, 王学通. 类ChatGPT大语言模型在护理教育中应用的实证探讨与前景展望[J]. 卫生职业教育, 2024, 42(20):4-7.
[13] Mu L, Xu WB, Wang XT. Empirical exploration and prospect on the application of ChatGPT-like large language model in nursing education[J]. Health Vocat Educ, 2024, 42(20):4-7.
[14] 徐文博, 陈凤敏, 王超, 等. GPT-4大语言模型对护理知识理解的测试研究[J]. 护理学杂志, 2024, 39(19):93-96.
[14] Xu WB, Chen FM, Wang C, et al. Testing research of GPT-4 large language model on nursing knowledge comprehension[J]. J Nurs Sci, 2024, 39(19):93-96.
[15] 王超, 孔祥辉. 大型预训练语言模型在网络健康信息鉴别中的应用探讨[J]. 农业图书情报学报, 2023, 35(6):51-59.
[16] Thirunavukarasu AJ, Hassan R, Mahmood S, et al. Trialling a large language model(ChatGPT) in general practice with the applied knowledge test:observational study demonstrating opportunities and limitations in primary care[J]. JMIR Med Educ, 2023, 9:e46599.
[17] 王雅琦, 高洁, 王克芳. 生成式人工智能在护理模拟教学中的潜在应用价值、挑战和展望[J]. 中华护理教育, 2024, 21(9):1076-1081.
[17] Wang YQ, Gao J, Wang KF. Potential application value,challenges,and prospects of generative artificial intelligence in nursing simulation education[J]. Chin J Nurs Educ, 2024, 21(9):1076-1081.
[18] Branum C, Schiavenato M. Can ChatGPT accurately answer a PICOT question? Assessing AI response to a clinical question[J]. Nurse Educ, 2023, 48(5):231-233.
[19] Elango A, Kannan N, Anandan I, et al. Testing the knowledge and interpretation skills of ChatGPT in pharmacology examination of phase Ⅱ MBBS[J]. Indian J Pharmacol, 2023, 55(4):266-267.
[20] 李晓文, 徐媛媛, 翟雪松, 等. 生成式人工智能赋能高校学生发展:国际经验与中国路径[J]. 中国远程教育, 2024(12):36-49.
[20] Li XW, Xu YY, Zhai XS, et al. International experience and China’s approach in empowering college students’ development through generative artificial intelligence[J]. Chin J Distance Educ, 2024(12):36-49.
[21] 刘婷, 杨富国, 杨丽, 等. 护理硕士研究生使用人工智能生成内容工具体验的质性研究[J]. 中华护理教育, 2024, 21(9):1046-1051.
[21] Liu T, Yang FG, Yang L, et al. A descriptive qualitative study on the experience of using artificial intelligence generated content tools among nursing postgraduate students[J]. Chin J Nurs Educ, 2024, 21(9):1046-1051.
文章导航

/