护理情境模拟教学中学生团队协作能力多模态评估的范围综述

doi:10.3761/j.issn.1672-9234.2026.03.005

摘要/Abstract

摘要：

目的对护理情境模拟教学中学生团队协作能力多模态学习评估的相关研究进行范围综述，总结多模态学习评估的应用现状与局限性。方法系统检索中国知网、万方、维普、Web of Science、EBSCO、IEEE Xplore、ACM数据库建库至2025年11月12日收录的中英文文献及Google Scholar数据库中相关主题的前100篇文献，文献筛选后，进行资料提取和分析。结果共纳入13篇文献，护理情境模拟教学中学生团队协作能力的多模态学习评估最常采用音频、视频和空间数据组合的多模态评估形式。构建的多种评估系统实现了从描述性到预测性、解释性的多维度评估。所评估的团队协作能力可归纳为认知与沟通能力、执行与协调能力、空间行为模式及生理与情感状态4个维度。当前存在的主要研究局限为评估指标缺乏统一标准，数据整合与解读主观性强；评估系统在数据质量、自动化程度及可用性方面仍有待优化；研究设计存在场景普适性差、样本代表性不足及隐私伦理考量欠缺等问题。结论多模态学习评估能多方位捕捉学生在护理情境模拟教学中的团队协作能力，但其发展仍处于初级阶段。未来研究应致力于建立标准化的评估指标体系，利用人工智能技术提升数据处理的自动化与智能化水平，并在多场景、大样本中验证评估系统的有效性，同时加强隐私保护与伦理规范建设。

关键词: 教育, 护理, 情境模拟教学, 多模态学习分析, 协作能力, 范围综述

Abstract:

Objective To conduct a scoping review of multimodal learning analytics （MMLA） for assessing nursing students’ teamwork competence in scenario simulation teaching，summarize its application status and limitations，and offer scientific evidence for practice. Methods We systematically searched CNKI，Wanfang Data，VIP，Web of Science，EBSCO，IEEE Xplore，and ACM Digital Library from database inception to November 12，2025，as well as the top 100 literatures on relevant topics in the Google Scholar database. Literatures were screened per inclusion/exclusion criteria，with relevant data extracted and analyzed. Results A total of thirteen studies were included. The most common MMLA format for assessing teamwork competence combined audio，video，and spatial data. Various constructed assessment systems enabled multidimensional evaluation ranging from descriptive to predictive and explanatory approaches. The assessed teamwork competencies were categorized into four dimensions：cognitive and communication skills，execution and coordination skills，spatial behavior patterns，and physiological and emotional states. Key limitations included：lack of unified assessment standards and subjective data interpretation；suboptimal data quality，automation，and usability of existing systems；poor scenario generalizability，insufficient sample representativeness；and inadequate privacy/ethical considerations. Conclusion MMLA can effectively capture nursing students’ teamwork processes in scenario simulation teaching but is still in the early development stage. Future research should focus on establishing standardized assessment indicators，enhancing AI-driven data processing automation/intelligence，verifying system effectiveness in multi-scenario and large-sample settings，as well as strengthening privacy protection and ethical norms.

Key words: Education, Nursing, Scenario Simulation Teaching, Multimodal Learning Analytics, Teamwork Competence, Scoping Review

颜筱茜, 王梓羽, 陈欧, 李静, 郭玉芳. 护理情境模拟教学中学生团队协作能力多模态评估的范围综述[J]. 中华护理教育, 2026, 23(3): 286-293.

YAN Xiaoqian, WANG Ziyu, CHEN Ou, LI Jing, GUO Yufang. A scoping review of multimodal learning analytics for students’ teamwork competence in nursing scenario simulation teaching[J]. Chinese Journal of Nursing Education, 2026, 23(3): 286-293.

图/表 2

参考文献 39

[1]	Chen CY, Tang M, Yang AB. Progress in a multimodal learning evaluation based on artificial intelligence[J]. Front Educ Res, 2024, 7(7):22-27.
[2]	Monsalves D, Cornide-Reyes H, Riquelme F. Relationships between social interactions and belbin role types in collaborative agile teams[J]. IEEE Access, 2023, 11:17002-17020. doi: 10.1109/ACCESS.2023.3245325
[3]	Blikstein P, Worsley M. Multimodal learning analytics and education data mining:using computational technologies to measure complex learning tasks[J]. J Learn Anal, 2016, 3(2):220-238.
[4]	Qushem UB, Christopoulos A, Laakso MJ. The value proposition of an integrated multimodal learning analytics framework[C]// Proceedings of the 45th Jubilee International Convention on Information,Communication and Electronic Technology(MIPRO). Opatija,Croatia:IEEE,2022:666-671.
[5]	Alwahaby H, Cukurova M, Papamitsiou Z, et al. The evidence of impact and ethical considerations of multimodal learning analytics:a systematic literature review[M]//The multimodal learning analytics handbook. Cham: Springer International Publishing,2022:289-325.
[6]	Ochoa X. Multimodal learning analytics:rationale,process,examples,and direction[M]//Lang C,Siemens G,Wise AF et al. Handbook of learning analytics. 2nd ed. Vancouver,BC:SoLAR,2022:54-65.
[7]	Schwengel D, Villagrán I, Miller G, et al. Multimodal assessment in clinical simulations:a guide for moving towards precision education[J]. Med Sci Educ, 2025, 35(2):1025-1034. doi: 10.1007/s40670-024-02221-7 pmid: 40353039
[8]	Yürüm OR. Technology-enhanced multimodal learning analytics in higher education:a systematic literature review[J]. IEEE Access, 2025, 13:92057-92073. doi: 10.1109/ACCESS.2025.3572467
[9]	Schwendimann BA, Rodríguez-Triana MJ, Vozniuk A, et al. Perceiving learning at a glance:a systematic literature review of learning dashboard research[J]. IEEE Trans Learn Technol, 2017, 10(1):30-41. doi: 10.1109/TLT.2016.2599522
[10]	Di Mitri D. Digital learning projection:learning performance estimation from multimodal learning experiences[C]//Proceedings of the 18th International Conference on Artificial Intelligence in Education. Cham:Springer International Publishing,2017:609-612.
[11]	Cukurova M, Giannakos M, Martinez-Maldonado R. The promise and challenges of multimodal learning analytics[J]. Br J Educ Technol, 2020, 51(5):1441-1449. doi: 10.1111/bjet.v51.5
[12]	Wise AF, Knight S, Shum SB. Collaborative learning analy-tics[M]// International handbook of computer-supported collaborative learning. Cham: Springer International Publishing, 2021:425-443.
[13]	Peters MDJ, Marnie C, Tricco AC, et al. Updated methodological guidance for the conduct of scoping reviews[J]. JBI Evid Synth, 2020, 18(10):2119-2126. doi: 10.11124/JBIES-20-00167 pmid: 33038124
[14]	Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews(PRISMA-ScR):checklist and explanation[J]. Ann Intern Med, 2018, 169(7):467-473. doi: 10.7326/M18-0850
[15]	Alwahaby H, Cukurova M, Papamitsiou Z, et al. The evidence of impact and ethical considerations of multimodal learning analytics:a systematic literature review[M]//The multimodal learning analytics handbook. Cham: Springer International Publishing, 2022:289-325.
[16]	Matcha W, Uzir NA, Gašević D, et al. A systematic review of empirical studies on learning analytics dashboards：a self-regulated learning perspective[J]. IEEE Trans Learn Technol, 2020: 13(2):226-245.
[17]	Stevens MJ, Campion MA. Staffing work teams:development and validation of a selection test for teamwork settings[J]. J Manag, 1999, 25(2):207-228.
[18]	Hairida H, Marmawi M, Kartono K. An analysis of students’ collaboration skills in science learning through inquiry and project-based learning[J]. Tadris:Jurnal Keguruan dan Ilmu Tarbiyah, 2021, 6(2):219-228. doi: 10.24042/tadris.v6i2.9320
[19]	Zhao LX, Echeverria V, Swiecki Z, et al. Epistemic network analysis for end-users:closing the loop in the context of multimodal analytics for collaborative team learning[C]//Proceedings of the 14th Learning Analytics and Knowledge Conference. March 18-22,2024,Kyoto,Japan:ACM,2024:90-100.
[20]	Martinez-Maldonado R, Echeverria V, Fernandez-Nieto G, et al. Lessons learnt from a multimodal learning analytics deployment in-the-wild[J]. TOCHI, 2023, 31(1):1-41.
[21]	Joshi V, Akiri S, Taherzadeh S, et al. Investigating differences in paramedic trainees’ multimodal interaction during low and high physiological synchrony[C]//Proceedings of the 27th International Conference on Multimodal Interaction. Canberra Australia:ACM,2025:526-534.
[22]	Sánchez D. Learning under stress:enhancing team-based simulation training with multimodal data[C]//Proceedings of the 17th International Conference on Computer-Supported Collaborative Learning. Buffalo,NY,USA:International Society of the Learning Sciences,2024:225-228.
[23]	Shah M, Tan YR, Eagan B, et al. A dual-method examination of nursing students’ teamwork in simulation-based learning:combining CORDTRA and ordered network analysis to reveal patterns and dynamics[C]//Proceedings of the 15th International Learning Analytics and Knowledge Conference. Dublin Ireland:ACM,2025:858-864.
[24]	Yan LX, Gasevic D, Echeverria V, et al. From complexity to parsimony:integrating latent class analysis to uncover multimodal learning patterns in collaborative learning[C]//Proceedings of the 15th International Learning Analytics and Knowledge Conference. Dublin,Ireland:ACM,2025:70-81.
[25]	Echeverria V, Martinez-Maldonado R, Yan LX, et al. HuCETA:a framework for human-centered embodied teamwork analytics[J]. IEEE Pervasive Comput, 2023, 22(1):39-49. doi: 10.1109/MPRV.2022.3217454
[26]	Fernandez-Nieto GM, Echeverria V, Shum SB, et al. Storytelling with learner data:guiding student reflection on multimodal team data[J]. IEEE Trans Learn Technol, 2021, 14(5):695-708. doi: 10.1109/TLT.2021.3131842
[27]	Echeverria V, Zhao LX, Alfredo R, et al. TeamVision:an AI-powered learning analytics system for supporting reflection in team-based healthcare simulation[C]//Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. Yokohama,Japan:ACM,2025:1-22.
[28]	Ronda-Carracao MA, Santos OC, Fernandez-Nieto G, et al. Towards exploring stress reactions in teamwork using multimodal physiological data[C]//Proceedings of the First International Workshop on Multimodal Artificial Intelligence in Education(MAIED 2021):at the 22nd International Conference on Artificial Intelligence in Education(AIED 2021). Utrecht,Netherlands:CEUR-WS,2021:49-60.
[29]	Feng SH, Yan LX, Zhao LX, et al. Heterogenous network analytics of small group teamwork:using multimodal data to uncover individual behavioral engagement strategies[C]//Proceedings of the 14th Learning Analytics and Knowledge Conference. Kyoto,Japan:ACM,2024:587-597.
[30]	YAN LX, Gašević D, Echeverria V, et al. In sync or out of sync? Understanding stress and learning performance in collaborative healthcare simulations through physiological synchrony and arousal[J]. Int J Artif Intell Educ, 2025: 35(4):2421-2452.
[31]	Vatral C, Biswas G, Cohn C, et al. Using the DiCoT framework for integrated multimodal analysis in mixed-reality training environments[J]. Front Artif Intell, 2022, 5:941825. doi: 10.3389/frai.2022.941825
[32]	Meier A, Spada H, Rummel N. A rating scheme for assessing the quality of computer-supported collaboration processes[J]. Int J Comput Support Collab Learn, 2007, 2(1):63-86. doi: 10.1007/s11412-006-9005-x
[33]	Echeverria V, Martinez-Maldonado R, Buckingham Shum S. Towards collaboration translucence:giving meaning to multimodal group data[C]//Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Glasgow Scotland UK:ACM,2019:1-16.
[34]	Echeverria V, Yan LX, Zhao LX, et al. TeamSlides:a multimodal teamwork analytics dashboard for teacher-guided reflection in a physical learning space[C]//Proceedings of the 14th Learning Analytics and Knowledge Conference. Kyoto,Japan: ACM,2024:112-122.
[35]	Zhao LX, Swiecki Z, Gasevic D, et al. METS:multimodal learning analytics of embodied teamwork learning[C]//LAK23:13th International Learning Analytics and Knowledge Conference. Arlington,TX,USA:ACM,2023:186-196.
[36]	Kröger J. Unexpected inferences from sensor data:a hidden privacy threat in the Internet of Things[C]//Internet of Things. Information Processing in an Increasingly Connected World. Cham:Springer,2019:147-159.
[37]	Prinsloo P, Slade S, Khalil M. Multimodal learning analytics:in-between student privacy and encroachment:a systematic review[J]. Br J Educ Technol, 2023, 54(6):1566-1586. doi: 10.1111/bjet.v54.6
[38]	Martinez-Maldonado R, Kay J, Buckingham Shum S, et al. Collocated collaboration analytics:principles and dilemmas for mining multimodal interaction data[J]. Hum-Comput Interact, 2019, 34(1):1-50. doi: 10.1080/07370024.2017.1338956
[39]	Alwahaby H. The ethical implications of using Multimodal Learning Analytics:a framework for research and practice[D]. London: University College London, 2025.