AHCI RESEARCH GROUP
Publications
Papers published in international journals,
proceedings of conferences, workshops and books.
OUR RESEARCH
Scientific Publications
How to
Here you can find the complete list of our publications.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
2025
Li, Y.; Pang, E. C. H.; Ng, C. S. Y.; Azim, M.; Leung, H.
Enhancing Linear Algebra Education with AI-Generated Content in the CityU Metaverse: A Comparative Study Proceedings Article
In: T., Hao; J.G., Wu; X., Luo; Y., Sun; Y., Mu; S., Ge; W., Xie (Ed.): Lect. Notes Comput. Sci., pp. 3–16, Springer Science and Business Media Deutschland GmbH, 2025, ISBN: 03029743 (ISSN); 978-981964406-3 (ISBN).
Abstract | Links | BibTeX | Tags: Comparatives studies, Digital age, Digital interactions, digital twin, Educational metaverse, Engineering education, Generative AI, Immersive, Matrix algebra, Metaverse, Metaverses, Personnel training, Students, Teaching, University campus, Virtual environments, virtual learning environment, Virtual learning environments, Virtual Reality, Virtualization
@inproceedings{li_enhancing_2025,
title = {Enhancing Linear Algebra Education with AI-Generated Content in the CityU Metaverse: A Comparative Study},
author = {Y. Li and E. C. H. Pang and C. S. Y. Ng and M. Azim and H. Leung},
editor = {Hao T. and Wu J.G. and Luo X. and Sun Y. and Mu Y. and Ge S. and Xie W.},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-105003632691&doi=10.1007%2f978-981-96-4407-0_1&partnerID=40&md5=c067ba5d4c15e9c0353bf315680531fc},
doi = {10.1007/978-981-96-4407-0_1},
isbn = {03029743 (ISSN); 978-981964406-3 (ISBN)},
year = {2025},
date = {2025-01-01},
booktitle = {Lect. Notes Comput. Sci.},
volume = {15589 LNCS},
pages = {3–16},
publisher = {Springer Science and Business Media Deutschland GmbH},
abstract = {In today’s digital age, the metaverse is emerging as the forthcoming evolution of the internet. It provides an immersive space that marks a new frontier in the way digital interactions are facilitated and experienced. In this paper, we present the CityU Metaverse, which aims to construct a digital twin of our university campus. It is designed as an educational virtual world where learning applications can be embedded in this virtual campus, supporting not only remote and collaborative learning but also professional technical training to enhance educational experiences through immersive and interactive learning. To evaluate the effectiveness of this educational metaverse, we conducted an experiment focused on 3D linear transformation in linear algebra, with teaching content generated by generative AI, comparing our metaverse system with traditional teaching methods. Knowledge tests and surveys assessing learning interest revealed that students engaged with the CityU Metaverse, facilitated by AI-generated content, outperformed those in traditional settings and reported greater enjoyment during the learning process. The work provides valuable perspectives on the behaviors and interactions within the metaverse by analyzing user preferences and learning outcomes. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.},
keywords = {Comparatives studies, Digital age, Digital interactions, digital twin, Educational metaverse, Engineering education, Generative AI, Immersive, Matrix algebra, Metaverse, Metaverses, Personnel training, Students, Teaching, University campus, Virtual environments, virtual learning environment, Virtual learning environments, Virtual Reality, Virtualization},
pubstate = {published},
tppubtype = {inproceedings}
}
In today’s digital age, the metaverse is emerging as the forthcoming evolution of the internet. It provides an immersive space that marks a new frontier in the way digital interactions are facilitated and experienced. In this paper, we present the CityU Metaverse, which aims to construct a digital twin of our university campus. It is designed as an educational virtual world where learning applications can be embedded in this virtual campus, supporting not only remote and collaborative learning but also professional technical training to enhance educational experiences through immersive and interactive learning. To evaluate the effectiveness of this educational metaverse, we conducted an experiment focused on 3D linear transformation in linear algebra, with teaching content generated by generative AI, comparing our metaverse system with traditional teaching methods. Knowledge tests and surveys assessing learning interest revealed that students engaged with the CityU Metaverse, facilitated by AI-generated content, outperformed those in traditional settings and reported greater enjoyment during the learning process. The work provides valuable perspectives on the behaviors and interactions within the metaverse by analyzing user preferences and learning outcomes. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.
Su, Z.
Integrating digital twin and large language models for advanced tower crane monitoring Proceedings Article
In: pp. 1133–1137, Institute of Electrical and Electronics Engineers Inc., 2025, ISBN: 9798331532598 (ISBN).
Abstract | Links | BibTeX | Tags: Alarm systems, Anomaly detection, Behavioral Research, Cognitive Systems, Computer architecture, digital twin, Language Model, Large language model, Manual inspection, Micro services, Micro-service, Monitoring approach, Multi-modal, Operational safety, Real- time, Risk perception, Safety engineering, Three dimensional computer graphics, Tower Crane Monitoring, Tower cranes, Virtual Reality, Visualization
@inproceedings{su_integrating_2025,
title = {Integrating digital twin and large language models for advanced tower crane monitoring},
author = {Z. Su},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-105010831175&doi=10.1109%2FEEICE65049.2025.11033896&partnerID=40&md5=cba8e7e255ee4c394b6c47a996977fc9},
doi = {10.1109/EEICE65049.2025.11033896},
isbn = {9798331532598 (ISBN)},
year = {2025},
date = {2025-01-01},
pages = {1133–1137},
publisher = {Institute of Electrical and Electronics Engineers Inc.},
abstract = {Traditional monitoring approaches for tower crane operational safety primarily rely on manual inspections and univariate sensor threshold alarms, which exhibit significant limitations including delayed dynamic response and insufficient risk prediction capabilities, failing to meet real-time safety requirements in complex construction scenarios. To address these challenges, this study proposes an innovative intelligent monitoring system that integrates digital twin technology with multimodal large language models (MLLMs). The system first constructs a 3D digital twin of the crane using IoT-enabled digital twin technology, establishing multidimensional dynamic mapping between physical entities and virtual models to create a comprehensive digital representation encompassing mechanical structures, motion trajectories, and environmental parameters. Building upon this foundation, a multimodal MLLM-based analytical framework is designed to intelligently process surveillance video streams and identify potential safety hazards. The system employs a microservices architecture to develop a web-based visualization platform that integrates real-time situational awareness, abnormal behavior detection, operational status monitoring, and early warning functionalities. Experimental results demonstrate the system's capability to monitor crane operations in real time while effectively identifying potential risks and anomalies. The research contributes novel methodologies for digital twin construction, multimodal cognitive model architectures, and virtual-physical fusion warning mechanisms, providing both theoretical foundations and practical solutions for advancing safety management systems in construction sites. © 2025 Elsevier B.V., All rights reserved.},
keywords = {Alarm systems, Anomaly detection, Behavioral Research, Cognitive Systems, Computer architecture, digital twin, Language Model, Large language model, Manual inspection, Micro services, Micro-service, Monitoring approach, Multi-modal, Operational safety, Real- time, Risk perception, Safety engineering, Three dimensional computer graphics, Tower Crane Monitoring, Tower cranes, Virtual Reality, Visualization},
pubstate = {published},
tppubtype = {inproceedings}
}
Traditional monitoring approaches for tower crane operational safety primarily rely on manual inspections and univariate sensor threshold alarms, which exhibit significant limitations including delayed dynamic response and insufficient risk prediction capabilities, failing to meet real-time safety requirements in complex construction scenarios. To address these challenges, this study proposes an innovative intelligent monitoring system that integrates digital twin technology with multimodal large language models (MLLMs). The system first constructs a 3D digital twin of the crane using IoT-enabled digital twin technology, establishing multidimensional dynamic mapping between physical entities and virtual models to create a comprehensive digital representation encompassing mechanical structures, motion trajectories, and environmental parameters. Building upon this foundation, a multimodal MLLM-based analytical framework is designed to intelligently process surveillance video streams and identify potential safety hazards. The system employs a microservices architecture to develop a web-based visualization platform that integrates real-time situational awareness, abnormal behavior detection, operational status monitoring, and early warning functionalities. Experimental results demonstrate the system's capability to monitor crane operations in real time while effectively identifying potential risks and anomalies. The research contributes novel methodologies for digital twin construction, multimodal cognitive model architectures, and virtual-physical fusion warning mechanisms, providing both theoretical foundations and practical solutions for advancing safety management systems in construction sites. © 2025 Elsevier B.V., All rights reserved.
Kim, M.; Kim, T.; Lee, K. -T.
3D Digital Human Generation from a Single Image Using Generative AI with Real-Time Motion Synchronization Journal Article
In: Electronics (Switzerland), vol. 14, no. 4, 2025, ISSN: 20799292 (ISSN), (Publisher: Multidisciplinary Digital Publishing Institute (MDPI)).
Abstract | Links | BibTeX | Tags: 3D digital human, 3D human generation, digital twin, Generative AI, pose estimation, real-time motion synchronization, single image processing, SMPL-X, Unity 3D
@article{kim_3d_2025,
title = {3D Digital Human Generation from a Single Image Using Generative AI with Real-Time Motion Synchronization},
author = {M. Kim and T. Kim and K. -T. Lee},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85218855876&doi=10.3390%2Felectronics14040777&partnerID=40&md5=6070c8effc2d0232edd901f0df9e85d0},
doi = {10.3390/electronics14040777},
issn = {20799292 (ISSN)},
year = {2025},
date = {2025-01-01},
journal = {Electronics (Switzerland)},
volume = {14},
number = {4},
abstract = {The generation of 3D digital humans has traditionally relied on multi-view imaging systems and large-scale datasets, posing challenges in cost, accessibility, and real-time applicability. To overcome these limitations, this study presents an efficient pipeline that constructs high-fidelity 3D digital humans from a single frontal image. By leveraging generative AI, the system synthesizes additional views and generates UV maps compatible with the SMPL-X model, ensuring anatomically accurate and photorealistic reconstructions. The generated 3D models are imported into Unity 3D, where they are rigged for real-time motion synchronization using BlazePose-based lightweight pose estimation. To further enhance motion realism, custom algorithms—including ground detection and rotation smoothing—are applied, improving movement stability and fluidity. The system was rigorously evaluated through both quantitative and qualitative analyses. Results show an average generation time of 211.1 s, segmentation accuracy of 92.1%, and real-time rendering at 64.4 FPS. In qualitative assessments, expert reviewers rated the system using the SUS usability framework and heuristic evaluation, confirming its usability and effectiveness. This method eliminates the need for multi-view cameras or depth sensors, significantly reducing the barrier to entry for real-time 3D avatar creation and interactive AI-driven applications. It has broad applications in virtual reality (VR), gaming, digital content creation, AI-driven simulation, digital twins, and telepresence systems. By introducing a scalable and accessible 3D modeling pipeline, this research lays the groundwork for future advancements in immersive and interactive environments. © 2025 Elsevier B.V., All rights reserved.},
note = {Publisher: Multidisciplinary Digital Publishing Institute (MDPI)},
keywords = {3D digital human, 3D human generation, digital twin, Generative AI, pose estimation, real-time motion synchronization, single image processing, SMPL-X, Unity 3D},
pubstate = {published},
tppubtype = {article}
}
The generation of 3D digital humans has traditionally relied on multi-view imaging systems and large-scale datasets, posing challenges in cost, accessibility, and real-time applicability. To overcome these limitations, this study presents an efficient pipeline that constructs high-fidelity 3D digital humans from a single frontal image. By leveraging generative AI, the system synthesizes additional views and generates UV maps compatible with the SMPL-X model, ensuring anatomically accurate and photorealistic reconstructions. The generated 3D models are imported into Unity 3D, where they are rigged for real-time motion synchronization using BlazePose-based lightweight pose estimation. To further enhance motion realism, custom algorithms—including ground detection and rotation smoothing—are applied, improving movement stability and fluidity. The system was rigorously evaluated through both quantitative and qualitative analyses. Results show an average generation time of 211.1 s, segmentation accuracy of 92.1%, and real-time rendering at 64.4 FPS. In qualitative assessments, expert reviewers rated the system using the SUS usability framework and heuristic evaluation, confirming its usability and effectiveness. This method eliminates the need for multi-view cameras or depth sensors, significantly reducing the barrier to entry for real-time 3D avatar creation and interactive AI-driven applications. It has broad applications in virtual reality (VR), gaming, digital content creation, AI-driven simulation, digital twins, and telepresence systems. By introducing a scalable and accessible 3D modeling pipeline, this research lays the groundwork for future advancements in immersive and interactive environments. © 2025 Elsevier B.V., All rights reserved.
Tang, M.; Nikolaenko, M.; Alrefai, A.; Kumar, A.
Metaverse and Digital Twins in the Age of AI and Extended Reality Journal Article
In: Architecture, vol. 5, no. 2, 2025, ISSN: 26738945 (ISSN), (Publisher: Multidisciplinary Digital Publishing Institute (MDPI)).
Abstract | Links | BibTeX | Tags: AI, digital twin, Extended reality, Metaverse
@article{tang_metaverse_2025,
title = {Metaverse and Digital Twins in the Age of AI and Extended Reality},
author = {M. Tang and M. Nikolaenko and A. Alrefai and A. Kumar},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-105008903949&doi=10.3390%2Farchitecture5020036&partnerID=40&md5=41eb293a38d18d1151b4973ea0993824},
doi = {10.3390/architecture5020036},
issn = {26738945 (ISSN)},
year = {2025},
date = {2025-01-01},
journal = {Architecture},
volume = {5},
number = {2},
abstract = {This paper explores the evolving relationship between Digital Twins (DT) and the Metaverse, two foundational yet often conflated digital paradigms in digital architecture. While DTs function as mirrored models of real-world systems—integrating IoT, BIM, and real-time analytics to support decision-making—Metaverses are typically fictional, immersive, multi-user environments shaped by social, cultural, and speculative narratives. Through several research projects, the team investigate the divergence between DTs and Metaverses through the lens of their purpose, data structure, immersion, and interactivity, while highlighting areas of convergence driven by emerging technologies in Artificial Intelligence (AI) and Extended Reality (XR).This study aims to investigate the convergence of DTs and the Metaverse in digital architecture, examining how emerging technologies—such as AI, XR, and Large Language Models (LLMs)—are blurring their traditional boundaries. By analyzing their divergent purposes, data structures, and interactivity modes, as well as hybrid applications (e.g., data-integrated virtual environments and AI-driven collaboration), this study seeks to define the opportunities and challenges of this integration for architectural design, decision-making, and immersive user experiences. Our research spans multiple projects utilizing XR and AI to develop DT and the Metaverse. The team assess the capabilities of AI in DT environments, such as reality capture and smart building management. Concurrently, the team evaluates metaverse platforms for online collaboration and architectural education, focusing on features facilitating multi-user engagement. The paper presents evaluations of various virtual environment development pipelines, comparing traditional BIM+IoT workflows with novel approaches such as Gaussian Splatting and generative AI for content creation. The team further explores the integration of Large Language Models (LLMs) in both domains, such as virtual agents or LLM-powered Non-Player-Controlled Characters (NPC), enabling autonomous interaction and enhancing user engagement within spatial environments. Finally, the paper argues that DTs and Metaverse’s once-distinct boundaries are becoming increasingly porous. Hybrid digital spaces—such as virtual buildings with data-integrated twins and immersive, social metaverses—demonstrate this convergence. As digital environments mature, architects are uniquely positioned to shape these dual-purpose ecosystems, leveraging AI, XR, and spatial computing to fuse data-driven models with immersive and user-centered experiences. © 2025 Elsevier B.V., All rights reserved.},
note = {Publisher: Multidisciplinary Digital Publishing Institute (MDPI)},
keywords = {AI, digital twin, Extended reality, Metaverse},
pubstate = {published},
tppubtype = {article}
}
This paper explores the evolving relationship between Digital Twins (DT) and the Metaverse, two foundational yet often conflated digital paradigms in digital architecture. While DTs function as mirrored models of real-world systems—integrating IoT, BIM, and real-time analytics to support decision-making—Metaverses are typically fictional, immersive, multi-user environments shaped by social, cultural, and speculative narratives. Through several research projects, the team investigate the divergence between DTs and Metaverses through the lens of their purpose, data structure, immersion, and interactivity, while highlighting areas of convergence driven by emerging technologies in Artificial Intelligence (AI) and Extended Reality (XR).This study aims to investigate the convergence of DTs and the Metaverse in digital architecture, examining how emerging technologies—such as AI, XR, and Large Language Models (LLMs)—are blurring their traditional boundaries. By analyzing their divergent purposes, data structures, and interactivity modes, as well as hybrid applications (e.g., data-integrated virtual environments and AI-driven collaboration), this study seeks to define the opportunities and challenges of this integration for architectural design, decision-making, and immersive user experiences. Our research spans multiple projects utilizing XR and AI to develop DT and the Metaverse. The team assess the capabilities of AI in DT environments, such as reality capture and smart building management. Concurrently, the team evaluates metaverse platforms for online collaboration and architectural education, focusing on features facilitating multi-user engagement. The paper presents evaluations of various virtual environment development pipelines, comparing traditional BIM+IoT workflows with novel approaches such as Gaussian Splatting and generative AI for content creation. The team further explores the integration of Large Language Models (LLMs) in both domains, such as virtual agents or LLM-powered Non-Player-Controlled Characters (NPC), enabling autonomous interaction and enhancing user engagement within spatial environments. Finally, the paper argues that DTs and Metaverse’s once-distinct boundaries are becoming increasingly porous. Hybrid digital spaces—such as virtual buildings with data-integrated twins and immersive, social metaverses—demonstrate this convergence. As digital environments mature, architects are uniquely positioned to shape these dual-purpose ecosystems, leveraging AI, XR, and spatial computing to fuse data-driven models with immersive and user-centered experiences. © 2025 Elsevier B.V., All rights reserved.
Furukawa, O.
Implementation of Voice-Controlled Remote Measurements via Metaverse using Automatic Speech Recognition Journal Article
In: IEEJ Transactions on Fundamentals and Materials, vol. 145, no. 10, pp. 294–300, 2025, ISSN: 03854205 (ISSN); 13475533 (ISSN), (Publisher: Institute of Electrical Engineers of Japan).
Abstract | Links | BibTeX | Tags: Automatic speech recognition, digital twin, Fiber Sensor, Language Model, Large language model, Measurement system, Measurements instruments, Metaverse, Metaverses, optical fiber sensor, Optical-, Recognition methods, Remote measurement, Speech communication, Speech recognition
@article{furukawa_implementation_2025,
title = {Implementation of Voice-Controlled Remote Measurements via Metaverse using Automatic Speech Recognition},
author = {O. Furukawa},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-105017845175&doi=10.1541%2Fieejfms.145.294&partnerID=40&md5=53e5584cc5d71588ca02c5ec820addd1},
doi = {10.1541/ieejfms.145.294},
issn = {03854205 (ISSN); 13475533 (ISSN)},
year = {2025},
date = {2025-01-01},
journal = {IEEJ Transactions on Fundamentals and Materials},
volume = {145},
number = {10},
pages = {294–300},
abstract = {Research on the three-dimensional virtual space “metaverse” is being actively conducted. The metaverse allows communication between distant “people” through voice and/or gestures. Applying the metaverse to distant “objects” is expected to bring industrial innovation. The industrial metaverse can be implemented in remote measurement systems. In previous research, we successfully controlled a measurement instrument using voice control via the metaverse. However, appropriate automatic speech recognition methods for metaverse measurement instruments have not been explored. In this study, we investigate the performance of representative automatic speech recognition methods that use deep neural networks, including Google Speech-to-Text and Faster-Whisper, an end-to-end generative pretrained transformer. In the case of dedicated control commands with the prefix, high performance was achieved with an average word error rate of 2%. Based on the results, we developed a measurement system and successfully demonstrated that it is possible to control measurement instruments in remote sites via the metaverse. © 2025 Elsevier B.V., All rights reserved.},
note = {Publisher: Institute of Electrical Engineers of Japan},
keywords = {Automatic speech recognition, digital twin, Fiber Sensor, Language Model, Large language model, Measurement system, Measurements instruments, Metaverse, Metaverses, optical fiber sensor, Optical-, Recognition methods, Remote measurement, Speech communication, Speech recognition},
pubstate = {published},
tppubtype = {article}
}
Research on the three-dimensional virtual space “metaverse” is being actively conducted. The metaverse allows communication between distant “people” through voice and/or gestures. Applying the metaverse to distant “objects” is expected to bring industrial innovation. The industrial metaverse can be implemented in remote measurement systems. In previous research, we successfully controlled a measurement instrument using voice control via the metaverse. However, appropriate automatic speech recognition methods for metaverse measurement instruments have not been explored. In this study, we investigate the performance of representative automatic speech recognition methods that use deep neural networks, including Google Speech-to-Text and Faster-Whisper, an end-to-end generative pretrained transformer. In the case of dedicated control commands with the prefix, high performance was achieved with an average word error rate of 2%. Based on the results, we developed a measurement system and successfully demonstrated that it is possible to control measurement instruments in remote sites via the metaverse. © 2025 Elsevier B.V., All rights reserved.
2024
Otoum, Y.; Gottimukkala, N.; Kumar, N.; Nayak, A.
Machine Learning in Metaverse Security: Current Solutions and Future Challenges Journal Article
In: ACM Computing Surveys, vol. 56, no. 8, 2024, ISSN: 03600300 (ISSN); 15577341 (ISSN), (Publisher: Association for Computing Machinery).
Abstract | Links | BibTeX | Tags: 'current, Block-chain, Blockchain, digital twin, E-Learning, Extended reality, Future challenges, Generative AI, machine learning, Machine-learning, Metaverse Security, Metaverses, Security and privacy, Spatio-temporal dynamics, Sustainable development
@article{otoum_machine_2024,
title = {Machine Learning in Metaverse Security: Current Solutions and Future Challenges},
author = {Y. Otoum and N. Gottimukkala and N. Kumar and A. Nayak},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85193466017&doi=10.1145%2F3654663&partnerID=40&md5=4875c5ea2d500d6ebd25164f27970b8b},
doi = {10.1145/3654663},
issn = {03600300 (ISSN); 15577341 (ISSN)},
year = {2024},
date = {2024-01-01},
journal = {ACM Computing Surveys},
volume = {56},
number = {8},
abstract = {The Metaverse, positioned as the next frontier of the Internet, has the ambition to forge a virtual shared realm characterized by immersion, hyper-spatiotemporal dynamics, and self-sustainability. Recent technological strides in AI, Extended Reality, 6G, and blockchain propel the Metaverse closer to realization, gradually transforming it from science fiction into an imminent reality. Nevertheless, the extensive deployment of the Metaverse faces substantial obstacles, primarily stemming from its potential to infringe on privacy and be susceptible to security breaches, whether inherent in its underlying technologies or arising from the evolving digital landscape. Metaverse security provisioning is poised to confront various foundational challenges owing to its distinctive attributes, encompassing immersive realism, hyper-spatiotemporally, sustainability, and heterogeneity. This article undertakes a comprehensive study of the security and privacy challenges facing the Metaverse, leveraging machine learning models for this purpose. In particular, our focus centers on an innovative distributed Metaverse architecture characterized by interactions across 3D worlds. Subsequently, we conduct a thorough review of the existing cutting-edge measures designed for Metaverse systems while also delving into the discourse surrounding security and privacy threats. As we contemplate the future of Metaverse systems, we outline directions for open research pursuits in this evolving landscape. © 2024 Elsevier B.V., All rights reserved.},
note = {Publisher: Association for Computing Machinery},
keywords = {'current, Block-chain, Blockchain, digital twin, E-Learning, Extended reality, Future challenges, Generative AI, machine learning, Machine-learning, Metaverse Security, Metaverses, Security and privacy, Spatio-temporal dynamics, Sustainable development},
pubstate = {published},
tppubtype = {article}
}
The Metaverse, positioned as the next frontier of the Internet, has the ambition to forge a virtual shared realm characterized by immersion, hyper-spatiotemporal dynamics, and self-sustainability. Recent technological strides in AI, Extended Reality, 6G, and blockchain propel the Metaverse closer to realization, gradually transforming it from science fiction into an imminent reality. Nevertheless, the extensive deployment of the Metaverse faces substantial obstacles, primarily stemming from its potential to infringe on privacy and be susceptible to security breaches, whether inherent in its underlying technologies or arising from the evolving digital landscape. Metaverse security provisioning is poised to confront various foundational challenges owing to its distinctive attributes, encompassing immersive realism, hyper-spatiotemporally, sustainability, and heterogeneity. This article undertakes a comprehensive study of the security and privacy challenges facing the Metaverse, leveraging machine learning models for this purpose. In particular, our focus centers on an innovative distributed Metaverse architecture characterized by interactions across 3D worlds. Subsequently, we conduct a thorough review of the existing cutting-edge measures designed for Metaverse systems while also delving into the discourse surrounding security and privacy threats. As we contemplate the future of Metaverse systems, we outline directions for open research pursuits in this evolving landscape. © 2024 Elsevier B.V., All rights reserved.
Chandrashekar, N. Donekal; Lee, A.; Azab, M.; Grǎcanin, D.
Understanding User Behavior for Enhancing Cybersecurity Training with Immersive Gamified Platforms Journal Article
In: Information (Switzerland), vol. 15, no. 12, 2024, ISSN: 20782489 (ISSN), (Publisher: Multidisciplinary Digital Publishing Institute (MDPI)).
Abstract | Links | BibTeX | Tags: Artificial intelligence, Critical infrastructures, Cyber attacks, Cyber security, Cyber systems, Cyber-attacks, Cybersecurity, Decisions makings, Digital infrastructures, digital twin, Extended reality, Gamification, Immersive, Network Security, simulation, Technical vulnerabilities, Training, user behavior, User behaviors
@article{donekal_chandrashekar_understanding_2024,
title = {Understanding User Behavior for Enhancing Cybersecurity Training with Immersive Gamified Platforms},
author = {N. Donekal Chandrashekar and A. Lee and M. Azab and D. Grǎcanin},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85213435167&doi=10.3390%2Finfo15120814&partnerID=40&md5=9e015d2d280ef872e30ad46db0781ce8},
doi = {10.3390/info15120814},
issn = {20782489 (ISSN)},
year = {2024},
date = {2024-01-01},
journal = {Information (Switzerland)},
volume = {15},
number = {12},
abstract = {In modern digital infrastructure, cyber systems are foundational, making resilience against sophisticated attacks essential. Traditional cybersecurity defenses primarily address technical vulnerabilities; however, the human element, particularly decision-making during cyber attacks, adds complexities that current behavioral studies fail to capture adequately. Existing approaches, including theoretical models, game theory, and simulators, rely on retrospective data and static scenarios. These methods often miss the real-time, context-specific nature of user responses during cyber threats. To address these limitations, this work introduces a framework that combines Extended Reality (XR) and Generative Artificial Intelligence (Gen-AI) within a gamified platform. This framework enables continuous, high-fidelity data collection on user behavior in dynamic attack scenarios. It includes three core modules: the Player Behavior Module (PBM), Gamification Module (GM), and Simulation Module (SM). Together, these modules create an immersive, responsive environment for studying user interactions. A case study in a simulated critical infrastructure environment demonstrates the framework’s effectiveness in capturing realistic user behaviors under cyber attack, with potential applications for improving response strategies and resilience across critical sectors. This work lays the foundation for adaptive cybersecurity training and user-centered development across critical infrastructure. © 2024 Elsevier B.V., All rights reserved.},
note = {Publisher: Multidisciplinary Digital Publishing Institute (MDPI)},
keywords = {Artificial intelligence, Critical infrastructures, Cyber attacks, Cyber security, Cyber systems, Cyber-attacks, Cybersecurity, Decisions makings, Digital infrastructures, digital twin, Extended reality, Gamification, Immersive, Network Security, simulation, Technical vulnerabilities, Training, user behavior, User behaviors},
pubstate = {published},
tppubtype = {article}
}
In modern digital infrastructure, cyber systems are foundational, making resilience against sophisticated attacks essential. Traditional cybersecurity defenses primarily address technical vulnerabilities; however, the human element, particularly decision-making during cyber attacks, adds complexities that current behavioral studies fail to capture adequately. Existing approaches, including theoretical models, game theory, and simulators, rely on retrospective data and static scenarios. These methods often miss the real-time, context-specific nature of user responses during cyber threats. To address these limitations, this work introduces a framework that combines Extended Reality (XR) and Generative Artificial Intelligence (Gen-AI) within a gamified platform. This framework enables continuous, high-fidelity data collection on user behavior in dynamic attack scenarios. It includes three core modules: the Player Behavior Module (PBM), Gamification Module (GM), and Simulation Module (SM). Together, these modules create an immersive, responsive environment for studying user interactions. A case study in a simulated critical infrastructure environment demonstrates the framework’s effectiveness in capturing realistic user behaviors under cyber attack, with potential applications for improving response strategies and resilience across critical sectors. This work lays the foundation for adaptive cybersecurity training and user-centered development across critical infrastructure. © 2024 Elsevier B.V., All rights reserved.