AHCI RESEARCH GROUP
Publications
Papers published in international journals,
proceedings of conferences, workshops and books.
OUR RESEARCH
Scientific Publications
How to
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
2025
Song, T.; Liu, Z.; Zhao, R.; Fu, J.
ElderEase AR: Enhancing Elderly Daily Living with the Multimodal Large Language Model and Augmented Reality Proceedings Article
In: ICVRT - Proc. Int. Conf. Virtual Real. Technol., pp. 60–67, Association for Computing Machinery, Inc, 2025, ISBN: 979-840071018-6 (ISBN).
Abstract | Links | BibTeX | Tags: Age-related, Assisted living, Augmented Reality, Augmented reality technology, Daily Life Support, Daily living, Daily-life supports, Elderly, Elderly users, Independent living, Independent living systems, Language Model, Modeling languages, Multi agent systems, Multi-modal, Multimodal large language model
@inproceedings{song_elderease_2025,
title = {ElderEase AR: Enhancing Elderly Daily Living with the Multimodal Large Language Model and Augmented Reality},
author = {T. Song and Z. Liu and R. Zhao and J. Fu},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-105001924899&doi=10.1145%2f3711496.3711505&partnerID=40&md5=4df693735547b505172657a73359f3ca},
doi = {10.1145/3711496.3711505},
isbn = {979-840071018-6 (ISBN)},
year = {2025},
date = {2025-01-01},
booktitle = {ICVRT - Proc. Int. Conf. Virtual Real. Technol.},
pages = {60–67},
publisher = {Association for Computing Machinery, Inc},
abstract = {Elderly individuals often face challenges in independent living due to age-related cognitive and physical decline. To address these issues, we propose an innovative Augmented Reality (AR) system, “ElderEase AR”, designed to assist elderly users in their daily lives by leveraging a Multimodal Large Language Model (MLLM). This system enables elderly users to capture images of their surroundings and ask related questions, providing context-aware feedback. We evaluated the system’s perceived ease-of-use and feasibility through a pilot study involving 30 elderly users, aiming to enhance their independence and quality of life. Our system integrates advanced AR technology with an intelligent agent trained on multimodal datasets. Through prompt engineering, the agent is tailored to respond in a manner that aligns with the speaking style of elderly users. Experimental results demonstrate high accuracy in object recognition and question answering, with positive feedback from user trials. Specifically, the system accurately identified objects in various environments and provided relevant answers to user queries. This study highlights the powerful potential of AR and AI technologies in creating support tools for the elderly. It suggests directions for future improvements and applications, such as enhancing the system’s adaptability to different user needs and expanding its functionality to cover more aspects of daily living. © 2024 Copyright held by the owner/author(s).},
keywords = {Age-related, Assisted living, Augmented Reality, Augmented reality technology, Daily Life Support, Daily living, Daily-life supports, Elderly, Elderly users, Independent living, Independent living systems, Language Model, Modeling languages, Multi agent systems, Multi-modal, Multimodal large language model},
pubstate = {published},
tppubtype = {inproceedings}
}
2024
Sheehy, L.; Bouchard, S.; Kakkar, A.; Hakim, R. El; Lhoest, J.; Frank, A.
Development and Initial Testing of an Artificial Intelligence-Based Virtual Reality Companion for People Living with Dementia in Long-Term Care Journal Article
In: Journal of Clinical Medicine, vol. 13, no. 18, 2024, ISSN: 20770383 (ISSN).
Abstract | Links | BibTeX | Tags: aged, Article, Artificial intelligence, cognitive decline, cognitive impairment, compassion, conversation, Dementia, Elderly, female, human, large language models, long term care, long-term care, major clinical study, male, program acceptability, program feasibility, reaction time, reminiscence, speech discrimination, very elderly, Virtual Reality
@article{sheehy_development_2024,
title = {Development and Initial Testing of an Artificial Intelligence-Based Virtual Reality Companion for People Living with Dementia in Long-Term Care},
author = {L. Sheehy and S. Bouchard and A. Kakkar and R. El Hakim and J. Lhoest and A. Frank},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85205071099&doi=10.3390%2fjcm13185574&partnerID=40&md5=844732ff858a0d5feb0a95a54093ad4d},
doi = {10.3390/jcm13185574},
issn = {20770383 (ISSN)},
year = {2024},
date = {2024-01-01},
journal = {Journal of Clinical Medicine},
volume = {13},
number = {18},
abstract = {Background/Objectives: Feelings of loneliness are common in people living with dementia (PLWD) in long-term care (LTC). The goals of this study were to describe the development of a novel virtual companion for PLWD living in LTC and assess its feasibility and acceptability. Methods: The computer-generated virtual companion, presented using a head-mounted virtual reality display, was developed in two stages. In Stage 1, the virtual companion asked questions designed to encourage conversation and reminiscence. In Stage 2, more powerful artificial intelligence tools allowed the virtual companion to engage users in nuanced discussions on any topic. PLWD in LTC tested the application at each stage to assess feasibility and acceptability. Results: Ten PLWD living in LTC participated in Stage 1 (4 men and 6 women; average 82 years old) and Stage 2 (2 men and 8 women; average 87 years old). Session lengths ranged from 0:00 to 5:30 min in Stage 1 and 0:00 to 53:50 min in Stage 2. Speech recognition issues and a limited repertoire of questions limited acceptance in Stage 1. Enhanced conversational ability in Stage 2 led to intimate and meaningful conversations with many participants. Many users found the head-mounted display heavy. There were no complaints of simulator sickness. The virtual companion was best suited to PLWD who could engage in reciprocal conversation. After Stage 2, response latency was identified as an opportunity for improvement in future versions. Conclusions: Virtual reality and artificial intelligence can be used to create a virtual companion that is acceptable and enjoyable to some PLWD living in LTC. Ongoing innovations in hardware and software will allow future iterations to provide more natural conversational interaction and an enhanced social experience. © 2024 by the authors.},
keywords = {aged, Article, Artificial intelligence, cognitive decline, cognitive impairment, compassion, conversation, Dementia, Elderly, female, human, large language models, long term care, long-term care, major clinical study, male, program acceptability, program feasibility, reaction time, reminiscence, speech discrimination, very elderly, Virtual Reality},
pubstate = {published},
tppubtype = {article}
}
2023
Sabatucci, Luca; Augello, Agnese; Caggianese, Giuseppe; Gallo, Luigi
Digital Practices: Introducing Social Dimension in Digital Twins Proceedings Article
In: 2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE), pp. 52–57, IEEE, Milano, Italy, 2023, ISBN: 9798350300802.
Abstract | Links | BibTeX | Tags: Cyber-Physical Systems, Digital Twins, Elderly
@inproceedings{sabatucciDigitalPracticesIntroducing2023,
title = {Digital Practices: Introducing Social Dimension in Digital Twins},
author = { Luca Sabatucci and Agnese Augello and Giuseppe Caggianese and Luigi Gallo},
url = {https://ieeexplore.ieee.org/document/10405710/},
doi = {10.1109/MetroXRAINE58569.2023.10405710},
isbn = {9798350300802},
year = {2023},
date = {2023-10-25},
urldate = {2024-02-19},
booktitle = {2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)},
pages = {52–57},
publisher = {IEEE},
address = {Milano, Italy},
abstract = {Digital Twin is one of the key components of society's digital transformation and a promising paradigm to support the development of cyber-physical systems. Currently, researchers are investigating methodologies that exploit Digital Twins as general-purpose abstractions for complex modelling and simulation. This paper explores the idea of explicitly representing the physical and social context in cyber-physical systems through dynamic digital entities. To this aim, we introduce the concept of Digital Practice as a shared (social) digital concept, highlighting how reality is not merely described by the state of physical objects (digital twins) but also by connections among them. We illustrate this concept by exploiting an assistance scenario for the elderly.},
keywords = {Cyber-Physical Systems, Digital Twins, Elderly},
pubstate = {published},
tppubtype = {inproceedings}
}
Sabatucci, Luca; Augello, Agnese; Caggianese, Giuseppe; Gallo, Luigi
Digital Practices: Introducing Social Dimension in Digital Twins Proceedings Article
In: 2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE), pp. 52–57, IEEE, Milano, Italy, 2023, ISBN: 9798350300802.
Abstract | Links | BibTeX | Tags: Cyber-Physical Systems, Digital Twins, Elderly
@inproceedings{sabatucci_digital_2023,
title = {Digital Practices: Introducing Social Dimension in Digital Twins},
author = {Luca Sabatucci and Agnese Augello and Giuseppe Caggianese and Luigi Gallo},
url = {https://ieeexplore.ieee.org/document/10405710/},
doi = {10.1109/MetroXRAINE58569.2023.10405710},
isbn = {9798350300802},
year = {2023},
date = {2023-10-01},
urldate = {2024-02-19},
booktitle = {2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)},
pages = {52–57},
publisher = {IEEE},
address = {Milano, Italy},
abstract = {Digital Twin is one of the key components of society's digital transformation and a promising paradigm to support the development of cyber-physical systems. Currently, researchers are investigating methodologies that exploit Digital Twins as general-purpose abstractions for complex modelling and simulation. This paper explores the idea of explicitly representing the physical and social context in cyber-physical systems through dynamic digital entities. To this aim, we introduce the concept of Digital Practice as a shared (social) digital concept, highlighting how reality is not merely described by the state of physical objects (digital twins) but also by connections among them. We illustrate this concept by exploiting an assistance scenario for the elderly.},
keywords = {Cyber-Physical Systems, Digital Twins, Elderly},
pubstate = {published},
tppubtype = {inproceedings}
}
2020
Chirico, Andrea; Giovannetti, Tania; Neroni, Pietro; Simone, Stephanie; Gallo, Luigi; Galli, Federica; Giancamilli, Francesco; Predazzi, Marco; Lucidi, Fabio; Pietro, Giuseppe De; Giordano, Antonio
In: Frontiers in Psychology, vol. 11, pp. 123, 2020, ISSN: 1664-1078.
Abstract | Links | BibTeX | Tags: Elderly, Healthcare, Monitoring, Virtual Reality
@article{chiricoVirtualRealityAssessment2020,
title = {Virtual Reality for the Assessment of Everyday Cognitive Functions in Older Adults: An Evaluation of the Virtual Reality Action Test and Two Interaction Devices in a 91-Year-Old Woman},
author = { Andrea Chirico and Tania Giovannetti and Pietro Neroni and Stephanie Simone and Luigi Gallo and Federica Galli and Francesco Giancamilli and Marco Predazzi and Fabio Lucidi and Giuseppe De Pietro and Antonio Giordano},
doi = {10.3389/fpsyg.2020.00123},
issn = {1664-1078},
year = {2020},
date = {2020-01-01},
journal = {Frontiers in Psychology},
volume = {11},
pages = {123},
abstract = {Performance-based functional tests for the evaluation of daily living activities demonstrate strong psychometric properties and solve many of the limitations associated with self- and informant-report questionnaires. Virtual reality (VR) technology, which has gained interest as an effective medium for administering interventions in the context of healthcare, has the potential to minimize the time-demands associated with the administration and scoring of performance-based assessments. To date, efforts to develop VR systems for assessment of everyday function in older adults generally have relied on non-immersive systems. The aim of the present study was to evaluate the feasibility of an immersive VR environment for the assessment of everyday function in older adults. We present a detailed case report of an elderly woman who performed an everyday activity in an immersive VR context (Virtual Reality Action Test) with two different types of interaction devices (controller vs. sensor). VR performance was compared to performance of the same task with real objects outside of the VR system (Real Action Test). Comparisons were made on several dimensions, including (1) quality of task performance (e.g., order of task steps, errors, use and speed of hand movements); (2) subjective impression (e.g., attitudes), and (3) physiological markers of stress. Subjective impressions of performance with the different controllers also were compared for presence, cybersickness, and usability. Results showed that the participant was capable of using controllers and sensors to manipulate objects in a purposeful and goal-directed manner in the immersive VR paradigm. She performed the everyday task similarly across all conditions. She reported no cybersickness and even indicated that interactions in the VR environment were pleasant and relaxing. Thus, immersive VR is a feasible approach for function assessment even with older adults who might have very limited computer experience, no prior VR exposure, average educational experiences, and mild cognitive difficulties. Because of inherent limitations of single case reports (e.g., unknown generalizability, potential practice effects, etc.), group studies are needed to establish the full psychometric properties of the Virtual Reality Action Test.},
keywords = {Elderly, Healthcare, Monitoring, Virtual Reality},
pubstate = {published},
tppubtype = {article}
}