AHCI RESEARCH GROUP
Publications
Papers published in international journals,
proceedings of conferences, workshops and books.
OUR RESEARCH
Scientific Publications
How to
Here you can find the complete list of our publications.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
2025
Coronado, A.; Carvalho, S. T.; Berretta, L.
See Through My Eyes: Using Multimodal Large Language Model for Describing Rendered Environments to Blind People Proceedings Article
In: IMX - Proc. ACM Int. Conf. Interact. Media Experiences, pp. 451–457, Association for Computing Machinery, Inc, 2025, ISBN: 979-840071391-0 (ISBN).
Abstract | Links | BibTeX | Tags: Accessibility, Behavioral Research, Blind, Blind people, Helmet mounted displays, Human engineering, Human rehabilitation equipment, Interactive computer graphics, Interactive computer systems, Language Model, LLM, Multi-modal, Rendered environment, rendered environments, Spatial cognition, Virtual Reality, Vision aids, Visual impairment, Visual languages, Visually impaired people
@inproceedings{coronado_see_2025,
title = {See Through My Eyes: Using Multimodal Large Language Model for Describing Rendered Environments to Blind People},
author = {A. Coronado and S. T. Carvalho and L. Berretta},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-105007991842&doi=10.1145%2f3706370.3731641&partnerID=40&md5=2f7cb1535d39d5e59b1f43f773de3272},
doi = {10.1145/3706370.3731641},
isbn = {979-840071391-0 (ISBN)},
year = {2025},
date = {2025-01-01},
booktitle = {IMX - Proc. ACM Int. Conf. Interact. Media Experiences},
pages = {451–457},
publisher = {Association for Computing Machinery, Inc},
abstract = {Extended Reality (XR) is quickly expanding "as the next major technology wave in personal computing". Nevertheless, this expansion and adoption could also exclude certain disabled users, particularly people with visual impairment (VIP). According to the World Health Organization (WHO) in their 2019 publication, there were at least 2.2 billion people with visual impairment, a number that is also estimated to have increased in recent years. Therefore, it is important to include disabled users, especially visually impaired people, in the design of Head-Mounted Displays and Extended Reality environments. Indeed, this objective can be pursued by incorporating Multimodal Large Language Model (MLLM) technology, which can assist visually impaired people. As a case study, this study employs different prompts that result in environment descriptions from an MLLM integrated into a virtual reality (VR) escape room. Therefore, six potential prompts were engineered to generate valuable outputs for visually impaired users inside a VR environment. These outputs were evaluated using the G-Eval, and VIEScore metrics. Even though, the results show that the prompt patterns provided a description that aligns with the user's point of view, it is highly recommended to evaluate these outputs through "expected outputs"from Orientation and Mobility Specialists, and Sighted Guides. Furthermore, the subsequent step in the process is to evaluate these outputs by visually impaired people themselves to identify the most effective prompt pattern. © 2025 Copyright held by the owner/author(s).},
keywords = {Accessibility, Behavioral Research, Blind, Blind people, Helmet mounted displays, Human engineering, Human rehabilitation equipment, Interactive computer graphics, Interactive computer systems, Language Model, LLM, Multi-modal, Rendered environment, rendered environments, Spatial cognition, Virtual Reality, Vision aids, Visual impairment, Visual languages, Visually impaired people},
pubstate = {published},
tppubtype = {inproceedings}
}
Extended Reality (XR) is quickly expanding "as the next major technology wave in personal computing". Nevertheless, this expansion and adoption could also exclude certain disabled users, particularly people with visual impairment (VIP). According to the World Health Organization (WHO) in their 2019 publication, there were at least 2.2 billion people with visual impairment, a number that is also estimated to have increased in recent years. Therefore, it is important to include disabled users, especially visually impaired people, in the design of Head-Mounted Displays and Extended Reality environments. Indeed, this objective can be pursued by incorporating Multimodal Large Language Model (MLLM) technology, which can assist visually impaired people. As a case study, this study employs different prompts that result in environment descriptions from an MLLM integrated into a virtual reality (VR) escape room. Therefore, six potential prompts were engineered to generate valuable outputs for visually impaired users inside a VR environment. These outputs were evaluated using the G-Eval, and VIEScore metrics. Even though, the results show that the prompt patterns provided a description that aligns with the user's point of view, it is highly recommended to evaluate these outputs through "expected outputs"from Orientation and Mobility Specialists, and Sighted Guides. Furthermore, the subsequent step in the process is to evaluate these outputs by visually impaired people themselves to identify the most effective prompt pattern. © 2025 Copyright held by the owner/author(s).
2019
Scianna, Andrea; Filippo, Gabriella Di
RAPID PROTOTYPING for the EXTENSION of the ACCESSIBILITY to CULTURAL HERITAGE for BLIND PEOPLE Proceedings Article
In: D., Toschi I. Remondino F. Gonzalez-Aguilera (Ed.): International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, pp. 1077–1082, International Society for Photogrammetry and Remote Sensing, 2019, (Issue: 2/W15).
Abstract | Links | BibTeX | Tags: 3-D printing, 3D printers, 3D Printing, Accessibility, Accessibility problems, Blind and visually impaired, Cultural heritage, Cultural heritages, Low cost technology, Rapid prototyping, Standards and guidelines, Visually impaired people
@inproceedings{scianna_rapid_2019,
title = {RAPID PROTOTYPING for the EXTENSION of the ACCESSIBILITY to CULTURAL HERITAGE for BLIND PEOPLE},
author = {Andrea Scianna and Gabriella Di Filippo},
editor = {Toschi I. Remondino F. Gonzalez-Aguilera D.},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85072212590&doi=10.5194%2fisprs-archives-XLII-2-W15-1077-2019&partnerID=40&md5=b95131689b6078a224eea8a8c1cc1730},
doi = {10.5194/isprs-archives-XLII-2-W15-1077-2019},
year = {2019},
date = {2019-01-01},
booktitle = {International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives},
volume = {42},
pages = {1077–1082},
publisher = {International Society for Photogrammetry and Remote Sensing},
abstract = {The extension of accessibility of CH to disabled people is a current topic of great importance. Today, there exist a lot of ongoing projects aimed at the extension of accessibility using the most recent and low cost technologies to improve accessibility to CH. One of the technologies, today available that can help to improve accessibility to CH, is certainly rapid prototyping. The main goal of the research here illustrated is the application of rapid prototyping for the extension of accessibility of Cultural Heritage (CH) to blind and visually impaired people. This document reports an experiment that compared the effectiveness of different 3D models for the introduction of blind and visually impaired people to the tactile use of models of monuments. In addition, this study focuses on defining standards and guidelines regarding features of 3D models, e.g. print resolution, in order to obtain greater legibility of models at different scales by the blind or visually impaired people. This paper shows a part of a wider Interreg EU research project, named I-ACCESS, aimed to study accessibility problems and solutions for CH. The experiments conducted with the sample of disabled people, allowed to obtain results on the most suitable printing parameters to be used. © 2019 International Society for Photogrammetry and Remote Sensing. All rights reserved.},
note = {Issue: 2/W15},
keywords = {3-D printing, 3D printers, 3D Printing, Accessibility, Accessibility problems, Blind and visually impaired, Cultural heritage, Cultural heritages, Low cost technology, Rapid prototyping, Standards and guidelines, Visually impaired people},
pubstate = {published},
tppubtype = {inproceedings}
}
The extension of accessibility of CH to disabled people is a current topic of great importance. Today, there exist a lot of ongoing projects aimed at the extension of accessibility using the most recent and low cost technologies to improve accessibility to CH. One of the technologies, today available that can help to improve accessibility to CH, is certainly rapid prototyping. The main goal of the research here illustrated is the application of rapid prototyping for the extension of accessibility of Cultural Heritage (CH) to blind and visually impaired people. This document reports an experiment that compared the effectiveness of different 3D models for the introduction of blind and visually impaired people to the tactile use of models of monuments. In addition, this study focuses on defining standards and guidelines regarding features of 3D models, e.g. print resolution, in order to obtain greater legibility of models at different scales by the blind or visually impaired people. This paper shows a part of a wider Interreg EU research project, named I-ACCESS, aimed to study accessibility problems and solutions for CH. The experiments conducted with the sample of disabled people, allowed to obtain results on the most suitable printing parameters to be used. © 2019 International Society for Photogrammetry and Remote Sensing. All rights reserved.