AHCI RESEARCH GROUP
Publications
Papers published in international journals,
proceedings of conferences, workshops and books.
OUR RESEARCH
Scientific Publications
How to
Here you can find the complete list of our publications.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
2021
Augello, Agnese; Infantino, Ignazio; Pilato, Giovanni; Vitale, Gianpaolo
In: Future Internet, vol. 13, no. 4, 2021, ISSN: 19995903.
Abstract | Links | BibTeX | Tags: Augmented Reality, Cultural heritage, Multimodal Interaction, User Behavior Analysis
@article{augelloSiteExperienceEnhancement2021,
title = {Site Experience Enhancement and Perspective in Cultural Heritage Fruition— a Survey on New Technologies and Methodologies Based on a ``Four-Pillars'' Approach},
author = { Agnese Augello and Ignazio Infantino and Giovanni Pilato and Gianpaolo Vitale},
doi = {10.3390/fi13040092},
issn = {19995903},
year = {2021},
date = {2021-01-01},
journal = {Future Internet},
volume = {13},
number = {4},
abstract = {This paper deals with innovative fruition modalities of cultural heritage sites. Based on two ongoing experiments, four pillars are considered, that is, User Localization, Multimodal Interaction, User Understanding and Gamification. A survey of the existing literature regarding one or more issues related to the four pillars is proposed. It aims to put in evidence the exploitation of these contributions to cultural heritage. It is discussed how a cultural site can be enriched, extended and transformed into an intelligent multimodal environment in this perspective. This new augmented environment can focus on the visitor, analyze his activity and behavior, and make his experience more satisfying, fulfilling and unique. After an in-depth overview of the existing technologies and methodologies for the fruition of cultural interest sites, the two experiments are described in detail and the authors' vision of the future is proposed. textcopyright 2021 by the authors. Licensee MDPI, Basel, Switzerland.},
keywords = {Augmented Reality, Cultural heritage, Multimodal Interaction, User Behavior Analysis},
pubstate = {published},
tppubtype = {article}
}
This paper deals with innovative fruition modalities of cultural heritage sites. Based on two ongoing experiments, four pillars are considered, that is, User Localization, Multimodal Interaction, User Understanding and Gamification. A survey of the existing literature regarding one or more issues related to the four pillars is proposed. It aims to put in evidence the exploitation of these contributions to cultural heritage. It is discussed how a cultural site can be enriched, extended and transformed into an intelligent multimodal environment in this perspective. This new augmented environment can focus on the visitor, analyze his activity and behavior, and make his experience more satisfying, fulfilling and unique. After an in-depth overview of the existing technologies and methodologies for the fruition of cultural interest sites, the two experiments are described in detail and the authors' vision of the future is proposed. textcopyright 2021 by the authors. Licensee MDPI, Basel, Switzerland.
2009
Gentile, Antonio; Santangelo, Antonella; Sorce, Salvatore; Augello, Agnese; Pilato, Giovanni; Genco, Alessandro; Gaglio, Salvatore
IGI Global, 2009, ISBN: 978-1-60566-978-6.
Abstract | Links | BibTeX | Tags: Cultural heritage, Multimodal Interaction
@book{gentileExploitingMultimodalityIntelligent2009,
title = {Exploiting Multimodality for Intelligent Mobile Access to Pervasive Services in Cultural Heritage Sites},
author = { Antonio Gentile and Antonella Santangelo and Salvatore Sorce and Agnese Augello and Giovanni Pilato and Alessandro Genco and Salvatore Gaglio},
doi = {10.4018/978-1-60566-978-6.ch009},
isbn = {978-1-60566-978-6},
year = {2009},
date = {2009-01-01},
publisher = {IGI Global},
abstract = {In this chapter the role of multimodality in intelligent, mobile guides for cultural heritage environments is discussed. Multimodal access to information contents enables the creation of systems with a higher degree of accessibility and usability. A multimodal interaction may involve several human interaction modes, such as sight, touch and voice to navigate contents, or gestures to activate controls. We first start our discussion by presenting a timeline of cultural heritage system evolution, spanning from 2001 to 2008, which highlights design issues such as intelligence and context-awareness in providing information. Then, multimodal access to contents is discussed, along with problems and corresponding solutions; an evaluation of several reviewed systems is also presented. Lastly, a case study multimodal framework termed MAGA is described, which combines intelligent conversational agents with speech recognition/synthesis technology in a framework employing RFID based location and Wi-Fi based data exchange. textcopyright 2010, IGI Global.},
keywords = {Cultural heritage, Multimodal Interaction},
pubstate = {published},
tppubtype = {book}
}
In this chapter the role of multimodality in intelligent, mobile guides for cultural heritage environments is discussed. Multimodal access to information contents enables the creation of systems with a higher degree of accessibility and usability. A multimodal interaction may involve several human interaction modes, such as sight, touch and voice to navigate contents, or gestures to activate controls. We first start our discussion by presenting a timeline of cultural heritage system evolution, spanning from 2001 to 2008, which highlights design issues such as intelligence and context-awareness in providing information. Then, multimodal access to contents is discussed, along with problems and corresponding solutions; an evaluation of several reviewed systems is also presented. Lastly, a case study multimodal framework termed MAGA is described, which combines intelligent conversational agents with speech recognition/synthesis technology in a framework employing RFID based location and Wi-Fi based data exchange. textcopyright 2010, IGI Global.
Sorce, Salvatore; Augello, Agnese; Santangelo, Antonella; Genco, Alessandro; Gentile, Antonio; Gaglio, Salvatore; Pilato, Giovanni
An RFID Framework for Multimodal Service Provision Proceedings Article
In: Proceedings of the International Conference on Complex, Intelligent and Software Intensive Systems, CISIS 2009, pp. 730–735, 2009, ISBN: 978-0-7695-3575-3.
Abstract | Links | BibTeX | Tags: Common Sense Reasoning, Context awareness, Conversational Agents, Human computer interaction, Multimodal Interaction, Ontologies, RFID Technology
@inproceedings{sorceRFIDFrameworkMultimodal2009,
title = {An RFID Framework for Multimodal Service Provision},
author = { Salvatore Sorce and Agnese Augello and Antonella Santangelo and Alessandro Genco and Antonio Gentile and Salvatore Gaglio and Giovanni Pilato},
doi = {10.1109/CISIS.2009.168},
isbn = {978-0-7695-3575-3},
year = {2009},
date = {2009-01-01},
booktitle = {Proceedings of the International Conference on Complex, Intelligent and Software Intensive Systems, CISIS 2009},
pages = {730--735},
abstract = {In recent years there has been a growing interest toward the evelopment of pervasive and contextaware services, and RFID technology played a relevant role in the context sensing task. We propose the use of RFID technology together with a conversational agent in order to implement a multimodal information retrieval service we call SensorMesh. The information acquired from RFID tags about the nearest point of interest is processed by the conversational agent that carries a more natural interaction with the user, also exploiting a common sense ontology. The service is accessible using a multimodal browser on Personal Digital Assistants (PDAs); the browser allows the user to interact with the conversational agent by means of spoken language instead of the traditional, keyboard- (or stylus-) based input systems. The resulting system offers a more natural interaction with respect to traditional prerecorded, audio-visual services, and it is particularly suitable for non technology-skilled users. textcopyright 2009 IEEE.},
keywords = {Common Sense Reasoning, Context awareness, Conversational Agents, Human computer interaction, Multimodal Interaction, Ontologies, RFID Technology},
pubstate = {published},
tppubtype = {inproceedings}
}
In recent years there has been a growing interest toward the evelopment of pervasive and contextaware services, and RFID technology played a relevant role in the context sensing task. We propose the use of RFID technology together with a conversational agent in order to implement a multimodal information retrieval service we call SensorMesh. The information acquired from RFID tags about the nearest point of interest is processed by the conversational agent that carries a more natural interaction with the user, also exploiting a common sense ontology. The service is accessible using a multimodal browser on Personal Digital Assistants (PDAs); the browser allows the user to interact with the conversational agent by means of spoken language instead of the traditional, keyboard- (or stylus-) based input systems. The resulting system offers a more natural interaction with respect to traditional prerecorded, audio-visual services, and it is particularly suitable for non technology-skilled users. textcopyright 2009 IEEE.
2007
Augello, Agnese; Santangelo, Antonella; Sorce, Salvatore; Pilato, Giovanni; Gentile, Antonio; Genco, Alessandro; Gaglio, Salvatore
A Multimodal Interaction Guide for Pervasive Services Access Proceedings Article
In: 2007 IEEE International Conference on Pervasive Services, ICPS, pp. 250–256, 2007, ISBN: 1-4244-1326-5 978-1-4244-1326-3.
Abstract | Links | BibTeX | Tags: Common Sense Reasoning, Conversational Agents, Cultural heritage, IVA, Multimodal Interaction, Pervasive Systems
@inproceedings{augelloMultimodalInteractionGuide2007,
title = {A Multimodal Interaction Guide for Pervasive Services Access},
author = { Agnese Augello and Antonella Santangelo and Salvatore Sorce and Giovanni Pilato and Antonio Gentile and Alessandro Genco and Salvatore Gaglio},
doi = {10.1109/PERSER.2007.4283923},
isbn = {1-4244-1326-5 978-1-4244-1326-3},
year = {2007},
date = {2007-01-01},
booktitle = {2007 IEEE International Conference on Pervasive Services, ICPS},
pages = {250--256},
abstract = {A pervasive, multimodal virtual guide for a cultural heritage site tour is illustrated. The guide is based on the integration of different technologies such as conversational agents, commonsense reasoning knowledge bases, multimodal interfaces and self-location detection systems. The aim of the work is to offer a more natural, context sensitive access to information with respect to traditional audio/visual pre-recorded guides. A prototype has been developed and implemented on a Qtek 9090 with Windows Mobile 2003 in order to deal with the "Museo Archeologico Regionale di Agrigento" domain. textcopyright 2007 IEEE.},
keywords = {Common Sense Reasoning, Conversational Agents, Cultural heritage, IVA, Multimodal Interaction, Pervasive Systems},
pubstate = {published},
tppubtype = {inproceedings}
}
A pervasive, multimodal virtual guide for a cultural heritage site tour is illustrated. The guide is based on the integration of different technologies such as conversational agents, commonsense reasoning knowledge bases, multimodal interfaces and self-location detection systems. The aim of the work is to offer a more natural, context sensitive access to information with respect to traditional audio/visual pre-recorded guides. A prototype has been developed and implemented on a Qtek 9090 with Windows Mobile 2003 in order to deal with the "Museo Archeologico Regionale di Agrigento" domain. textcopyright 2007 IEEE.
Santangelo, Antonella; Augello, Agnese; Sorce, Salvatore; Pilato, Giovanni; Gentile, Antonio; Genco, Alessandro; Gaglio, Salvatore
A Virtual Shopper Customer Assistant in Pervasive Environments Journal Article
In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4805 LNCS, no. PART 1, pp. 447–456, 2007, ISSN: 03029743.
Abstract | Links | BibTeX | Tags: Chatbots, Human computer interaction, Knowledge Representation, Multimodal Interaction, Pervasive Systems
@article{santangeloVirtualShopperCustomer2007,
title = {A Virtual Shopper Customer Assistant in Pervasive Environments},
author = { Antonella Santangelo and Agnese Augello and Salvatore Sorce and Giovanni Pilato and Antonio Gentile and Alessandro Genco and Salvatore Gaglio},
doi = {10.1007/978-3-540-76888-3_67},
issn = {03029743},
year = {2007},
date = {2007-01-01},
journal = {Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)},
volume = {4805 LNCS},
number = {PART 1},
pages = {447--456},
abstract = {In this work we propose a smart, human-like PDA-based personal shopper assistant. The system is able to understand the user needs through a spoken natural language interaction and then stores the preferences of the potential customer. Subsequently the personal shopper suggests the most suitable items and shops that match the user profile. The interaction is given by automatic speech recognition and text-to-speech technologies; localization is allowed by the use of Wireless technologies, while the interaction is performed by an Alice-based chat-bot endowed with reasoning capabilities. Besides, being implemented on a PDA, the personal shopper satisfies the user needs of mobility and it is also usable on different mobile devices. textcopyright Springer-Verlag Berlin Heidelberg 2007.},
keywords = {Chatbots, Human computer interaction, Knowledge Representation, Multimodal Interaction, Pervasive Systems},
pubstate = {published},
tppubtype = {article}
}
In this work we propose a smart, human-like PDA-based personal shopper assistant. The system is able to understand the user needs through a spoken natural language interaction and then stores the preferences of the potential customer. Subsequently the personal shopper suggests the most suitable items and shops that match the user profile. The interaction is given by automatic speech recognition and text-to-speech technologies; localization is allowed by the use of Wireless technologies, while the interaction is performed by an Alice-based chat-bot endowed with reasoning capabilities. Besides, being implemented on a PDA, the personal shopper satisfies the user needs of mobility and it is also usable on different mobile devices. textcopyright Springer-Verlag Berlin Heidelberg 2007.
Sorce, Salvatore; Augello, Agnese; Santangelo, Antonella; Pilato, Giovanni; Gentile, Antonio; Genco, Alessandro; Gaglio, Salvatore
A Multimodal Guide for the Augmented Campus Proceedings Article
In: Proceedings ACM SIGUCCS User Services Conference, pp. 325–331, 2007, ISBN: 978-1-59593-634-9.
Abstract | Links | BibTeX | Tags: Human computer interaction, Information Retrieval, Multimodal Interaction
@inproceedings{sorceMultimodalGuideAugmented2007,
title = {A Multimodal Guide for the Augmented Campus},
author = { Salvatore Sorce and Agnese Augello and Antonella Santangelo and Giovanni Pilato and Antonio Gentile and Alessandro Genco and Salvatore Gaglio},
doi = {10.1145/1294046.1294123},
isbn = {978-1-59593-634-9},
year = {2007},
date = {2007-01-01},
booktitle = {Proceedings ACM SIGUCCS User Services Conference},
pages = {325--331},
abstract = {The use of Personal Digital Assistants (PDAs) with ad-hoc built-in information retrieval and auto-localization functionalities can help people navigating an environment in a more natural manner compared to traditional audio/visual pre-recorded guides. In this work we propose and discuss a user-friendly, multi-modal guide system for pervasive context-aware service provision within augmented environments. The proposed system is adaptable to the user needs of mobility within a given environment; it is usable on different mobile devices and in particular on PDAs, which are used as advanced adaptive HEI (human-environment interaction) interfaces. An information retrieval service is provided that is easily accessible through spoken language interaction in cooperation with an auto-localization service. The interaction is enabled by speech recognition and synthesis technologies, and by a ChatBot system, endowed with common sense reasoning capabilities to properly interpret user speech and provide him with the requested information. This interaction mode turns to be more natural, and users are required to have only basic skills on the use of PDAs. The auto-localization service relies on a RFID-based framework, which resides partly in the mobile side of the entire system (PDAs), and partly in the environment side. In particular, RFID technology allows the system to provide users with context-related information. An implemented case study is showed that illustrates service provision in an augmented environment within university campus settings (termed "Augmented Campus"). Lastly, a discussion about user experiences while using trial services within the Augmented Campus is given. textcopyright Copyright 2007 ACM.},
keywords = {Human computer interaction, Information Retrieval, Multimodal Interaction},
pubstate = {published},
tppubtype = {inproceedings}
}
The use of Personal Digital Assistants (PDAs) with ad-hoc built-in information retrieval and auto-localization functionalities can help people navigating an environment in a more natural manner compared to traditional audio/visual pre-recorded guides. In this work we propose and discuss a user-friendly, multi-modal guide system for pervasive context-aware service provision within augmented environments. The proposed system is adaptable to the user needs of mobility within a given environment; it is usable on different mobile devices and in particular on PDAs, which are used as advanced adaptive HEI (human-environment interaction) interfaces. An information retrieval service is provided that is easily accessible through spoken language interaction in cooperation with an auto-localization service. The interaction is enabled by speech recognition and synthesis technologies, and by a ChatBot system, endowed with common sense reasoning capabilities to properly interpret user speech and provide him with the requested information. This interaction mode turns to be more natural, and users are required to have only basic skills on the use of PDAs. The auto-localization service relies on a RFID-based framework, which resides partly in the mobile side of the entire system (PDAs), and partly in the environment side. In particular, RFID technology allows the system to provide users with context-related information. An implemented case study is showed that illustrates service provision in an augmented environment within university campus settings (termed "Augmented Campus"). Lastly, a discussion about user experiences while using trial services within the Augmented Campus is given. textcopyright Copyright 2007 ACM.
2006
Augello, Agnese; Santangelo, Antonella; Gentile, Antonio; Gaglio, Salvatore; Pilato, Giovanni
A Multimodal Chat-Bot Based Information Technology System Proceedings Article
In: 4th International Industrial Simulation Conference 2006, ISC 2006, pp. 86–90, EUROSIS, 2006.
Abstract | BibTeX | Tags: Cultural heritage, Human computer interaction, IVA, Multimodal Interaction
@inproceedings{augelloMultimodalChatbotBased2006,
title = {A Multimodal Chat-Bot Based Information Technology System},
author = { Agnese Augello and Antonella Santangelo and Antonio Gentile and Salvatore Gaglio and Giovanni Pilato},
year = {2006},
date = {2006-01-01},
booktitle = {4th International Industrial Simulation Conference 2006, ISC 2006},
pages = {86--90},
publisher = {EUROSIS},
abstract = {The proposed system integrates chat-bot and speech recognition technologies in order to build a versatile, user-friendly, virtual assistant guide with information retrieval capabilities. The system is adaptable to the user needs of mobility being also usable on different devices (i.e. PDAs, Smartphone). The system has been implemented on a Qtek 9090 with Windows Mobile 2003 and a simulation for the cultural heritage domain is here presented.},
keywords = {Cultural heritage, Human computer interaction, IVA, Multimodal Interaction},
pubstate = {published},
tppubtype = {inproceedings}
}
The proposed system integrates chat-bot and speech recognition technologies in order to build a versatile, user-friendly, virtual assistant guide with information retrieval capabilities. The system is adaptable to the user needs of mobility being also usable on different devices (i.e. PDAs, Smartphone). The system has been implemented on a Qtek 9090 with Windows Mobile 2003 and a simulation for the cultural heritage domain is here presented.