AHCI RESEARCH GROUP
Publications
Papers published in international journals,
proceedings of conferences, workshops and books.
OUR RESEARCH
Scientific Publications
How to
Here you can find the complete list of our publications.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
2024
Peretti, A.; Mazzola, M.; Capra, L.; Piazzola, M.; Carlevaro, C.
Seamless Human-Robot Interaction Through a Distributed Zero-Trust Architecture and Advanced User Interfaces Proceedings Article
In: C., Secchi; L., Marconi (Ed.): Springer. Proc. Adv. Robot., pp. 92–95, Springer Nature, 2024, ISBN: 25111256 (ISSN); 978-303176427-1 (ISBN).
Abstract | Links | BibTeX | Tags: Advanced user interfaces, Digital Twins, HRC, Human Robot Interaction, Human-Robot Collaboration, Humans-robot interactions, Industrial robots, Industry 4.0, Intelligent robots, Interaction platform, Language Model, Large language model, LLM, Problem oriented languages, Robot Operating System, Robot operating system 2, Robot-robot collaboration, ROS2, RRC, Wages, XR, ZTA
@inproceedings{peretti_seamless_2024,
title = {Seamless Human-Robot Interaction Through a Distributed Zero-Trust Architecture and Advanced User Interfaces},
author = {A. Peretti and M. Mazzola and L. Capra and M. Piazzola and C. Carlevaro},
editor = {Secchi C. and Marconi L.},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85216090556&doi=10.1007%2f978-3-031-76428-8_18&partnerID=40&md5=9f58281f8a8c034fb45fed610ce64bd2},
doi = {10.1007/978-3-031-76428-8_18},
isbn = {25111256 (ISSN); 978-303176427-1 (ISBN)},
year = {2024},
date = {2024-01-01},
booktitle = {Springer. Proc. Adv. Robot.},
volume = {33 SPAR},
pages = {92–95},
publisher = {Springer Nature},
abstract = {The proposed work presents a novel interaction platform designed to address the shortage of skilled workers in the labor market, facilitating the seamless integration of robotics and advanced user interfaces such as eXtended Reality (XR) to optimize Human-Robot Collaboration (HRC) as well as Robot-Robot Collaboration (RRC) in an Industry 4.0 scenario. One of the most challenging situations is to optimize and simplify the collaborations of humans and robots to decrease or avoid system slowdowns, blocks, or dangerous situations for both users and robots. The advent of the LLMs (Large Language Model) have been breakthrough the whole IT environment because they perform well in different scenario from human text generation to autonomous systems management. Due to their malleability, LLMs have a primary role for Human-Robot collaboration processes. For this reason, the platform comprises three key technical components: a distributed zero-trust architecture, a virtual avatar, and digital twins of robots powered by the Robot Operating System 2 (ROS2) platform. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.},
keywords = {Advanced user interfaces, Digital Twins, HRC, Human Robot Interaction, Human-Robot Collaboration, Humans-robot interactions, Industrial robots, Industry 4.0, Intelligent robots, Interaction platform, Language Model, Large language model, LLM, Problem oriented languages, Robot Operating System, Robot operating system 2, Robot-robot collaboration, ROS2, RRC, Wages, XR, ZTA},
pubstate = {published},
tppubtype = {inproceedings}
}
The proposed work presents a novel interaction platform designed to address the shortage of skilled workers in the labor market, facilitating the seamless integration of robotics and advanced user interfaces such as eXtended Reality (XR) to optimize Human-Robot Collaboration (HRC) as well as Robot-Robot Collaboration (RRC) in an Industry 4.0 scenario. One of the most challenging situations is to optimize and simplify the collaborations of humans and robots to decrease or avoid system slowdowns, blocks, or dangerous situations for both users and robots. The advent of the LLMs (Large Language Model) have been breakthrough the whole IT environment because they perform well in different scenario from human text generation to autonomous systems management. Due to their malleability, LLMs have a primary role for Human-Robot collaboration processes. For this reason, the platform comprises three key technical components: a distributed zero-trust architecture, a virtual avatar, and digital twins of robots powered by the Robot Operating System 2 (ROS2) platform. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
Sonawani, S.; Weigend, F.; Amor, H. B.
SiSCo: Signal Synthesis for Effective Human-Robot Communication Via Large Language Models Proceedings Article
In: IEEE Int Conf Intell Rob Syst, pp. 7107–7114, Institute of Electrical and Electronics Engineers Inc., 2024, ISBN: 21530858 (ISSN); 979-835037770-5 (ISBN).
Abstract | Links | BibTeX | Tags: Communications channels, Extensive resources, Human engineering, Human Robot Interaction, Human-Robot Collaboration, Human-robot communication, Humans-robot interactions, Industrial robots, Intelligent robots, Language Model, Man machine systems, Microrobots, Robust communication, Signal synthesis, Specialized knowledge, Visual communication, Visual cues, Visual languages
@inproceedings{sonawani_sisco_2024,
title = {SiSCo: Signal Synthesis for Effective Human-Robot Communication Via Large Language Models},
author = {S. Sonawani and F. Weigend and H. B. Amor},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85216466596&doi=10.1109%2fIROS58592.2024.10802561&partnerID=40&md5=ccd14b4f0b5d527b179394dffd4e2c73},
doi = {10.1109/IROS58592.2024.10802561},
isbn = {21530858 (ISSN); 979-835037770-5 (ISBN)},
year = {2024},
date = {2024-01-01},
booktitle = {IEEE Int Conf Intell Rob Syst},
pages = {7107–7114},
publisher = {Institute of Electrical and Electronics Engineers Inc.},
abstract = {Effective human-robot collaboration hinges on robust communication channels, with visual signaling playing a pivotal role due to its intuitive appeal. Yet, the creation of visually intuitive cues often demands extensive resources and specialized knowledge. The emergence of Large Language Models (LLMs) offers promising avenues for enhancing human-robot interactions and revolutionizing the way we generate context-aware visual cues. To this end, we introduce SiSCo-a novel framework that combines the computational power of LLMs with mixed-reality technologies to streamline the creation of visual cues for human-robot collaboration. Our results show that SiSCo improves the efficiency of communication in human-robot teaming tasks, reducing task completion time by approximately 73% and increasing task success rates by 18% compared to baseline natural language signals. Additionally, SiSCo reduces cognitive load for participants by 46%, as measured by the NASA-TLX subscale, and receives above-average user ratings for on-the-fly signals generated for unseen objects. To encourage further development and broader community engagement, we provide full access to SiSCo's implementation and related materials on our GitHub repository.1 © 2024 IEEE.},
keywords = {Communications channels, Extensive resources, Human engineering, Human Robot Interaction, Human-Robot Collaboration, Human-robot communication, Humans-robot interactions, Industrial robots, Intelligent robots, Language Model, Man machine systems, Microrobots, Robust communication, Signal synthesis, Specialized knowledge, Visual communication, Visual cues, Visual languages},
pubstate = {published},
tppubtype = {inproceedings}
}
Effective human-robot collaboration hinges on robust communication channels, with visual signaling playing a pivotal role due to its intuitive appeal. Yet, the creation of visually intuitive cues often demands extensive resources and specialized knowledge. The emergence of Large Language Models (LLMs) offers promising avenues for enhancing human-robot interactions and revolutionizing the way we generate context-aware visual cues. To this end, we introduce SiSCo-a novel framework that combines the computational power of LLMs with mixed-reality technologies to streamline the creation of visual cues for human-robot collaboration. Our results show that SiSCo improves the efficiency of communication in human-robot teaming tasks, reducing task completion time by approximately 73% and increasing task success rates by 18% compared to baseline natural language signals. Additionally, SiSCo reduces cognitive load for participants by 46%, as measured by the NASA-TLX subscale, and receives above-average user ratings for on-the-fly signals generated for unseen objects. To encourage further development and broader community engagement, we provide full access to SiSCo's implementation and related materials on our GitHub repository.1 © 2024 IEEE.
Fujii, A.; Fukuda, K.
Initial Study on Robot Emotional Expression Using Manpu Proceedings Article
In: ACM/IEEE Int. Conf. Hum.-Rob. Interact., pp. 463–467, IEEE Computer Society, 2024, ISBN: 21672148 (ISSN); 979-840070323-2 (ISBN).
Abstract | Links | BibTeX | Tags: Comic engineering, Comic symbol, Comic symbols, Display devices, Emotional expressions, Express emotions, Generic expression, Human Robot Interaction, Human robots, Human-robot interaction, Humans-robot interactions, Machine design, Man machine systems, Manpu, Mixed reality, Symbiotics, Symbolic methods
@inproceedings{fujii_initial_2024,
title = {Initial Study on Robot Emotional Expression Using Manpu},
author = {A. Fujii and K. Fukuda},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85188120223&doi=10.1145%2f3610978.3640652&partnerID=40&md5=4277cbd98c0474e2e7ba19d352e6f46e},
doi = {10.1145/3610978.3640652},
isbn = {21672148 (ISSN); 979-840070323-2 (ISBN)},
year = {2024},
date = {2024-01-01},
booktitle = {ACM/IEEE Int. Conf. Hum.-Rob. Interact.},
pages = {463–467},
publisher = {IEEE Computer Society},
abstract = {In recent years, robots have started to play an active role in various places in society. The ability of robots not only to convey information but also to interact emotionally, is necessary to realize a human-robot symbiotic society. Many studies have been conducted on the emotional expression of robots. However, as robots come in a wide variety of designs, it is difficult to construct a generic expression method, and some robots are not equipped with expression devices such as faces or displays. To address these problems, this research aims to develop technology that enables robots to express emotions, using Manpu (a symbolic method used in comic books, expressing not only the emotions of humans and animals but also the states of objects) and mixed reality technology. As the first step of the research, we categorize manpu and use large language models to generate manpu expressions according to the dialogue information. © 2024 Copyright held by the owner/author(s)},
keywords = {Comic engineering, Comic symbol, Comic symbols, Display devices, Emotional expressions, Express emotions, Generic expression, Human Robot Interaction, Human robots, Human-robot interaction, Humans-robot interactions, Machine design, Man machine systems, Manpu, Mixed reality, Symbiotics, Symbolic methods},
pubstate = {published},
tppubtype = {inproceedings}
}
In recent years, robots have started to play an active role in various places in society. The ability of robots not only to convey information but also to interact emotionally, is necessary to realize a human-robot symbiotic society. Many studies have been conducted on the emotional expression of robots. However, as robots come in a wide variety of designs, it is difficult to construct a generic expression method, and some robots are not equipped with expression devices such as faces or displays. To address these problems, this research aims to develop technology that enables robots to express emotions, using Manpu (a symbolic method used in comic books, expressing not only the emotions of humans and animals but also the states of objects) and mixed reality technology. As the first step of the research, we categorize manpu and use large language models to generate manpu expressions according to the dialogue information. © 2024 Copyright held by the owner/author(s)
2023
Bottega, J. A.; Kich, V. A.; Jesus, J. C.; Steinmetz, R.; Kolling, A. H.; Grando, R. B.; Guerra, R. S.; Gamarra, D. F. T.
Jubileo: An Immersive Simulation Framework for Social Robot Design Journal Article
In: Journal of Intelligent and Robotic Systems: Theory and Applications, vol. 109, no. 4, 2023, ISSN: 09210296 (ISSN).
Abstract | Links | BibTeX | Tags: Anthropomorphic Robots, Computational Linguistics, Cost effectiveness, E-Learning, English language learning, English languages, Human Robot Interaction, Human-robot interaction, Humanoid robot, Humans-robot interactions, Immersive, Language learning, Language Model, Large language model, large language models, Learning game, Machine design, Man machine systems, Open systems, Robot Operating System, Simulation framework, Simulation platform, Virtual Reality
@article{bottega_jubileo_2023,
title = {Jubileo: An Immersive Simulation Framework for Social Robot Design},
author = {J. A. Bottega and V. A. Kich and J. C. Jesus and R. Steinmetz and A. H. Kolling and R. B. Grando and R. S. Guerra and D. F. T. Gamarra},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85178895874&doi=10.1007%2fs10846-023-01991-3&partnerID=40&md5=6392af1e9a500ef51c3e215bd9709ce5},
doi = {10.1007/s10846-023-01991-3},
issn = {09210296 (ISSN)},
year = {2023},
date = {2023-01-01},
journal = {Journal of Intelligent and Robotic Systems: Theory and Applications},
volume = {109},
number = {4},
abstract = {This paper introduces Jubileo, an open-source simulated humanoid robot as a framework for the development of human-robot interaction applications. By leveraging the power of the Robot Operating System (ROS) and Unity in a virtual reality environment, this simulation establishes a strong connection to real robotics, faithfully replicating the robot’s physical components down to its motors and enabling communication with servo-actuators to control both the animatronic face and the joints of a real humanoid robot. To validate the capabilities of the framework, we propose English teaching games that integrate Virtual Reality (VR), game-based Human-Robot Interaction (HRI), and advanced large language models such as Generative Pre-trained Transformer (GPT). These games aim to foster linguistic competence within dynamic and interactive virtual environments. The incorporation of large language models bolsters the robot’s capability to generate human-like responses, thus facilitating a more realistic conversational experience. Moreover, the simulation framework reduces real-world testing risks and offers a cost-effective, efficient, and scalable platform for developing new HRI applications. The paper underscores the transformative potential of converging VR, large language models, and HRI, particularly in educational applications. © 2023, The Author(s), under exclusive licence to Springer Nature B.V.},
keywords = {Anthropomorphic Robots, Computational Linguistics, Cost effectiveness, E-Learning, English language learning, English languages, Human Robot Interaction, Human-robot interaction, Humanoid robot, Humans-robot interactions, Immersive, Language learning, Language Model, Large language model, large language models, Learning game, Machine design, Man machine systems, Open systems, Robot Operating System, Simulation framework, Simulation platform, Virtual Reality},
pubstate = {published},
tppubtype = {article}
}
This paper introduces Jubileo, an open-source simulated humanoid robot as a framework for the development of human-robot interaction applications. By leveraging the power of the Robot Operating System (ROS) and Unity in a virtual reality environment, this simulation establishes a strong connection to real robotics, faithfully replicating the robot’s physical components down to its motors and enabling communication with servo-actuators to control both the animatronic face and the joints of a real humanoid robot. To validate the capabilities of the framework, we propose English teaching games that integrate Virtual Reality (VR), game-based Human-Robot Interaction (HRI), and advanced large language models such as Generative Pre-trained Transformer (GPT). These games aim to foster linguistic competence within dynamic and interactive virtual environments. The incorporation of large language models bolsters the robot’s capability to generate human-like responses, thus facilitating a more realistic conversational experience. Moreover, the simulation framework reduces real-world testing risks and offers a cost-effective, efficient, and scalable platform for developing new HRI applications. The paper underscores the transformative potential of converging VR, large language models, and HRI, particularly in educational applications. © 2023, The Author(s), under exclusive licence to Springer Nature B.V.
2022
Augello, Agnese; Infantino, Ignazio; Pilato, Giovanni; Vitale, Gianpaolo
Extending Affective Capabilities for Medical Assistive Robots Journal Article
In: Cognitive Systems Research, vol. 73, pp. 21–25, 2022, ISSN: 13890417.
Abstract | Links | BibTeX | Tags: Anthropomorphic Robots, Assistive Robots, Emotion Detection, Facial Expressions, Human computer interaction, Human Robot Interaction, Humanoid Robots, Natural Language Processing, Robotics, Wellbeing
@article{augelloExtendingAffectiveCapabilities2022,
title = {Extending Affective Capabilities for Medical Assistive Robots},
author = { Agnese Augello and Ignazio Infantino and Giovanni Pilato and Gianpaolo Vitale},
doi = {10.1016/j.cogsys.2021.12.004},
issn = {13890417},
year = {2022},
date = {2022-01-01},
journal = {Cognitive Systems Research},
volume = {73},
pages = {21--25},
abstract = {In this work, we discuss methodologies and implementation choices to enable a humanoid robot to estimate patients' mood and emotions during postoperative home rehabilitation. The approach is modular and it has been implemented into a SoftBank Pepper robotic architecture; however, the approach is general and it can be easily adapted to other robotic platforms. A sample of an interactive session for the detection of the patient's affective state is also reported. textcopyright 2022 Elsevier B.V.},
keywords = {Anthropomorphic Robots, Assistive Robots, Emotion Detection, Facial Expressions, Human computer interaction, Human Robot Interaction, Humanoid Robots, Natural Language Processing, Robotics, Wellbeing},
pubstate = {published},
tppubtype = {article}
}
In this work, we discuss methodologies and implementation choices to enable a humanoid robot to estimate patients' mood and emotions during postoperative home rehabilitation. The approach is modular and it has been implemented into a SoftBank Pepper robotic architecture; however, the approach is general and it can be easily adapted to other robotic platforms. A sample of an interactive session for the detection of the patient's affective state is also reported. textcopyright 2022 Elsevier B.V.
Augello, Agnese; Infantino, Ignazio; Pilato, Giovanni; Vitale, Gianpaolo
Extending affective capabilities for medical assistive robots Journal Article
In: Cognitive Systems Research, vol. 73, pp. 21–25, 2022, ISSN: 13890417.
Abstract | Links | BibTeX | Tags: Anthropomorphic Robots, Assistive Robots, Emotion Detection, Facial Expressions, Human computer interaction, Human Robot Interaction, Humanoid Robots, Natural Language Processing, Robotics, Wellbeing
@article{augello_extending_2022,
title = {Extending affective capabilities for medical assistive robots},
author = {Agnese Augello and Ignazio Infantino and Giovanni Pilato and Gianpaolo Vitale},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85123046436&doi=10.1016%2fj.cogsys.2021.12.004&partnerID=40&md5=6e76332f7f95333a9ae2e8f11c054622},
doi = {10.1016/j.cogsys.2021.12.004},
issn = {13890417},
year = {2022},
date = {2022-01-01},
journal = {Cognitive Systems Research},
volume = {73},
pages = {21–25},
abstract = {In this work, we discuss methodologies and implementation choices to enable a humanoid robot to estimate patients’ mood and emotions during postoperative home rehabilitation. The approach is modular and it has been implemented into a SoftBank Pepper robotic architecture; however, the approach is general and it can be easily adapted to other robotic platforms. A sample of an interactive session for the detection of the patient's affective state is also reported. © 2022 Elsevier B.V.},
keywords = {Anthropomorphic Robots, Assistive Robots, Emotion Detection, Facial Expressions, Human computer interaction, Human Robot Interaction, Humanoid Robots, Natural Language Processing, Robotics, Wellbeing},
pubstate = {published},
tppubtype = {article}
}
In this work, we discuss methodologies and implementation choices to enable a humanoid robot to estimate patients’ mood and emotions during postoperative home rehabilitation. The approach is modular and it has been implemented into a SoftBank Pepper robotic architecture; however, the approach is general and it can be easily adapted to other robotic platforms. A sample of an interactive session for the detection of the patient's affective state is also reported. © 2022 Elsevier B.V.
2018
Augello, Agnese; Infantino, Ignazio; Lieto, Antonio; Maniscalco, Umberto; Pilato, Giovanni; Vella, Filippo
Towards a Dual Process Approach to Computational Explanation in Human-Robot Social Interaction Proceedings Article
In: A., Bhatt M. Bhatt M. Lieto (Ed.): CEUR Workshop Proceedings, pp. 21–26, CEUR-WS, 2018.
Abstract | BibTeX | Tags: Artificial intelligence, Dual Process Theory, Explainability, Human Robot Interaction
@inproceedings{augelloDualProcessApproach2018,
title = {Towards a Dual Process Approach to Computational Explanation in Human-Robot Social Interaction},
author = { Agnese Augello and Ignazio Infantino and Antonio Lieto and Umberto Maniscalco and Giovanni Pilato and Filippo Vella},
editor = { Bhatt M. Bhatt M. Lieto A.},
year = {2018},
date = {2018-01-01},
booktitle = {CEUR Workshop Proceedings},
volume = {2099},
pages = {21--26},
publisher = {CEUR-WS},
abstract = {The capacity for AI systems of explaining their decisions represents nowadays a huge challenge for both academia and industry (e.g. let us think at the autonomous cars sector). In this paper we sketch a preliminary proposal suggesting the adoption of a dual process approach for computational explanation. Our proposal is declined in the field of Human-Robot Social Interaction; namely, in a gesture recognition task. textcopyright 2018 CEUR-WS. All rights reserved.},
keywords = {Artificial intelligence, Dual Process Theory, Explainability, Human Robot Interaction},
pubstate = {published},
tppubtype = {inproceedings}
}
The capacity for AI systems of explaining their decisions represents nowadays a huge challenge for both academia and industry (e.g. let us think at the autonomous cars sector). In this paper we sketch a preliminary proposal suggesting the adoption of a dual process approach for computational explanation. Our proposal is declined in the field of Human-Robot Social Interaction; namely, in a gesture recognition task. textcopyright 2018 CEUR-WS. All rights reserved.
Augello, Agnese; Infantino, Ignazio; Maniscalco, Umberto; Pilato, Giovanni; Vella, Filippo
Robot Inner Perception Capability through a Soft Somatosensory System Journal Article
In: International Journal of Semantic Computing, vol. 12, no. 1, pp. 59–87, 2018, ISSN: 1793351X.
Abstract | Links | BibTeX | Tags: Anthropomorphic Robots, Cognitive Architectures, Cognitive Model, Human Robot Interaction, Motivation, Sensor systems, Somatosensory Systems
@article{augelloRobotInnerPerception2018,
title = {Robot Inner Perception Capability through a Soft Somatosensory System},
author = { Agnese Augello and Ignazio Infantino and Umberto Maniscalco and Giovanni Pilato and Filippo Vella},
doi = {10.1142/S1793351X18400044},
issn = {1793351X},
year = {2018},
date = {2018-01-01},
journal = {International Journal of Semantic Computing},
volume = {12},
number = {1},
pages = {59--87},
abstract = {The capability of a robot being aware of its internal status is a step forward to the enhancement of human-robot interaction. The possibility of feeling either pleasant or unpleasant sensations is at the basis of the motivation level of a robot. It can modulate the "willingness" of accomplishing a given task. Negative sensations can represent an alarm indicating dangerous situations, while the feeling of a reassuring environment or a well-being sensation can be a stimulus in pursuing the task, even in the presence of a painful perception. In this paper, we illustrate a bio-inspired somatosensory system embedded in a cognitive model for a humanoid robot. The system is based on a set of soft sensors that have been designed in order to make it possible for the interpretation of the robot physical sensations through a proper classification of the perceived somatosensory signals. This interpretation triggers and modulates the motivation level of the robot as well as its behavior. textcopyright 2018 World Scientific Publishing Company.},
keywords = {Anthropomorphic Robots, Cognitive Architectures, Cognitive Model, Human Robot Interaction, Motivation, Sensor systems, Somatosensory Systems},
pubstate = {published},
tppubtype = {article}
}
The capability of a robot being aware of its internal status is a step forward to the enhancement of human-robot interaction. The possibility of feeling either pleasant or unpleasant sensations is at the basis of the motivation level of a robot. It can modulate the "willingness" of accomplishing a given task. Negative sensations can represent an alarm indicating dangerous situations, while the feeling of a reassuring environment or a well-being sensation can be a stimulus in pursuing the task, even in the presence of a painful perception. In this paper, we illustrate a bio-inspired somatosensory system embedded in a cognitive model for a humanoid robot. The system is based on a set of soft sensors that have been designed in order to make it possible for the interpretation of the robot physical sensations through a proper classification of the perceived somatosensory signals. This interpretation triggers and modulates the motivation level of the robot as well as its behavior. textcopyright 2018 World Scientific Publishing Company.
Augello, Agnese; Dignum, Frank; Gentile, Manuel; Infantino, Ignazio; Maniscalco, Umberto; Pilato, Giovanni; Vella, Filippo
A Social Practice Oriented Signs Detection for Human-Humanoid Interaction Journal Article
In: Biologically Inspired Cognitive Architectures, vol. 25, pp. 8–16, 2018, ISSN: 2212683X.
Abstract | Links | BibTeX | Tags: Cognitive Architectures, Human Robot Interaction, Social Context, Social Practices, Social Robots
@article{augelloSocialPracticeOriented2018,
title = {A Social Practice Oriented Signs Detection for Human-Humanoid Interaction},
author = { Agnese Augello and Frank Dignum and Manuel Gentile and Ignazio Infantino and Umberto Maniscalco and Giovanni Pilato and Filippo Vella},
doi = {10.1016/j.bica.2018.07.013},
issn = {2212683X},
year = {2018},
date = {2018-01-01},
journal = {Biologically Inspired Cognitive Architectures},
volume = {25},
pages = {8--16},
abstract = {In this work we propose a cognitive architecture, based on the Social Practice (SP) theory, aimed at the modeling of socially adaptive robots, able to interact with people, recognizing and interpreting the specific social context where it is acting. The proposed social robot is able to recognize and interpret social signs during ongoing social practices. The cognitive architecture is inspired by the well-known Psi model, and it is equipped with a Social Practice Engine that manages the whole conduct of the robot. The use of such an architecture simplifies and makes more natural the interaction between human beings and a robot. In particular, the scenario of a robot fulfilling the tasks of welcoming people in an office environment is being considered. textcopyright 2018 Elsevier B.V.},
keywords = {Cognitive Architectures, Human Robot Interaction, Social Context, Social Practices, Social Robots},
pubstate = {published},
tppubtype = {article}
}
In this work we propose a cognitive architecture, based on the Social Practice (SP) theory, aimed at the modeling of socially adaptive robots, able to interact with people, recognizing and interpreting the specific social context where it is acting. The proposed social robot is able to recognize and interpret social signs during ongoing social practices. The cognitive architecture is inspired by the well-known Psi model, and it is equipped with a Social Practice Engine that manages the whole conduct of the robot. The use of such an architecture simplifies and makes more natural the interaction between human beings and a robot. In particular, the scenario of a robot fulfilling the tasks of welcoming people in an office environment is being considered. textcopyright 2018 Elsevier B.V.
Clodic, Aurélie; Vazquez-Salceda, Javier; Dignum, Frank; Mascarenhas, Samuel; Dignum, Virginia; Augello, Agnese; Gentile, Manuel; Alami, Rachid
On the Pertinence of Social Practices for Social Robotics Journal Article
In: Frontiers in Artificial Intelligence and Applications, vol. 311, pp. 63–74, 2018, ISSN: 09226389.
Abstract | Links | BibTeX | Tags: Human Robot Interaction, Robotics, Social Context, Social Practices
@article{clodicPertinenceSocialPractices2018,
title = {On the Pertinence of Social Practices for Social Robotics},
author = { Aurélie Clodic and Javier {Vazquez-Salceda} and Frank Dignum and Samuel Mascarenhas and Virginia Dignum and Agnese Augello and Manuel Gentile and Rachid Alami},
editor = { Loh J. Norskov M. Coeckelbergh M. Seibt J. Funk M.},
doi = {10.3233/978-1-61499-931-7-63},
issn = {09226389},
year = {2018},
date = {2018-01-01},
journal = {Frontiers in Artificial Intelligence and Applications},
volume = {311},
pages = {63--74},
abstract = {In the area of consumer robots that need to have rich social interactions with humans, one of the challenges is the complexity of computing the appropriate interactions in a cognitive, social and physical context. We propose a novel approach for social robots based on the concept of Social Practices. By using social practices robots are able to be aware of their own social identities (given by the role in the social practice) and the identities of others and also be able to identify the different social contexts and the appropriate social interactions that go along with those contexts and identities. textcopyright 2018 The authors and IOS Press. All rights reserved.},
keywords = {Human Robot Interaction, Robotics, Social Context, Social Practices},
pubstate = {published},
tppubtype = {article}
}
In the area of consumer robots that need to have rich social interactions with humans, one of the challenges is the complexity of computing the appropriate interactions in a cognitive, social and physical context. We propose a novel approach for social robots based on the concept of Social Practices. By using social practices robots are able to be aware of their own social identities (given by the role in the social practice) and the identities of others and also be able to identify the different social contexts and the appropriate social interactions that go along with those contexts and identities. textcopyright 2018 The authors and IOS Press. All rights reserved.
Dignum, Virginia; Dignum, Frank; Vazquez-Salceda, Javier; Clodic, A.; Gentile, Manuel; Mascarenhas, Samuel; Augello, Agnese
Design for Values for Social Robot Architectures Journal Article
In: Frontiers in Artificial Intelligence and Applications, vol. 311, pp. 43–52, 2018, ISSN: 09226389.
Abstract | Links | BibTeX | Tags: Behavioral Research, Ethics, Human Robot Interaction, Responsible AI, Robotics, Social Practices
@article{dignumDesignValuesSocial2018,
title = {Design for Values for Social Robot Architectures},
author = { Virginia Dignum and Frank Dignum and Javier {Vazquez-Salceda} and A. Clodic and Manuel Gentile and Samuel Mascarenhas and Agnese Augello},
editor = { Loh J. Norskov M. Coeckelbergh M. Seibt J. Funk M.},
doi = {10.3233/978-1-61499-931-7-43},
issn = {09226389},
year = {2018},
date = {2018-01-01},
journal = {Frontiers in Artificial Intelligence and Applications},
volume = {311},
pages = {43--52},
abstract = {The integration of social robots in human societies requires that they are capable to take decisions that may affect the lives of people around them. In order to ensure that these robots will behave according to shared ethical principles, an important shift in the design and development of social robots is needed, one where the main goal is improving ethical transparency rather than technical performance, and placing human values at the core of robot designs. In this abstract, we discuss the concept of ethical decision making and how to achieve trust according to the principles of Autonomy, Responsibility and Transparency (ART). textcopyright 2018 The authors and IOS Press. All rights reserved.},
keywords = {Behavioral Research, Ethics, Human Robot Interaction, Responsible AI, Robotics, Social Practices},
pubstate = {published},
tppubtype = {article}
}
The integration of social robots in human societies requires that they are capable to take decisions that may affect the lives of people around them. In order to ensure that these robots will behave according to shared ethical principles, an important shift in the design and development of social robots is needed, one where the main goal is improving ethical transparency rather than technical performance, and placing human values at the core of robot designs. In this abstract, we discuss the concept of ethical decision making and how to achieve trust according to the principles of Autonomy, Responsibility and Transparency (ART). textcopyright 2018 The authors and IOS Press. All rights reserved.
Infantino, Ignazio; Augello, Agnese; Maniscalto, Umberto; Pilato, Giovanni; Vella, Filippo
A Cognitive Architecture for Social Robots Proceedings Article
In: IEEE 4th International Forum on Research and Technologies for Society and Industry, RTSI 2018 - Proceedings, Institute of Electrical and Electronics Engineers Inc., 2018, ISBN: 978-1-5386-6282-3.
Abstract | Links | BibTeX | Tags: Cognitive Architectures, Human Robot Interaction, Social Robots, Somatosensory Systems
@inproceedings{infantinoCognitiveArchitectureSocial2018,
title = {A Cognitive Architecture for Social Robots},
author = { Ignazio Infantino and Agnese Augello and Umberto Maniscalto and Giovanni Pilato and Filippo Vella},
doi = {10.1109/RTSI.2018.8548520},
isbn = {978-1-5386-6282-3},
year = {2018},
date = {2018-01-01},
booktitle = {IEEE 4th International Forum on Research and Technologies for Society and Industry, RTSI 2018 - Proceedings},
publisher = {Institute of Electrical and Electronics Engineers Inc.},
abstract = {The paper illustrates a software architecture allowing a robot to socially interact with human beings, sharing with them some basilar cognitive mechanisms. Robust sensing of the environment and people is strongly linked with an artificial somatosensory system that drives the robot behavior at a low level and influences its motivation. Both long-term memory and short-term memory store relevant data to detect and recognize the social context (and social practice), and the human social behavior. Using both internal and external evaluations, the robot learns and improves its social skills, which take into account its physiological and emotional demands (affiliation, competence, certainty). Social interaction is encoded in the cognitive architecture by considering at the same level the human understanding and the robot communicative actions. This is done by using the same interaction channels (both verbal and nonverbal). Some examples derived from previous works show the effectiveness and the potential of the cognitive architecture. textcopyright 2018 IEEE.},
keywords = {Cognitive Architectures, Human Robot Interaction, Social Robots, Somatosensory Systems},
pubstate = {published},
tppubtype = {inproceedings}
}
The paper illustrates a software architecture allowing a robot to socially interact with human beings, sharing with them some basilar cognitive mechanisms. Robust sensing of the environment and people is strongly linked with an artificial somatosensory system that drives the robot behavior at a low level and influences its motivation. Both long-term memory and short-term memory store relevant data to detect and recognize the social context (and social practice), and the human social behavior. Using both internal and external evaluations, the robot learns and improves its social skills, which take into account its physiological and emotional demands (affiliation, competence, certainty). Social interaction is encoded in the cognitive architecture by considering at the same level the human understanding and the robot communicative actions. This is done by using the same interaction channels (both verbal and nonverbal). Some examples derived from previous works show the effectiveness and the potential of the cognitive architecture. textcopyright 2018 IEEE.
Nuccio, Carlo; Augello, Agnese; Gaglio, Salvatore; Pilato, Giovanni
Interaction Capabilities of a Robotic Receptionist Journal Article
In: Smart Innovation, Systems and Technologies, vol. 76, pp. 171–180, 2018, ISSN: 21903018.
Abstract | Links | BibTeX | Tags: Anthropomorphic Robots, Computational Creativity, Human computer interaction, Human Robot Interaction, Humanoid Robots, Ontologies, Robotics
@article{nuccioInteractionCapabilitiesRobotic2018,
title = {Interaction Capabilities of a Robotic Receptionist},
author = { Carlo Nuccio and Agnese Augello and Salvatore Gaglio and Giovanni Pilato},
editor = { Giuseppe De Pietro and Luigi Gallo and Robert J. Howlett and Lakhmi C. Jain},
doi = {10.1007/978-3-319-59480-4_18},
issn = {21903018},
year = {2018},
date = {2018-01-01},
journal = {Smart Innovation, Systems and Technologies},
volume = {76},
pages = {171--180},
abstract = {A system aimed at facilitating the interaction between a human user and an humanoid robot is presented. The system is suited to answer questions about laboratories activities, people involved, projects, research themes and collaborations among employees. The task is accomplished by the HermiT reasoner invoked by a speech recognition module. The system is capable of navigating a specific ontology making inference on it. The presented system is part of a broader social robot framework whose goal is to give the user a fulfilling social interaction experience, driven by the perception of the robot internal state and involving intuitive and computational creativity capabilities. textcopyright Springer International Publishing AG 2018.},
keywords = {Anthropomorphic Robots, Computational Creativity, Human computer interaction, Human Robot Interaction, Humanoid Robots, Ontologies, Robotics},
pubstate = {published},
tppubtype = {article}
}
A system aimed at facilitating the interaction between a human user and an humanoid robot is presented. The system is suited to answer questions about laboratories activities, people involved, projects, research themes and collaborations among employees. The task is accomplished by the HermiT reasoner invoked by a speech recognition module. The system is capable of navigating a specific ontology making inference on it. The presented system is part of a broader social robot framework whose goal is to give the user a fulfilling social interaction experience, driven by the perception of the robot internal state and involving intuitive and computational creativity capabilities. textcopyright Springer International Publishing AG 2018.
Nuccio, Carlo; Augello, Agnese; Gaglio, Salvatore; Pilato, Giovanni
Interaction capabilities of a robotic receptionist Journal Article
In: Smart Innovation, Systems and Technologies, vol. 76, pp. 171–180, 2018, ISSN: 21903018.
Abstract | Links | BibTeX | Tags: Anthropomorphic Robots, Computational Creativity, Human computer interaction, Human Robot Interaction, Humanoid Robots, Ontologies, Robotics
@article{nuccio_interaction_2018,
title = {Interaction capabilities of a robotic receptionist},
author = {Carlo Nuccio and Agnese Augello and Salvatore Gaglio and Giovanni Pilato},
editor = {Giuseppe De Pietro and Luigi Gallo and Robert J. Howlett and Lakhmi C. Jain},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85020412736&doi=10.1007%2f978-3-319-59480-4_18&partnerID=40&md5=36826af104eeb18f5d3fe6ff7ef1c18f},
doi = {10.1007/978-3-319-59480-4_18},
issn = {21903018},
year = {2018},
date = {2018-01-01},
journal = {Smart Innovation, Systems and Technologies},
volume = {76},
pages = {171–180},
abstract = {A system aimed at facilitating the interaction between a human user and an humanoid robot is presented. The system is suited to answer questions about laboratories activities, people involved, projects, research themes and collaborations among employees. The task is accomplished by the HermiT reasoner invoked by a speech recognition module. The system is capable of navigating a specific ontology making inference on it. The presented system is part of a broader social robot framework whose goal is to give the user a fulfilling social interaction experience, driven by the perception of the robot internal state and involving intuitive and computational creativity capabilities. © Springer International Publishing AG 2018.},
keywords = {Anthropomorphic Robots, Computational Creativity, Human computer interaction, Human Robot Interaction, Humanoid Robots, Ontologies, Robotics},
pubstate = {published},
tppubtype = {article}
}
A system aimed at facilitating the interaction between a human user and an humanoid robot is presented. The system is suited to answer questions about laboratories activities, people involved, projects, research themes and collaborations among employees. The task is accomplished by the HermiT reasoner invoked by a speech recognition module. The system is capable of navigating a specific ontology making inference on it. The presented system is part of a broader social robot framework whose goal is to give the user a fulfilling social interaction experience, driven by the perception of the robot internal state and involving intuitive and computational creativity capabilities. © Springer International Publishing AG 2018.
Augello, Agnese; Infantino, Ignazio; Lieto, Antonio; Maniscalco, Umberto; Pilato, Giovanni; Vella, Filippo
Towards a dual process approach to computational explanation in human-robot social interaction Proceedings Article
In: A., Bhatt M. Bhatt M. Lieto (Ed.): CEUR Workshop Proceedings, pp. 21–26, CEUR-WS, 2018.
Abstract | Links | BibTeX | Tags: Artificial intelligence, Dual Process Theory, Explainability, Human Robot Interaction
@inproceedings{augello_towards_2018,
title = {Towards a dual process approach to computational explanation in human-robot social interaction},
author = {Agnese Augello and Ignazio Infantino and Antonio Lieto and Umberto Maniscalco and Giovanni Pilato and Filippo Vella},
editor = {Bhatt M. Bhatt M. Lieto A.},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85047906954&partnerID=40&md5=9902c763f57c431005349181b3518769},
year = {2018},
date = {2018-01-01},
booktitle = {CEUR Workshop Proceedings},
volume = {2099},
pages = {21–26},
publisher = {CEUR-WS},
abstract = {The capacity for AI systems of explaining their decisions represents nowadays a huge challenge for both academia and industry (e.g. let us think at the autonomous cars sector). In this paper we sketch a preliminary proposal suggesting the adoption of a dual process approach for computational explanation. Our proposal is declined in the field of Human-Robot Social Interaction; namely, in a gesture recognition task. © 2018 CEUR-WS. All rights reserved.},
keywords = {Artificial intelligence, Dual Process Theory, Explainability, Human Robot Interaction},
pubstate = {published},
tppubtype = {inproceedings}
}
The capacity for AI systems of explaining their decisions represents nowadays a huge challenge for both academia and industry (e.g. let us think at the autonomous cars sector). In this paper we sketch a preliminary proposal suggesting the adoption of a dual process approach for computational explanation. Our proposal is declined in the field of Human-Robot Social Interaction; namely, in a gesture recognition task. © 2018 CEUR-WS. All rights reserved.
Dignum, Virginia; Dignum, Frank; Vazquez-Salceda, Javier; Clodic, A.; Gentile, Manuel; Mascarenhas, Samuel; Augello, Agnese
Design for values for social robot architectures Journal Article
In: Frontiers in Artificial Intelligence and Applications, vol. 311, pp. 43–52, 2018, ISSN: 09226389.
Abstract | Links | BibTeX | Tags: Behavioral Research, Ethics, Human Robot Interaction, Responsible AI, Robotics, Social Practices
@article{dignum_design_2018,
title = {Design for values for social robot architectures},
author = {Virginia Dignum and Frank Dignum and Javier Vazquez-Salceda and A. Clodic and Manuel Gentile and Samuel Mascarenhas and Agnese Augello},
editor = {Norskov M. Loh J. Funk M.},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85058222837&doi=10.3233%2f978-1-61499-931-7-43&partnerID=40&md5=dab1f635e2f9f043c7d1f81a8a2768d8},
doi = {10.3233/978-1-61499-931-7-43},
issn = {09226389},
year = {2018},
date = {2018-01-01},
journal = {Frontiers in Artificial Intelligence and Applications},
volume = {311},
pages = {43–52},
abstract = {The integration of social robots in human societies requires that they are capable to take decisions that may affect the lives of people around them. In order to ensure that these robots will behave according to shared ethical principles, an important shift in the design and development of social robots is needed, one where the main goal is improving ethical transparency rather than technical performance, and placing human values at the core of robot designs. In this abstract, we discuss the concept of ethical decision making and how to achieve trust according to the principles of Autonomy, Responsibility and Transparency (ART). © 2018 The authors and IOS Press. All rights reserved.},
keywords = {Behavioral Research, Ethics, Human Robot Interaction, Responsible AI, Robotics, Social Practices},
pubstate = {published},
tppubtype = {article}
}
The integration of social robots in human societies requires that they are capable to take decisions that may affect the lives of people around them. In order to ensure that these robots will behave according to shared ethical principles, an important shift in the design and development of social robots is needed, one where the main goal is improving ethical transparency rather than technical performance, and placing human values at the core of robot designs. In this abstract, we discuss the concept of ethical decision making and how to achieve trust according to the principles of Autonomy, Responsibility and Transparency (ART). © 2018 The authors and IOS Press. All rights reserved.
Augello, Agnese; Infantino, Ignazio; Maniscalco, Umberto; Pilato, Giovanni; Vella, Filippo
Robot inner perception capability through a soft somatosensory system Journal Article
In: International Journal of Semantic Computing, vol. 12, no. 1, pp. 59–87, 2018, ISSN: 1793351X.
Abstract | Links | BibTeX | Tags: Anthropomorphic Robots, Cognitive Architectures, Cognitive Model, Human Robot Interaction, Motivation, Sensor systems, Somatosensory Systems
@article{augello_robot_2018,
title = {Robot inner perception capability through a soft somatosensory system},
author = {Agnese Augello and Ignazio Infantino and Umberto Maniscalco and Giovanni Pilato and Filippo Vella},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85051523659&doi=10.1142%2fS1793351X18400044&partnerID=40&md5=c602b9f8638911db3433de9acd74ea75},
doi = {10.1142/S1793351X18400044},
issn = {1793351X},
year = {2018},
date = {2018-01-01},
journal = {International Journal of Semantic Computing},
volume = {12},
number = {1},
pages = {59–87},
abstract = {The capability of a robot being aware of its internal status is a step forward to the enhancement of human-robot interaction. The possibility of feeling either pleasant or unpleasant sensations is at the basis of the motivation level of a robot. It can modulate the "willingness" of accomplishing a given task. Negative sensations can represent an alarm indicating dangerous situations, while the feeling of a reassuring environment or a well-being sensation can be a stimulus in pursuing the task, even in the presence of a painful perception. In this paper, we illustrate a bio-inspired somatosensory system embedded in a cognitive model for a humanoid robot. The system is based on a set of soft sensors that have been designed in order to make it possible for the interpretation of the robot physical sensations through a proper classification of the perceived somatosensory signals. This interpretation triggers and modulates the motivation level of the robot as well as its behavior. © 2018 World Scientific Publishing Company.},
keywords = {Anthropomorphic Robots, Cognitive Architectures, Cognitive Model, Human Robot Interaction, Motivation, Sensor systems, Somatosensory Systems},
pubstate = {published},
tppubtype = {article}
}
The capability of a robot being aware of its internal status is a step forward to the enhancement of human-robot interaction. The possibility of feeling either pleasant or unpleasant sensations is at the basis of the motivation level of a robot. It can modulate the "willingness" of accomplishing a given task. Negative sensations can represent an alarm indicating dangerous situations, while the feeling of a reassuring environment or a well-being sensation can be a stimulus in pursuing the task, even in the presence of a painful perception. In this paper, we illustrate a bio-inspired somatosensory system embedded in a cognitive model for a humanoid robot. The system is based on a set of soft sensors that have been designed in order to make it possible for the interpretation of the robot physical sensations through a proper classification of the perceived somatosensory signals. This interpretation triggers and modulates the motivation level of the robot as well as its behavior. © 2018 World Scientific Publishing Company.
Clodic, Aurélie; Vazquez-Salceda, Javier; Dignum, Frank; Mascarenhas, Samuel; Dignum, Virginia; Augello, Agnese; Gentile, Manuel; Alami, Rachid
On the pertinence of social practices for social robotics Journal Article
In: Frontiers in Artificial Intelligence and Applications, vol. 311, pp. 63–74, 2018, ISSN: 09226389.
Abstract | Links | BibTeX | Tags: Human Robot Interaction, Robotics, Social Context, Social Practices
@article{clodic_pertinence_2018,
title = {On the pertinence of social practices for social robotics},
author = {Aurélie Clodic and Javier Vazquez-Salceda and Frank Dignum and Samuel Mascarenhas and Virginia Dignum and Agnese Augello and Manuel Gentile and Rachid Alami},
editor = {Norskov M. Loh J. Funk M.},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85058246800&doi=10.3233%2f978-1-61499-931-7-63&partnerID=40&md5=b6dea7693678d23e4127d1b9597f0d20},
doi = {10.3233/978-1-61499-931-7-63},
issn = {09226389},
year = {2018},
date = {2018-01-01},
journal = {Frontiers in Artificial Intelligence and Applications},
volume = {311},
pages = {63–74},
abstract = {In the area of consumer robots that need to have rich social interactions with humans, one of the challenges is the complexity of computing the appropriate interactions in a cognitive, social and physical context. We propose a novel approach for social robots based on the concept of Social Practices. By using social practices robots are able to be aware of their own social identities (given by the role in the social practice) and the identities of others and also be able to identify the different social contexts and the appropriate social interactions that go along with those contexts and identities. © 2018 The authors and IOS Press. All rights reserved.},
keywords = {Human Robot Interaction, Robotics, Social Context, Social Practices},
pubstate = {published},
tppubtype = {article}
}
In the area of consumer robots that need to have rich social interactions with humans, one of the challenges is the complexity of computing the appropriate interactions in a cognitive, social and physical context. We propose a novel approach for social robots based on the concept of Social Practices. By using social practices robots are able to be aware of their own social identities (given by the role in the social practice) and the identities of others and also be able to identify the different social contexts and the appropriate social interactions that go along with those contexts and identities. © 2018 The authors and IOS Press. All rights reserved.
Augello, Agnese; Dignum, Frank; Gentile, Manuel; Infantino, Ignazio; Maniscalco, Umberto; Pilato, Giovanni; Vella, Filippo
A social practice oriented signs detection for human-humanoid interaction Journal Article
In: Biologically Inspired Cognitive Architectures, vol. 25, pp. 8–16, 2018, ISSN: 2212683X.
Abstract | Links | BibTeX | Tags: Cognitive Architectures, Human Robot Interaction, Social Context, Social Practices, Social Robots
@article{augello_social_2018-1,
title = {A social practice oriented signs detection for human-humanoid interaction},
author = {Agnese Augello and Frank Dignum and Manuel Gentile and Ignazio Infantino and Umberto Maniscalco and Giovanni Pilato and Filippo Vella},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85052488332&doi=10.1016%2fj.bica.2018.07.013&partnerID=40&md5=43ba89b15faf7fac6e16670bb9eeb858},
doi = {10.1016/j.bica.2018.07.013},
issn = {2212683X},
year = {2018},
date = {2018-01-01},
journal = {Biologically Inspired Cognitive Architectures},
volume = {25},
pages = {8–16},
abstract = {In this work we propose a cognitive architecture, based on the Social Practice (SP) theory, aimed at the modeling of socially adaptive robots, able to interact with people, recognizing and interpreting the specific social context where it is acting. The proposed social robot is able to recognize and interpret social signs during ongoing social practices. The cognitive architecture is inspired by the well-known Psi model, and it is equipped with a Social Practice Engine that manages the whole conduct of the robot. The use of such an architecture simplifies and makes more natural the interaction between human beings and a robot. In particular, the scenario of a robot fulfilling the tasks of welcoming people in an office environment is being considered. © 2018 Elsevier B.V.},
keywords = {Cognitive Architectures, Human Robot Interaction, Social Context, Social Practices, Social Robots},
pubstate = {published},
tppubtype = {article}
}
In this work we propose a cognitive architecture, based on the Social Practice (SP) theory, aimed at the modeling of socially adaptive robots, able to interact with people, recognizing and interpreting the specific social context where it is acting. The proposed social robot is able to recognize and interpret social signs during ongoing social practices. The cognitive architecture is inspired by the well-known Psi model, and it is equipped with a Social Practice Engine that manages the whole conduct of the robot. The use of such an architecture simplifies and makes more natural the interaction between human beings and a robot. In particular, the scenario of a robot fulfilling the tasks of welcoming people in an office environment is being considered. © 2018 Elsevier B.V.
Infantino, Ignazio; Augello, Agnese; Maniscalto, Umberto; Pilato, Giovanni; Vella, Filippo
A Cognitive Architecture for Social Robots Proceedings Article
In: IEEE 4th International Forum on Research and Technologies for Society and Industry, RTSI 2018 - Proceedings, Institute of Electrical and Electronics Engineers Inc., 2018, ISBN: 978-1-5386-6282-3.
Abstract | Links | BibTeX | Tags: Cognitive Architectures, Human Robot Interaction, Social Robots, Somatosensory Systems
@inproceedings{infantino_cognitive_2018,
title = {A Cognitive Architecture for Social Robots},
author = {Ignazio Infantino and Agnese Augello and Umberto Maniscalto and Giovanni Pilato and Filippo Vella},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85060055386&doi=10.1109%2fRTSI.2018.8548520&partnerID=40&md5=e0f42bea237008a45b64f3c2ac1b5dea},
doi = {10.1109/RTSI.2018.8548520},
isbn = {978-1-5386-6282-3},
year = {2018},
date = {2018-01-01},
booktitle = {IEEE 4th International Forum on Research and Technologies for Society and Industry, RTSI 2018 - Proceedings},
publisher = {Institute of Electrical and Electronics Engineers Inc.},
abstract = {The paper illustrates a software architecture allowing a robot to socially interact with human beings, sharing with them some basilar cognitive mechanisms. Robust sensing of the environment and people is strongly linked with an artificial somatosensory system that drives the robot behavior at a low level and influences its motivation. Both long-term memory and short-term memory store relevant data to detect and recognize the social context (and social practice), and the human social behavior. Using both internal and external evaluations, the robot learns and improves its social skills, which take into account its physiological and emotional demands (affiliation, competence, certainty). Social interaction is encoded in the cognitive architecture by considering at the same level the human understanding and the robot communicative actions. This is done by using the same interaction channels (both verbal and nonverbal). Some examples derived from previous works show the effectiveness and the potential of the cognitive architecture. © 2018 IEEE.},
keywords = {Cognitive Architectures, Human Robot Interaction, Social Robots, Somatosensory Systems},
pubstate = {published},
tppubtype = {inproceedings}
}
The paper illustrates a software architecture allowing a robot to socially interact with human beings, sharing with them some basilar cognitive mechanisms. Robust sensing of the environment and people is strongly linked with an artificial somatosensory system that drives the robot behavior at a low level and influences its motivation. Both long-term memory and short-term memory store relevant data to detect and recognize the social context (and social practice), and the human social behavior. Using both internal and external evaluations, the robot learns and improves its social skills, which take into account its physiological and emotional demands (affiliation, competence, certainty). Social interaction is encoded in the cognitive architecture by considering at the same level the human understanding and the robot communicative actions. This is done by using the same interaction channels (both verbal and nonverbal). Some examples derived from previous works show the effectiveness and the potential of the cognitive architecture. © 2018 IEEE.
2016
Augello, Agnese; Infantino, Ignazio; Manfré, Adriano; Pilato, Giovanni; Vella, Filippo
Analyzing and Discussing Primary Creative Traits of a Robotic Artist Journal Article
In: Biologically Inspired Cognitive Architectures, vol. 17, pp. 22–31, 2016, ISSN: 2212683X.
Abstract | Links | BibTeX | Tags: Anthropomorphic Robots, Artificial intelligence, Cognitive Architectures, Computational Creativity, Creative Agents, Creative Process, Human computer interaction, Human Robot Interaction, Humanoid Robots, Information Management, Social Robots
@article{augelloAnalyzingDiscussingPrimary2016,
title = {Analyzing and Discussing Primary Creative Traits of a Robotic Artist},
author = { Agnese Augello and Ignazio Infantino and Adriano Manfré and Giovanni Pilato and Filippo Vella},
doi = {10.1016/j.bica.2016.07.006},
issn = {2212683X},
year = {2016},
date = {2016-01-01},
journal = {Biologically Inspired Cognitive Architectures},
volume = {17},
pages = {22--31},
abstract = {We present a robot aimed at producing a collage formed by a mix of photomontage and digital collage. The artwork is created after a visual and verbal interaction with a human user. The proposed system, through a cognitive architecture, allows the robot to manage the three different phases of the real-time artwork process: (i) taking inspiration from information captured during the postural and verbal interaction with the human user and from the analysis of his/her social web items; (ii) performing a creative process to obtain a model of the artwork; (iii) executing the creative collage composition and providing a significant title. The paper explains, primarily, how the creativity traits of the robot are implemented in the proposed architecture: how ideas are generated through an elaboration that is modulated by affective influences; how the personality and the artistic behavior are modeled by learning and guided by external evaluations; the motivation and the confidence evolution as a function of successes or failures. textcopyright 2016 Elsevier B.V. All rights reserved.},
keywords = {Anthropomorphic Robots, Artificial intelligence, Cognitive Architectures, Computational Creativity, Creative Agents, Creative Process, Human computer interaction, Human Robot Interaction, Humanoid Robots, Information Management, Social Robots},
pubstate = {published},
tppubtype = {article}
}
We present a robot aimed at producing a collage formed by a mix of photomontage and digital collage. The artwork is created after a visual and verbal interaction with a human user. The proposed system, through a cognitive architecture, allows the robot to manage the three different phases of the real-time artwork process: (i) taking inspiration from information captured during the postural and verbal interaction with the human user and from the analysis of his/her social web items; (ii) performing a creative process to obtain a model of the artwork; (iii) executing the creative collage composition and providing a significant title. The paper explains, primarily, how the creativity traits of the robot are implemented in the proposed architecture: how ideas are generated through an elaboration that is modulated by affective influences; how the personality and the artistic behavior are modeled by learning and guided by external evaluations; the motivation and the confidence evolution as a function of successes or failures. textcopyright 2016 Elsevier B.V. All rights reserved.
Infantino, Ignazio; Augello, Agnese; Manfré, Adriano; Pilato, Giovanni; Vella, Filippo
Robodanza: Live Performances of a Creative Dancing Humanoid Proceedings Article
In: F., Cardoso F. A. Corruble V. Ghedini F. Pachet (Ed.): Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016, pp. 388–395, Sony CSL, 2016, ISBN: 978-2-7466-9155-1.
Abstract | BibTeX | Tags: Anthropomorphic Robots, Artificial intelligence, Cognitive Architectures, Creative Agents, Human Robot Interaction, Social Robots
@inproceedings{infantinoRobodanzaLivePerformances2016,
title = {Robodanza: Live Performances of a Creative Dancing Humanoid},
author = { Ignazio Infantino and Agnese Augello and Adriano Manfré and Giovanni Pilato and Filippo Vella},
editor = { Cardoso F.A. Corruble V. Ghedini F. Pachet F.},
isbn = {978-2-7466-9155-1},
year = {2016},
date = {2016-01-01},
booktitle = {Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016},
pages = {388--395},
publisher = {Sony CSL},
abstract = {The paper describes the artistic performances obtained with a creative system based on a cognitive architecture. The performances are executed by a humanoid robot whose creative behaviour is strongly influenced both by the interaction with human dancers and by internal and external evaluation mechanisms. The complexity of such a task requires the development of robust and fast algorithms in order to effectively perceive and process musical inputs, and the generation of coherent movements in order to realize an amusing and original choreography. A basic sketch of the choreography has been conceived and set-up in cooperation with professional dancers. The sketch takes into account both robot capabilities and limitations. Three live performances are discussed in detail, reporting their impact on the audience, the environmental conditions, and the adopted solutions to satisfy safety requirements, and achieve aesthetic pleasantness. textcopyright 2016 Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016. All rights reserved.},
keywords = {Anthropomorphic Robots, Artificial intelligence, Cognitive Architectures, Creative Agents, Human Robot Interaction, Social Robots},
pubstate = {published},
tppubtype = {inproceedings}
}
The paper describes the artistic performances obtained with a creative system based on a cognitive architecture. The performances are executed by a humanoid robot whose creative behaviour is strongly influenced both by the interaction with human dancers and by internal and external evaluation mechanisms. The complexity of such a task requires the development of robust and fast algorithms in order to effectively perceive and process musical inputs, and the generation of coherent movements in order to realize an amusing and original choreography. A basic sketch of the choreography has been conceived and set-up in cooperation with professional dancers. The sketch takes into account both robot capabilities and limitations. Three live performances are discussed in detail, reporting their impact on the audience, the environmental conditions, and the adopted solutions to satisfy safety requirements, and achieve aesthetic pleasantness. textcopyright 2016 Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016. All rights reserved.
Manfré, Adriano; Augello, Agnese; Pilato, Giovanni; Vella, Filippo; Infantino, Ignazio
Exploiting Interactive Genetic Algorithms for Creative Humanoid Dancing Journal Article
In: Biologically Inspired Cognitive Architectures, vol. 17, pp. 12–21, 2016, ISSN: 2212683X.
Abstract | Links | BibTeX | Tags: Artificial intelligence, Cognitive Architectures, Computational Creativity, Creative Agents, Human Robot Interaction
@article{manfreExploitingInteractiveGenetic2016,
title = {Exploiting Interactive Genetic Algorithms for Creative Humanoid Dancing},
author = { Adriano Manfré and Agnese Augello and Giovanni Pilato and Filippo Vella and Ignazio Infantino},
doi = {10.1016/j.bica.2016.07.004},
issn = {2212683X},
year = {2016},
date = {2016-01-01},
journal = {Biologically Inspired Cognitive Architectures},
volume = {17},
pages = {12--21},
abstract = {The paper discusses an approach aimed at endowing a cognitive architecture with artificial creativity capabilities in order to make a humanoid able to dance in a pleasant manner. The robot associates movements to music perception creating an aesthetically valuable dance by using a Hidden Markov Model with a nonclassical approach. Two matrices mainly influence the model: a Transition matrix TM, and an Emission Matrix EM. The TM matrix rules the transition between two subsequent movements. The EM matrix constitutes the link between a set of movements and the perceived music features. In order to compute the EM matrix, we exploit a genetic algorithm approach. The approach makes use of two kinds of fitness functions. The first one is an internal evaluation fitness that allows the robot to autonomously learn the association between music and movements. The second one depends on the interaction with a human teacher, leading to the determination of different dance styles, which constitute the robot repertoire. The experimental part discusses the effects on the creativity of different distances to compute fitness. textcopyright 2016 Elsevier B.V. All rights reserved.},
keywords = {Artificial intelligence, Cognitive Architectures, Computational Creativity, Creative Agents, Human Robot Interaction},
pubstate = {published},
tppubtype = {article}
}
The paper discusses an approach aimed at endowing a cognitive architecture with artificial creativity capabilities in order to make a humanoid able to dance in a pleasant manner. The robot associates movements to music perception creating an aesthetically valuable dance by using a Hidden Markov Model with a nonclassical approach. Two matrices mainly influence the model: a Transition matrix TM, and an Emission Matrix EM. The TM matrix rules the transition between two subsequent movements. The EM matrix constitutes the link between a set of movements and the perceived music features. In order to compute the EM matrix, we exploit a genetic algorithm approach. The approach makes use of two kinds of fitness functions. The first one is an internal evaluation fitness that allows the robot to autonomously learn the association between music and movements. The second one depends on the interaction with a human teacher, leading to the determination of different dance styles, which constitute the robot repertoire. The experimental part discusses the effects on the creativity of different distances to compute fitness. textcopyright 2016 Elsevier B.V. All rights reserved.
Infantino, Ignazio; Augello, Agnese; Manfré, Adriano; Pilato, Giovanni; Vella, Filippo
Robodanza: Live performances of a creative dancing humanoid Proceedings Article
In: F., Corruble V. Cardoso F. A. Pachet (Ed.): Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016, pp. 388–395, Sony CSL, 2016, ISBN: 978-2-7466-9155-1.
Abstract | Links | BibTeX | Tags: Anthropomorphic Robots, Artificial intelligence, Cognitive Architectures, Creative Agents, Human Robot Interaction, Social Robots
@inproceedings{infantino_robodanza_2016,
title = {Robodanza: Live performances of a creative dancing humanoid},
author = {Ignazio Infantino and Agnese Augello and Adriano Manfré and Giovanni Pilato and Filippo Vella},
editor = {Corruble V. Cardoso F.A. Pachet F.},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85042599660&partnerID=40&md5=c2c8dd727b6e58b00b2fc72272923f0e},
isbn = {978-2-7466-9155-1},
year = {2016},
date = {2016-01-01},
booktitle = {Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016},
pages = {388–395},
publisher = {Sony CSL},
abstract = {The paper describes the artistic performances obtained with a creative system based on a cognitive architecture. The performances are executed by a humanoid robot whose creative behaviour is strongly influenced both by the interaction with human dancers and by internal and external evaluation mechanisms. The complexity of such a task requires the development of robust and fast algorithms in order to effectively perceive and process musical inputs, and the generation of coherent movements in order to realize an amusing and original choreography. A basic sketch of the choreography has been conceived and set-up in cooperation with professional dancers. The sketch takes into account both robot capabilities and limitations. Three live performances are discussed in detail, reporting their impact on the audience, the environmental conditions, and the adopted solutions to satisfy safety requirements, and achieve aesthetic pleasantness. © 2016 Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016. All rights reserved.},
keywords = {Anthropomorphic Robots, Artificial intelligence, Cognitive Architectures, Creative Agents, Human Robot Interaction, Social Robots},
pubstate = {published},
tppubtype = {inproceedings}
}
The paper describes the artistic performances obtained with a creative system based on a cognitive architecture. The performances are executed by a humanoid robot whose creative behaviour is strongly influenced both by the interaction with human dancers and by internal and external evaluation mechanisms. The complexity of such a task requires the development of robust and fast algorithms in order to effectively perceive and process musical inputs, and the generation of coherent movements in order to realize an amusing and original choreography. A basic sketch of the choreography has been conceived and set-up in cooperation with professional dancers. The sketch takes into account both robot capabilities and limitations. Three live performances are discussed in detail, reporting their impact on the audience, the environmental conditions, and the adopted solutions to satisfy safety requirements, and achieve aesthetic pleasantness. © 2016 Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016. All rights reserved.
Manfré, Adriano; Augello, Agnese; Pilato, Giovanni; Vella, Filippo; Infantino, Ignazio
Exploiting interactive genetic algorithms for creative humanoid dancing Journal Article
In: Biologically Inspired Cognitive Architectures, vol. 17, pp. 12–21, 2016, ISSN: 2212683X.
Abstract | Links | BibTeX | Tags: Artificial intelligence, Cognitive Architectures, Computational Creativity, Creative Agents, Human Robot Interaction
@article{manfre_exploiting_2016,
title = {Exploiting interactive genetic algorithms for creative humanoid dancing},
author = {Adriano Manfré and Agnese Augello and Giovanni Pilato and Filippo Vella and Ignazio Infantino},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-84994805980&doi=10.1016%2fj.bica.2016.07.004&partnerID=40&md5=78d4161f046ce425fb59b2d1650d7d3b},
doi = {10.1016/j.bica.2016.07.004},
issn = {2212683X},
year = {2016},
date = {2016-01-01},
journal = {Biologically Inspired Cognitive Architectures},
volume = {17},
pages = {12–21},
abstract = {The paper discusses an approach aimed at endowing a cognitive architecture with artificial creativity capabilities in order to make a humanoid able to dance in a pleasant manner. The robot associates movements to music perception creating an aesthetically valuable dance by using a Hidden Markov Model with a nonclassical approach. Two matrices mainly influence the model: a Transition matrix TM, and an Emission Matrix EM. The TM matrix rules the transition between two subsequent movements. The EM matrix constitutes the link between a set of movements and the perceived music features. In order to compute the EM matrix, we exploit a genetic algorithm approach. The approach makes use of two kinds of fitness functions. The first one is an internal evaluation fitness that allows the robot to autonomously learn the association between music and movements. The second one depends on the interaction with a human teacher, leading to the determination of different dance styles, which constitute the robot repertoire. The experimental part discusses the effects on the creativity of different distances to compute fitness. © 2016 Elsevier B.V. All rights reserved.},
keywords = {Artificial intelligence, Cognitive Architectures, Computational Creativity, Creative Agents, Human Robot Interaction},
pubstate = {published},
tppubtype = {article}
}
The paper discusses an approach aimed at endowing a cognitive architecture with artificial creativity capabilities in order to make a humanoid able to dance in a pleasant manner. The robot associates movements to music perception creating an aesthetically valuable dance by using a Hidden Markov Model with a nonclassical approach. Two matrices mainly influence the model: a Transition matrix TM, and an Emission Matrix EM. The TM matrix rules the transition between two subsequent movements. The EM matrix constitutes the link between a set of movements and the perceived music features. In order to compute the EM matrix, we exploit a genetic algorithm approach. The approach makes use of two kinds of fitness functions. The first one is an internal evaluation fitness that allows the robot to autonomously learn the association between music and movements. The second one depends on the interaction with a human teacher, leading to the determination of different dance styles, which constitute the robot repertoire. The experimental part discusses the effects on the creativity of different distances to compute fitness. © 2016 Elsevier B.V. All rights reserved.