AHCI RESEARCH GROUP
Publications
Papers published in international journals,
proceedings of conferences, workshops and books.
OUR RESEARCH
Scientific Publications
How to
Here you can find the complete list of our publications.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
2023
Augello, Agnese; Gaglio, Salvatore; Infantino, Ignazio; Maniscalco, Umberto; Pilato, Giovanni; Vella, Filippo
Roboception and Adaptation in a Cognitive Robot Journal Article
In: Robotics and autonomous systems (Print), pp. 104400, 2023, ISSN: 0921-8890.
Abstract | Links | BibTeX | Tags: Cognitive Architectures, Humanoid Robots, Reinforcement Learning, Roboceptions, Sensor systems, Social Robots
@article{augelloRoboceptionAdaptationCognitive2023,
title = {Roboception and Adaptation in a Cognitive Robot},
author = { Agnese Augello and Salvatore Gaglio and Ignazio Infantino and Umberto Maniscalco and Giovanni Pilato and Filippo Vella},
doi = {10.1016/j.robot.2023.104400},
issn = {0921-8890},
year = {2023},
date = {2023-01-01},
journal = {Robotics and autonomous systems (Print)},
pages = {104400},
abstract = {In robotics, perception is usually oriented at understanding what is happening in the external world, while few works pay attention to what is occurring in the robot's body. In this work, we propose an artificial somatosensory system, embedded in a cognitive architecture, that enables a robot to perceive the sensations from its embodiment while executing a task. We called these perceptions roboceptions, and they let the robot act according to its own physical needs in addition to the task demands. Physical information is processed by the robot to behave in a balanced way, determining the most appropriate trade-off between the achievement of the task and its well being. The experiments show the integration of information from the somatosensory system and the choices that lead to the accomplishment of the task.},
keywords = {Cognitive Architectures, Humanoid Robots, Reinforcement Learning, Roboceptions, Sensor systems, Social Robots},
pubstate = {published},
tppubtype = {article}
}
In robotics, perception is usually oriented at understanding what is happening in the external world, while few works pay attention to what is occurring in the robot's body. In this work, we propose an artificial somatosensory system, embedded in a cognitive architecture, that enables a robot to perceive the sensations from its embodiment while executing a task. We called these perceptions roboceptions, and they let the robot act according to its own physical needs in addition to the task demands. Physical information is processed by the robot to behave in a balanced way, determining the most appropriate trade-off between the achievement of the task and its well being. The experiments show the integration of information from the somatosensory system and the choices that lead to the accomplishment of the task.
2021
Augello, Agnese; Citt`a, Giuseppe; Gentile, Manuel; Lieto, Antonio
A Storytelling Robot Managing Persuasive and Ethical Stances via ACT-R: An Exploratory Study Journal Article
In: International Journal of Social Robotics, 2021, ISSN: 18754791.
Abstract | Links | BibTeX | Tags: Cognitive Architectures, Covid-19, Dialogue Management, Ethical Argumentation, Ethics, Persuasive Systems, Social Robots, Storytelling Robots
@article{augelloStorytellingRobotManaging2021,
title = {A Storytelling Robot Managing Persuasive and Ethical Stances via ACT-R: An Exploratory Study},
author = { Agnese Augello and Giuseppe Citt{`a} and Manuel Gentile and Antonio Lieto},
doi = {10.1007/s12369-021-00847-w},
issn = {18754791},
year = {2021},
date = {2021-01-01},
journal = {International Journal of Social Robotics},
abstract = {We present a storytelling robot, controlled via the ACT-R cognitive architecture, able to adopt different persuasive techniques and ethical stances while conversing about some topics concerning COVID-19. The main contribution of the paper consists in the proposal of a needs-driven model that guides and evaluates, during the dialogue, the use (if any) of persuasive techniques available in the agent procedural memory. The portfolio of persuasive techniques tested in such a model ranges from the use of storytelling to framing techniques and rhetorical-based arguments. To the best of our knowledge, this represents the first attempt of building a persuasive agent able to integrate a mix of explicitly grounded cognitive assumptions about dialogue management, storytelling and persuasive techniques as well as ethical attitudes. The paper presents the results of an exploratory evaluation of the system on 63 participants. textcopyright 2021, The Author(s).},
keywords = {Cognitive Architectures, Covid-19, Dialogue Management, Ethical Argumentation, Ethics, Persuasive Systems, Social Robots, Storytelling Robots},
pubstate = {published},
tppubtype = {article}
}
We present a storytelling robot, controlled via the ACT-R cognitive architecture, able to adopt different persuasive techniques and ethical stances while conversing about some topics concerning COVID-19. The main contribution of the paper consists in the proposal of a needs-driven model that guides and evaluates, during the dialogue, the use (if any) of persuasive techniques available in the agent procedural memory. The portfolio of persuasive techniques tested in such a model ranges from the use of storytelling to framing techniques and rhetorical-based arguments. To the best of our knowledge, this represents the first attempt of building a persuasive agent able to integrate a mix of explicitly grounded cognitive assumptions about dialogue management, storytelling and persuasive techniques as well as ethical attitudes. The paper presents the results of an exploratory evaluation of the system on 63 participants. textcopyright 2021, The Author(s).
Ferrante, Giuliana; Vitale, Gianpaolo; Licari, Amelia; Montalbano, Laura; Pilato, Giovanni; Infantino, Ignazio; Augello, Agnese; Grutta, Stefania La
Social Robots and Therapeutic Adherence: A New Challenge in Pediatric Asthma? Journal Article
In: Paediatric Respiratory Reviews, vol. 40, pp. 46–51, 2021, ISSN: 15260542.
Abstract | Links | BibTeX | Tags: Asthma, Healthcare, Robotics, Social Agents, Social Robots
@article{ferranteSocialRobotsTherapeutic2021,
title = {Social Robots and Therapeutic Adherence: A New Challenge in Pediatric Asthma?},
author = { Giuliana Ferrante and Gianpaolo Vitale and Amelia Licari and Laura Montalbano and Giovanni Pilato and Ignazio Infantino and Agnese Augello and Stefania La Grutta},
doi = {10.1016/j.prrv.2020.11.001},
issn = {15260542},
year = {2021},
date = {2021-01-01},
journal = {Paediatric Respiratory Reviews},
volume = {40},
pages = {46--51},
abstract = {Social Robots are used in different contexts and, in healthcare, they are better known as Socially Assistive Robots. In the context of asthma, the use of Socially Assistive Robots has the potential to increase motivation and engagement to treatment. Other positive roles proposed for Socially Assistive Robots are to provide education, training regarding treatments, and feedback to patients. This review evaluates emerging interventions for improving treatment adherence in pediatric asthma, focusing on the possible future role of social robots in the clinical practice. textcopyright 2020 Elsevier Ltd},
keywords = {Asthma, Healthcare, Robotics, Social Agents, Social Robots},
pubstate = {published},
tppubtype = {article}
}
Social Robots are used in different contexts and, in healthcare, they are better known as Socially Assistive Robots. In the context of asthma, the use of Socially Assistive Robots has the potential to increase motivation and engagement to treatment. Other positive roles proposed for Socially Assistive Robots are to provide education, training regarding treatments, and feedback to patients. This review evaluates emerging interventions for improving treatment adherence in pediatric asthma, focusing on the possible future role of social robots in the clinical practice. textcopyright 2020 Elsevier Ltd
2020
Augello, Agnese; Infantino, Ignazio; Gaglio, Salvatore; Maniscalco, Umberto; Pilato, Giovanni; Vella, Filippo
An Artificial Soft Somatosensory System for a Cognitive Robot Proceedings Article
In: Proceedings - 4th IEEE International Conference on Robotic Computing, IRC 2020, pp. 319–326, Institute of Electrical and Electronics Engineers Inc., 2020, ISBN: 978-1-72815-237-0.
Abstract | Links | BibTeX | Tags: Cognitive Architectures, Reinforcement Learning, Robotics, Social Robots, Somatosensory Systems
@inproceedings{augelloArtificialSoftSomatosensory2020,
title = {An Artificial Soft Somatosensory System for a Cognitive Robot},
author = { Agnese Augello and Ignazio Infantino and Salvatore Gaglio and Umberto Maniscalco and Giovanni Pilato and Filippo Vella},
doi = {10.1109/IRC.2020.00058},
isbn = {978-1-72815-237-0},
year = {2020},
date = {2020-01-01},
booktitle = {Proceedings - 4th IEEE International Conference on Robotic Computing, IRC 2020},
pages = {319--326},
publisher = {Institute of Electrical and Electronics Engineers Inc.},
abstract = {The paper proposes an artificial somatosensory system loosely inspired by human beings' biology and embedded in a cognitive architecture (CA). It enables a robot to receive the stimulation from its embodiment, and use these sensations, we called roboceptions, to behave according to both the external environment and the internal robot status. In such a way, the robot is aware of its body and able to interpret physical sensations can be more effective in the task while maintaining its well being. The robot's physiological urges are tightly bound to the specific physical state of the robot. Positive and negative physical information can, therefore, be processed and let the robot behave in a more realistic way adopting the right trade-off between the achievement of the task and the well-being of the robot. This goal has been achieved through a reinforcement learning approach. To test these statements we considered, as a test-bench, the execution of working performances with an SoftBank NAO robot that are modulated according its body well-being. textcopyright 2020 IEEE.},
keywords = {Cognitive Architectures, Reinforcement Learning, Robotics, Social Robots, Somatosensory Systems},
pubstate = {published},
tppubtype = {inproceedings}
}
The paper proposes an artificial somatosensory system loosely inspired by human beings' biology and embedded in a cognitive architecture (CA). It enables a robot to receive the stimulation from its embodiment, and use these sensations, we called roboceptions, to behave according to both the external environment and the internal robot status. In such a way, the robot is aware of its body and able to interpret physical sensations can be more effective in the task while maintaining its well being. The robot's physiological urges are tightly bound to the specific physical state of the robot. Positive and negative physical information can, therefore, be processed and let the robot behave in a more realistic way adopting the right trade-off between the achievement of the task and the well-being of the robot. This goal has been achieved through a reinforcement learning approach. To test these statements we considered, as a test-bench, the execution of working performances with an SoftBank NAO robot that are modulated according its body well-being. textcopyright 2020 IEEE.
Augello, Agnese; Ciulla, Angelo; Cuzzocrea, Alfredo; Gaglio, Salvatore; Pilato, Giovanni; Vella, Filippo
A Kinect-Based Gesture Acquisition and Reproduction System for Humanoid Robots Proceedings Article
In: Gervasi, O; Murgante, B; Misra, S; Garau, C; Blecic, I; Taniar, D; relax BO Apduhan,; relax AMAC Rocha,; Tarantino, E; relax CM Torre,; Karaca, Y (Ed.): COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2020, PT I, pp. 967–977, SPRINGER INTERNATIONAL PUBLISHING AG, GEWERBESTRASSE 11, CHAM, CH-6330, SWITZERLAND, 2020, ISBN: 978-3-030-58799-4 978-3-030-58798-7.
Abstract | Links | BibTeX | Tags: Gestural Interaction, Humanoid Robots, RGB-D, Social Robots
@inproceedings{augelloKinectBasedGestureAcquisition2020,
title = {A Kinect-Based Gesture Acquisition and Reproduction System for Humanoid Robots},
author = { Agnese Augello and Angelo Ciulla and Alfredo Cuzzocrea and Salvatore Gaglio and Giovanni Pilato and Filippo Vella},
editor = { O Gervasi and B Murgante and S Misra and C Garau and I Blecic and D Taniar and {relax BO} Apduhan and {relax AMAC} Rocha and E Tarantino and {relax CM} Torre and Y Karaca},
doi = {10.1007/978-3-030-58799-4_69},
isbn = {978-3-030-58799-4 978-3-030-58798-7},
year = {2020},
date = {2020-01-01},
booktitle = {COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2020, PT I},
volume = {12249},
pages = {967--977},
publisher = {SPRINGER INTERNATIONAL PUBLISHING AG},
address = {GEWERBESTRASSE 11, CHAM, CH-6330, SWITZERLAND},
series = {Lecture Notes in Computer Science},
abstract = {The paper illustrates a system that endows an humanoid robot with the capability to mimic the motion of a human user in real time, serving as a basis for further gesture based human-robot interactions. The described approach uses the Microsoft Kinect as a low cost alternative to expensive motion capture devices.},
keywords = {Gestural Interaction, Humanoid Robots, RGB-D, Social Robots},
pubstate = {published},
tppubtype = {inproceedings}
}
The paper illustrates a system that endows an humanoid robot with the capability to mimic the motion of a human user in real time, serving as a basis for further gesture based human-robot interactions. The described approach uses the Microsoft Kinect as a low cost alternative to expensive motion capture devices.
Augello, Agnese; Pilato, Giovanni; Trecarichi, Gaia; Vassallo, Giorgio; Vella, Filippo
A Robotic Humanoid for Information Exploration on Cultural Heritage Domain Journal Article
In: Studies in Computational Intelligence, vol. 859, pp. 47–65, 2020, ISSN: 1860949X.
Abstract | Links | BibTeX | Tags: Cultural heritage, Humanoid Robots, Social Robots
@article{augelloRoboticHumanoidInformation2020,
title = {A Robotic Humanoid for Information Exploration on Cultural Heritage Domain},
author = { Agnese Augello and Giovanni Pilato and Gaia Trecarichi and Giorgio Vassallo and Filippo Vella},
doi = {10.1007/978-3-030-36107-5_3},
issn = {1860949X},
year = {2020},
date = {2020-01-01},
journal = {Studies in Computational Intelligence},
volume = {859},
pages = {47--65},
abstract = {The work presented here illustrates an humanoid robot capable of interacting with an human user within the Cultural Heritage domain. Two different and complementary AI approaches, namely sub-symbolic and symbolic, have been implemented and combined together to design the framework of a robot having both rational and intuitive capabilities. Furthermore, the robot is capable of providing information expressively and of adapting its behavior according to the emotional content of the artworks descriptions. This could make the robot more effective in providing information and entertaining the users. textcopyright 2020, Springer Nature Switzerland AG.},
keywords = {Cultural heritage, Humanoid Robots, Social Robots},
pubstate = {published},
tppubtype = {article}
}
The work presented here illustrates an humanoid robot capable of interacting with an human user within the Cultural Heritage domain. Two different and complementary AI approaches, namely sub-symbolic and symbolic, have been implemented and combined together to design the framework of a robot having both rational and intuitive capabilities. Furthermore, the robot is capable of providing information expressively and of adapting its behavior according to the emotional content of the artworks descriptions. This could make the robot more effective in providing information and entertaining the users. textcopyright 2020, Springer Nature Switzerland AG.
Bono, Adriana; Augello, Agnese; Pilato, Giovanni; Vella, Filippo; Gaglio, Salvatore
An ACT-R Based Humanoid Social Robot to Manage Storytelling Activities Journal Article
In: Robotics, vol. 9, no. 2, 2020, ISSN: 22186581.
Abstract | Links | BibTeX | Tags: ACT-R, Cognitive Architectures, Education, Humanoid Robots, Introspective Dialogs, Social Practices, Social Robots, Storytelling Robots
@article{bonoACTRBasedHumanoid2020,
title = {An ACT-R Based Humanoid Social Robot to Manage Storytelling Activities},
author = { Adriana Bono and Agnese Augello and Giovanni Pilato and Filippo Vella and Salvatore Gaglio},
doi = {10.3390/ROBOTICS9020025},
issn = {22186581},
year = {2020},
date = {2020-01-01},
journal = {Robotics},
volume = {9},
number = {2},
abstract = {This paper describes an interactive storytelling system, accessible through the SoftBank robotic platforms NAO and Pepper. The main contribution consists of the interpretation of the story characters by humanoid robots, obtained through the definition of appropriate cognitive models, relying on the ACT-R cognitive architecture. The reasoning processes leading to the story evolution are based on the represented knowledge and the suggestions of the listener in critical points of the story. They are disclosed during the narration, to make clear the dynamics of the story and the feelings of the characters. We analyzed the impact of such externalization of the internal status of the characters to set the basis for future experimentation with primary school children. textcopyright 2020 by the authors.},
keywords = {ACT-R, Cognitive Architectures, Education, Humanoid Robots, Introspective Dialogs, Social Practices, Social Robots, Storytelling Robots},
pubstate = {published},
tppubtype = {article}
}
This paper describes an interactive storytelling system, accessible through the SoftBank robotic platforms NAO and Pepper. The main contribution consists of the interpretation of the story characters by humanoid robots, obtained through the definition of appropriate cognitive models, relying on the ACT-R cognitive architecture. The reasoning processes leading to the story evolution are based on the represented knowledge and the suggestions of the listener in critical points of the story. They are disclosed during the narration, to make clear the dynamics of the story and the feelings of the characters. We analyzed the impact of such externalization of the internal status of the characters to set the basis for future experimentation with primary school children. textcopyright 2020 by the authors.
Bono, Adriana; Augello, Agnese; Pilato, Giovanni; Gaglio, Salvatore
Exploiting Cognitive Architectures to Design Storytelling Activities for NarRob Proceedings Article
In: Proceedings - 4th IEEE International Conference on Robotic Computing, IRC 2020, pp. 428–429, Institute of Electrical and Electronics Engineers Inc., 2020, ISBN: 978-1-72815-237-0.
Abstract | Links | BibTeX | Tags: Cognitive Architectures, Cognitive Process, Education, Interactive Storytelling, Social Robots, Storytelling Robots
@inproceedings{bonoExploitingCognitiveArchitectures2020,
title = {Exploiting Cognitive Architectures to Design Storytelling Activities for NarRob},
author = { Adriana Bono and Agnese Augello and Giovanni Pilato and Salvatore Gaglio},
doi = {10.1109/IRC.2020.00078},
isbn = {978-1-72815-237-0},
year = {2020},
date = {2020-01-01},
booktitle = {Proceedings - 4th IEEE International Conference on Robotic Computing, IRC 2020},
pages = {428--429},
publisher = {Institute of Electrical and Electronics Engineers Inc.},
abstract = {In this work, we exploited the potential of a cognitive architecture to model the characters of a story in an interactive storytelling system. The system is accessible through NarRob, a humanoid storyteller robot. Our main goal was to implement the cognitive processes of the agents played by the robot within a narrative context environment. textcopyright 2020 IEEE.},
keywords = {Cognitive Architectures, Cognitive Process, Education, Interactive Storytelling, Social Robots, Storytelling Robots},
pubstate = {published},
tppubtype = {inproceedings}
}
In this work, we exploited the potential of a cognitive architecture to model the characters of a story in an interactive storytelling system. The system is accessible through NarRob, a humanoid storyteller robot. Our main goal was to implement the cognitive processes of the agents played by the robot within a narrative context environment. textcopyright 2020 IEEE.
Trifir`o, Irene; Augello, Agnese; Maniscalco, Umberto; Pilato, Giovanni; Vella, Filippo; Meo, Rosa
How Are You? How a Robot Can Learn to Express Its Own Roboceptions Proceedings Article
In: Cristiani, Matteo; Toro, Carlos; Zanni-Merk, Cecilia; Howlett, Robert J.; Jain, Lakhmi C. (Ed.): Procedia Computer Science, pp. 480–489, Elsevier B.V., 2020.
Abstract | Links | BibTeX | Tags: Human computer interaction, Knowledge Representation, Latent Semantic Analysis, Natural Language Processing, Robotics, Semantic Computing, Social Robots
@inproceedings{trifiroHowAreYou2020,
title = {How Are You? How a Robot Can Learn to Express Its Own Roboceptions},
author = { Irene Trifir{`o} and Agnese Augello and Umberto Maniscalco and Giovanni Pilato and Filippo Vella and Rosa Meo},
editor = { Matteo Cristiani and Carlos Toro and Cecilia {Zanni-Merk} and Robert J. Howlett and Lakhmi C. Jain},
doi = {10.1016/j.procs.2020.08.050},
year = {2020},
date = {2020-01-01},
booktitle = {Procedia Computer Science},
volume = {176},
pages = {480--489},
publisher = {Elsevier B.V.},
abstract = {This work is framed on investigating how a robot can learn associations between linguistic elements, such as words or sentences, and its bodily perceptions, that we named ``roboceptions''. We discuss the possibility of defining such a process of an association through the interaction with human beings. By interacting with a user, the robot can learn to ascribe a meaning to its roboceptions to express them in natural language. Such a process could then be used by the robot in a verbal interaction to detect some words recalling the previously experimented roboceptions. In this paper, we discuss a Dual-NMT approach to realize such an association. However, it requires adequate training corpus. For this reason, we consider two different phases towards the realization of the system, and we show the results of the first phase, comparing two approaches: one based on the Latent Semantic Analysis paradigm and one based on the Random Indexing methodology.},
keywords = {Human computer interaction, Knowledge Representation, Latent Semantic Analysis, Natural Language Processing, Robotics, Semantic Computing, Social Robots},
pubstate = {published},
tppubtype = {inproceedings}
}
This work is framed on investigating how a robot can learn associations between linguistic elements, such as words or sentences, and its bodily perceptions, that we named ``roboceptions''. We discuss the possibility of defining such a process of an association through the interaction with human beings. By interacting with a user, the robot can learn to ascribe a meaning to its roboceptions to express them in natural language. Such a process could then be used by the robot in a verbal interaction to detect some words recalling the previously experimented roboceptions. In this paper, we discuss a Dual-NMT approach to realize such an association. However, it requires adequate training corpus. For this reason, we consider two different phases towards the realization of the system, and we show the results of the first phase, comparing two approaches: one based on the Latent Semantic Analysis paradigm and one based on the Random Indexing methodology.
2019
Augello, Agnese; Infantino, Ignazio; Maniscalco, Umberto; Pilato, Giovanni; Rizzo, Riccardo; Vella, Filippo
Robotic Intelligence and Computational Creativity Book
World Scientific Publishing Co., 2019, ISBN: 9789811203480; 9789811203473.
Abstract | BibTeX | Tags: Computational Creativity, Creative Agents, Social Robots
@book{augelloRoboticIntelligenceComputational2019,
title = {Robotic Intelligence and Computational Creativity},
author = { Agnese Augello and Ignazio Infantino and Umberto Maniscalco and Giovanni Pilato and Riccardo Rizzo and Filippo Vella},
isbn = {9789811203480; 9789811203473},
year = {2019},
date = {2019-01-01},
volume = {2},
publisher = {World Scientific Publishing Co.},
abstract = {The paper illustrates a cognitive architecture for computational creativity based on the Psi model and the mechanisms inspired by dual-process theories of reasoning and rationality. In particular, three applications of computational creativity will be summed up: (a) a robot capable of executing creative paintings through a multilayer mechanism that implements an associative memory and is capable to properly mix elements belonging to different domains; (b) a robot aimed at producing a collage formed by a mix of photo-montage and digital collage: the artwork is created after a visual and verbal interaction with a human user; and (c) a humanoid robot capable of improvising a dancing choreography in real-time according to the listened music. First results in computational creativity show a set of potentialities to be explored that can shed light on human and artificial creativities and artificial intelligent systems. textcopyright 2019 by World Scientific Publishing Co. Pte. Ltd.},
keywords = {Computational Creativity, Creative Agents, Social Robots},
pubstate = {published},
tppubtype = {book}
}
The paper illustrates a cognitive architecture for computational creativity based on the Psi model and the mechanisms inspired by dual-process theories of reasoning and rationality. In particular, three applications of computational creativity will be summed up: (a) a robot capable of executing creative paintings through a multilayer mechanism that implements an associative memory and is capable to properly mix elements belonging to different domains; (b) a robot aimed at producing a collage formed by a mix of photo-montage and digital collage: the artwork is created after a visual and verbal interaction with a human user; and (c) a humanoid robot capable of improvising a dancing choreography in real-time according to the listened music. First results in computational creativity show a set of potentialities to be explored that can shed light on human and artificial creativities and artificial intelligent systems. textcopyright 2019 by World Scientific Publishing Co. Pte. Ltd.
2018
Augello, Agnese; Dignum, Frank; Gentile, Manuel; Infantino, Ignazio; Maniscalco, Umberto; Pilato, Giovanni; Vella, Filippo
A Social Practice Oriented Signs Detection for Human-Humanoid Interaction Journal Article
In: Biologically Inspired Cognitive Architectures, vol. 25, pp. 8–16, 2018, ISSN: 2212683X.
Abstract | Links | BibTeX | Tags: Cognitive Architectures, Human Robot Interaction, Social Context, Social Practices, Social Robots
@article{augelloSocialPracticeOriented2018,
title = {A Social Practice Oriented Signs Detection for Human-Humanoid Interaction},
author = { Agnese Augello and Frank Dignum and Manuel Gentile and Ignazio Infantino and Umberto Maniscalco and Giovanni Pilato and Filippo Vella},
doi = {10.1016/j.bica.2018.07.013},
issn = {2212683X},
year = {2018},
date = {2018-01-01},
journal = {Biologically Inspired Cognitive Architectures},
volume = {25},
pages = {8--16},
abstract = {In this work we propose a cognitive architecture, based on the Social Practice (SP) theory, aimed at the modeling of socially adaptive robots, able to interact with people, recognizing and interpreting the specific social context where it is acting. The proposed social robot is able to recognize and interpret social signs during ongoing social practices. The cognitive architecture is inspired by the well-known Psi model, and it is equipped with a Social Practice Engine that manages the whole conduct of the robot. The use of such an architecture simplifies and makes more natural the interaction between human beings and a robot. In particular, the scenario of a robot fulfilling the tasks of welcoming people in an office environment is being considered. textcopyright 2018 Elsevier B.V.},
keywords = {Cognitive Architectures, Human Robot Interaction, Social Context, Social Practices, Social Robots},
pubstate = {published},
tppubtype = {article}
}
In this work we propose a cognitive architecture, based on the Social Practice (SP) theory, aimed at the modeling of socially adaptive robots, able to interact with people, recognizing and interpreting the specific social context where it is acting. The proposed social robot is able to recognize and interpret social signs during ongoing social practices. The cognitive architecture is inspired by the well-known Psi model, and it is equipped with a Social Practice Engine that manages the whole conduct of the robot. The use of such an architecture simplifies and makes more natural the interaction between human beings and a robot. In particular, the scenario of a robot fulfilling the tasks of welcoming people in an office environment is being considered. textcopyright 2018 Elsevier B.V.
Infantino, Ignazio; Augello, Agnese; Maniscalto, Umberto; Pilato, Giovanni; Vella, Filippo
A Cognitive Architecture for Social Robots Proceedings Article
In: IEEE 4th International Forum on Research and Technologies for Society and Industry, RTSI 2018 - Proceedings, Institute of Electrical and Electronics Engineers Inc., 2018, ISBN: 978-1-5386-6282-3.
Abstract | Links | BibTeX | Tags: Cognitive Architectures, Human Robot Interaction, Social Robots, Somatosensory Systems
@inproceedings{infantinoCognitiveArchitectureSocial2018,
title = {A Cognitive Architecture for Social Robots},
author = { Ignazio Infantino and Agnese Augello and Umberto Maniscalto and Giovanni Pilato and Filippo Vella},
doi = {10.1109/RTSI.2018.8548520},
isbn = {978-1-5386-6282-3},
year = {2018},
date = {2018-01-01},
booktitle = {IEEE 4th International Forum on Research and Technologies for Society and Industry, RTSI 2018 - Proceedings},
publisher = {Institute of Electrical and Electronics Engineers Inc.},
abstract = {The paper illustrates a software architecture allowing a robot to socially interact with human beings, sharing with them some basilar cognitive mechanisms. Robust sensing of the environment and people is strongly linked with an artificial somatosensory system that drives the robot behavior at a low level and influences its motivation. Both long-term memory and short-term memory store relevant data to detect and recognize the social context (and social practice), and the human social behavior. Using both internal and external evaluations, the robot learns and improves its social skills, which take into account its physiological and emotional demands (affiliation, competence, certainty). Social interaction is encoded in the cognitive architecture by considering at the same level the human understanding and the robot communicative actions. This is done by using the same interaction channels (both verbal and nonverbal). Some examples derived from previous works show the effectiveness and the potential of the cognitive architecture. textcopyright 2018 IEEE.},
keywords = {Cognitive Architectures, Human Robot Interaction, Social Robots, Somatosensory Systems},
pubstate = {published},
tppubtype = {inproceedings}
}
The paper illustrates a software architecture allowing a robot to socially interact with human beings, sharing with them some basilar cognitive mechanisms. Robust sensing of the environment and people is strongly linked with an artificial somatosensory system that drives the robot behavior at a low level and influences its motivation. Both long-term memory and short-term memory store relevant data to detect and recognize the social context (and social practice), and the human social behavior. Using both internal and external evaluations, the robot learns and improves its social skills, which take into account its physiological and emotional demands (affiliation, competence, certainty). Social interaction is encoded in the cognitive architecture by considering at the same level the human understanding and the robot communicative actions. This is done by using the same interaction channels (both verbal and nonverbal). Some examples derived from previous works show the effectiveness and the potential of the cognitive architecture. textcopyright 2018 IEEE.
2017
Manfré, Adriano; Infantino, Ignazio; Augello, Agnese; Pilato, Giovanni; Vella, Filippo
Learning by Demonstration for a Dancing Robot within a Computational Creativity Framework Proceedings Article
In: Proceedings - 2017 1st IEEE International Conference on Robotic Computing, IRC 2017, pp. 434–439, Institute of Electrical and Electronics Engineers Inc., 2017, ISBN: 978-1-5090-6723-7.
Abstract | Links | BibTeX | Tags: Artificial intelligence, Cognitive Architectures, Computational Creativity, Social Robots
@inproceedings{manfreLearningDemonstrationDancing2017,
title = {Learning by Demonstration for a Dancing Robot within a Computational Creativity Framework},
author = { Adriano Manfré and Ignazio Infantino and Agnese Augello and Giovanni Pilato and Filippo Vella},
doi = {10.1109/IRC.2017.58},
isbn = {978-1-5090-6723-7},
year = {2017},
date = {2017-01-01},
booktitle = {Proceedings - 2017 1st IEEE International Conference on Robotic Computing, IRC 2017},
pages = {434--439},
publisher = {Institute of Electrical and Electronics Engineers Inc.},
abstract = {The paper presents a system that learns a set of movements for a creative dancing robot. A human user only dances in front of an 3D camera, and automatically the acquisition system segments the acquired sequence of postures depending on the detected music beat and rhythm. A clustering phase allows the system to group the identified actions in 20 classes, defining the set of movements that is typical of a given person. Analysis of the k-mean algorithm outcomes using different distances is reported. The human postures are translated in the corresponding robot joints configurations and are used to compose dance choreographies creatively. A cognitive architecture developed in previous works drives the process of dance creation. Experimentation shows the sets of movements derived from human users with different dance skills. Audience evaluates the robot performances based on these sets, and results are coherent with the quality and richness of the acquired movements. textcopyright 2017 IEEE.},
keywords = {Artificial intelligence, Cognitive Architectures, Computational Creativity, Social Robots},
pubstate = {published},
tppubtype = {inproceedings}
}
The paper presents a system that learns a set of movements for a creative dancing robot. A human user only dances in front of an 3D camera, and automatically the acquisition system segments the acquired sequence of postures depending on the detected music beat and rhythm. A clustering phase allows the system to group the identified actions in 20 classes, defining the set of movements that is typical of a given person. Analysis of the k-mean algorithm outcomes using different distances is reported. The human postures are translated in the corresponding robot joints configurations and are used to compose dance choreographies creatively. A cognitive architecture developed in previous works drives the process of dance creation. Experimentation shows the sets of movements derived from human users with different dance skills. Audience evaluates the robot performances based on these sets, and results are coherent with the quality and richness of the acquired movements. textcopyright 2017 IEEE.
2016
Augello, Agnese; Infantino, Ignazio; Manfré, Adriano; Pilato, Giovanni; Vella, Filippo
Analyzing and Discussing Primary Creative Traits of a Robotic Artist Journal Article
In: Biologically Inspired Cognitive Architectures, vol. 17, pp. 22–31, 2016, ISSN: 2212683X.
Abstract | Links | BibTeX | Tags: Anthropomorphic Robots, Artificial intelligence, Cognitive Architectures, Computational Creativity, Creative Agents, Creative Process, Human computer interaction, Human Robot Interaction, Humanoid Robots, Information Management, Social Robots
@article{augelloAnalyzingDiscussingPrimary2016,
title = {Analyzing and Discussing Primary Creative Traits of a Robotic Artist},
author = { Agnese Augello and Ignazio Infantino and Adriano Manfré and Giovanni Pilato and Filippo Vella},
doi = {10.1016/j.bica.2016.07.006},
issn = {2212683X},
year = {2016},
date = {2016-01-01},
journal = {Biologically Inspired Cognitive Architectures},
volume = {17},
pages = {22--31},
abstract = {We present a robot aimed at producing a collage formed by a mix of photomontage and digital collage. The artwork is created after a visual and verbal interaction with a human user. The proposed system, through a cognitive architecture, allows the robot to manage the three different phases of the real-time artwork process: (i) taking inspiration from information captured during the postural and verbal interaction with the human user and from the analysis of his/her social web items; (ii) performing a creative process to obtain a model of the artwork; (iii) executing the creative collage composition and providing a significant title. The paper explains, primarily, how the creativity traits of the robot are implemented in the proposed architecture: how ideas are generated through an elaboration that is modulated by affective influences; how the personality and the artistic behavior are modeled by learning and guided by external evaluations; the motivation and the confidence evolution as a function of successes or failures. textcopyright 2016 Elsevier B.V. All rights reserved.},
keywords = {Anthropomorphic Robots, Artificial intelligence, Cognitive Architectures, Computational Creativity, Creative Agents, Creative Process, Human computer interaction, Human Robot Interaction, Humanoid Robots, Information Management, Social Robots},
pubstate = {published},
tppubtype = {article}
}
We present a robot aimed at producing a collage formed by a mix of photomontage and digital collage. The artwork is created after a visual and verbal interaction with a human user. The proposed system, through a cognitive architecture, allows the robot to manage the three different phases of the real-time artwork process: (i) taking inspiration from information captured during the postural and verbal interaction with the human user and from the analysis of his/her social web items; (ii) performing a creative process to obtain a model of the artwork; (iii) executing the creative collage composition and providing a significant title. The paper explains, primarily, how the creativity traits of the robot are implemented in the proposed architecture: how ideas are generated through an elaboration that is modulated by affective influences; how the personality and the artistic behavior are modeled by learning and guided by external evaluations; the motivation and the confidence evolution as a function of successes or failures. textcopyright 2016 Elsevier B.V. All rights reserved.
Augello, Agnese; Infantino, Ignazio; Lieto, Antonio; Pilato, Giovanni; Rizzo, Riccardo; Vella, Filippo
Artwork Creation by a Cognitive Architecture Integrating Computational Creativity and Dual Process Approaches Journal Article
In: Biologically Inspired Cognitive Architectures, vol. 15, pp. 74–86, 2016, ISSN: 2212683X.
Abstract | Links | BibTeX | Tags: Artificial intelligence, Cognitive Architectures, Cognitive Systems, Computational Creativity, Creative Agents, Dual Process Theory, Social Robots
@article{augelloArtworkCreationCognitive2016,
title = {Artwork Creation by a Cognitive Architecture Integrating Computational Creativity and Dual Process Approaches},
author = { Agnese Augello and Ignazio Infantino and Antonio Lieto and Giovanni Pilato and Riccardo Rizzo and Filippo Vella},
doi = {10.1016/j.bica.2015.09.007},
issn = {2212683X},
year = {2016},
date = {2016-01-01},
journal = {Biologically Inspired Cognitive Architectures},
volume = {15},
pages = {74--86},
abstract = {The paper proposes a novel cognitive architecture (CA) for computational creativity based on the Psi model and on the mechanisms inspired by dual process theories of reasoning and rationality. In recent years, many cognitive models have focused on dual process theories to better describe and implement complex cognitive skills in artificial agents, but creativity has been approached only at a descriptive level. In previous works we have described various modules of the cognitive architecture that allows a robot to execute creative paintings. By means of dual process theories we refine some relevant mechanisms to obtain artworks, and in particular we explain details about resolution level of the CA dealing with different strategies of access to the Long Term Memory (LTM) and managing the interaction between S1 and S2 processes of the dual process theory. The creative process involves both divergent and convergent processes in either implicit or explicit manner. This leads to four activities (exploratory, reflective, tacit, and analytic) that, triggered by urges and motivations, generate creative acts. These creative acts exploit both the LTM and the WM in order to make novel substitutions to a perceived image by properly mixing parts of pictures coming from different domains. The paper highlights the role of the interaction between S1 and S2 processes, modulated by the resolution level which focuses the attention of the creative agent by broadening or narrowing the exploration of novel solutions, or even drawing the solution from a set of already made associations. An example of artificial painter is described in some experimentations by using a robotic platform. textcopyright 2015 Elsevier B.V. All rights reserved.},
keywords = {Artificial intelligence, Cognitive Architectures, Cognitive Systems, Computational Creativity, Creative Agents, Dual Process Theory, Social Robots},
pubstate = {published},
tppubtype = {article}
}
The paper proposes a novel cognitive architecture (CA) for computational creativity based on the Psi model and on the mechanisms inspired by dual process theories of reasoning and rationality. In recent years, many cognitive models have focused on dual process theories to better describe and implement complex cognitive skills in artificial agents, but creativity has been approached only at a descriptive level. In previous works we have described various modules of the cognitive architecture that allows a robot to execute creative paintings. By means of dual process theories we refine some relevant mechanisms to obtain artworks, and in particular we explain details about resolution level of the CA dealing with different strategies of access to the Long Term Memory (LTM) and managing the interaction between S1 and S2 processes of the dual process theory. The creative process involves both divergent and convergent processes in either implicit or explicit manner. This leads to four activities (exploratory, reflective, tacit, and analytic) that, triggered by urges and motivations, generate creative acts. These creative acts exploit both the LTM and the WM in order to make novel substitutions to a perceived image by properly mixing parts of pictures coming from different domains. The paper highlights the role of the interaction between S1 and S2 processes, modulated by the resolution level which focuses the attention of the creative agent by broadening or narrowing the exploration of novel solutions, or even drawing the solution from a set of already made associations. An example of artificial painter is described in some experimentations by using a robotic platform. textcopyright 2015 Elsevier B.V. All rights reserved.
Augello, Agnese; Infantino, Ignazio; Manfr`e, Adriano; Pilato, Giovanni; Vella, Filippo; Chella, Antonio
Creation and Cognition for Humanoid Live Dancing Journal Article
In: Robotics and Autonomous Systems, vol. 86, pp. 128–137, 2016, ISSN: 09218890.
Abstract | Links | BibTeX | Tags: Anthropomorphic Robots, Artificial intelligence, Cognitive Architectures, Cognitive Systems, Computational Creativity, Creative Agents, Social Robots
@article{augelloCreationCognitionHumanoid2016,
title = {Creation and Cognition for Humanoid Live Dancing},
author = { Agnese Augello and Ignazio Infantino and Adriano Manfr{`e} and Giovanni Pilato and Filippo Vella and Antonio Chella},
doi = {10.1016/j.robot.2016.09.012},
issn = {09218890},
year = {2016},
date = {2016-01-01},
journal = {Robotics and Autonomous Systems},
volume = {86},
pages = {128--137},
abstract = {Computational creativity in dancing is a recent and challenging research field in Artificial Intelligence and Robotics. We present a cognitive architecture embodied in a humanoid robot capable to create and perform dances driven by the perception of music. The humanoid robot is able to suitably move, to react to human mate dancers and to generate novel and appropriate sequences of movements. The approach is based on a cognitive architecture that integrates Hidden Markov Models and Genetic Algorithms. The system has been implemented on a NAO robot and tested in public setting-up live performances, obtaining positive feedbacks from the audience. textcopyright 2016},
keywords = {Anthropomorphic Robots, Artificial intelligence, Cognitive Architectures, Cognitive Systems, Computational Creativity, Creative Agents, Social Robots},
pubstate = {published},
tppubtype = {article}
}
Computational creativity in dancing is a recent and challenging research field in Artificial Intelligence and Robotics. We present a cognitive architecture embodied in a humanoid robot capable to create and perform dances driven by the perception of music. The humanoid robot is able to suitably move, to react to human mate dancers and to generate novel and appropriate sequences of movements. The approach is based on a cognitive architecture that integrates Hidden Markov Models and Genetic Algorithms. The system has been implemented on a NAO robot and tested in public setting-up live performances, obtaining positive feedbacks from the audience. textcopyright 2016
Augello, Agnese; Infantino, Ignazio; Manfre, Adriano; Pilato, Giovanni; Vella, Filippo; Gentile, Manuel; Citta, Giuseppe; Crifaci, Giulia; Raso, Rossella; Allegra, Mario
A Personal Intelligent Coach for Smart Embodied Learning Environments Proceedings Article
In: Pietro, Giuseppe De; Gallo, Luigi; Howlett, Robert J.; Jain, Lakhmi C. (Ed.): Intelligent Interactive Multimedia Systems and Services 2016, pp. 629–636, SPRINGER INTERNATIONAL PUBLISHING AG, GEWERBESTRASSE 11, CHAM, CH-6330, SWITZERLAND, 2016, ISBN: 978-3-319-39345-2 978-3-319-39344-5.
Abstract | Links | BibTeX | Tags: Cognitive Architectures, Education, Embodied Cognition, Humanoid Robots, Learning Environments, Social Robots
@inproceedings{augelloPersonalIntelligentCoach2016,
title = {A Personal Intelligent Coach for Smart Embodied Learning Environments},
author = { Agnese Augello and Ignazio Infantino and Adriano Manfre and Giovanni Pilato and Filippo Vella and Manuel Gentile and Giuseppe Citta and Giulia Crifaci and Rossella Raso and Mario Allegra},
editor = { Giuseppe De Pietro and Luigi Gallo and Robert J. Howlett and Lakhmi C. Jain},
doi = {10.1007/978-3-319-39345-2_56},
isbn = {978-3-319-39345-2 978-3-319-39344-5},
year = {2016},
date = {2016-01-01},
booktitle = {Intelligent Interactive Multimedia Systems and Services 2016},
volume = {55},
pages = {629--636},
publisher = {SPRINGER INTERNATIONAL PUBLISHING AG},
address = {GEWERBESTRASSE 11, CHAM, CH-6330, SWITZERLAND},
series = {Smart Innovation, Systems and Technologies},
abstract = {Within a Smart Learning Environment (SLE) learners are involved in a new learning process tailored to create a continuum of education by extending the current educational formal settings to real-life informal learning context. The goal of this paper is to describe the Cognitive Architecture (CA) of a Personal Intelligent Coach able tomanage learning tasks and interactions within a complex Smart Learning Environment (SLE). PICo has two possible embodiments: humanoid robot, and an avatar on mobile device. We argue that the proposed intelligent coach can adapt to the contents, to the students needs and can evolve its strategies according the learning process.},
keywords = {Cognitive Architectures, Education, Embodied Cognition, Humanoid Robots, Learning Environments, Social Robots},
pubstate = {published},
tppubtype = {inproceedings}
}
Within a Smart Learning Environment (SLE) learners are involved in a new learning process tailored to create a continuum of education by extending the current educational formal settings to real-life informal learning context. The goal of this paper is to describe the Cognitive Architecture (CA) of a Personal Intelligent Coach able tomanage learning tasks and interactions within a complex Smart Learning Environment (SLE). PICo has two possible embodiments: humanoid robot, and an avatar on mobile device. We argue that the proposed intelligent coach can adapt to the contents, to the students needs and can evolve its strategies according the learning process.
Infantino, Ignazio; Augello, Agnese; Manfré, Adriano; Pilato, Giovanni; Vella, Filippo
Robodanza: Live Performances of a Creative Dancing Humanoid Proceedings Article
In: F., Cardoso F. A. Corruble V. Ghedini F. Pachet (Ed.): Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016, pp. 388–395, Sony CSL, 2016, ISBN: 978-2-7466-9155-1.
Abstract | BibTeX | Tags: Anthropomorphic Robots, Artificial intelligence, Cognitive Architectures, Creative Agents, Human Robot Interaction, Social Robots
@inproceedings{infantinoRobodanzaLivePerformances2016,
title = {Robodanza: Live Performances of a Creative Dancing Humanoid},
author = { Ignazio Infantino and Agnese Augello and Adriano Manfré and Giovanni Pilato and Filippo Vella},
editor = { Cardoso F.A. Corruble V. Ghedini F. Pachet F.},
isbn = {978-2-7466-9155-1},
year = {2016},
date = {2016-01-01},
booktitle = {Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016},
pages = {388--395},
publisher = {Sony CSL},
abstract = {The paper describes the artistic performances obtained with a creative system based on a cognitive architecture. The performances are executed by a humanoid robot whose creative behaviour is strongly influenced both by the interaction with human dancers and by internal and external evaluation mechanisms. The complexity of such a task requires the development of robust and fast algorithms in order to effectively perceive and process musical inputs, and the generation of coherent movements in order to realize an amusing and original choreography. A basic sketch of the choreography has been conceived and set-up in cooperation with professional dancers. The sketch takes into account both robot capabilities and limitations. Three live performances are discussed in detail, reporting their impact on the audience, the environmental conditions, and the adopted solutions to satisfy safety requirements, and achieve aesthetic pleasantness. textcopyright 2016 Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016. All rights reserved.},
keywords = {Anthropomorphic Robots, Artificial intelligence, Cognitive Architectures, Creative Agents, Human Robot Interaction, Social Robots},
pubstate = {published},
tppubtype = {inproceedings}
}
The paper describes the artistic performances obtained with a creative system based on a cognitive architecture. The performances are executed by a humanoid robot whose creative behaviour is strongly influenced both by the interaction with human dancers and by internal and external evaluation mechanisms. The complexity of such a task requires the development of robust and fast algorithms in order to effectively perceive and process musical inputs, and the generation of coherent movements in order to realize an amusing and original choreography. A basic sketch of the choreography has been conceived and set-up in cooperation with professional dancers. The sketch takes into account both robot capabilities and limitations. Three live performances are discussed in detail, reporting their impact on the audience, the environmental conditions, and the adopted solutions to satisfy safety requirements, and achieve aesthetic pleasantness. textcopyright 2016 Proceedings of the 7th International Conference on Computational Creativity, ICCC 2016. All rights reserved.
2014
Augello, Agnese; Infantino, Ignazio; Pilato, Giovanni; Rizzo, Riccardo; Vella, Filippo
Robotic Creativity Driven by Motivation and Semantic Analysis Proceedings Article
In: Proceedings - 2014 IEEE International Conference on Semantic Computing, ICSC 2014, pp. 285–289, IEEE Computer Society, 2014, ISBN: 978-1-4799-4002-8.
Abstract | Links | BibTeX | Tags: Artificial intelligence, Chatbots, Cognitive Architectures, Computational Creativity, Creative Agents, Motivation, Natural Language Processing, PSI, Semantic Computing, Social Robots
@inproceedings{augelloRoboticCreativityDriven2014,
title = {Robotic Creativity Driven by Motivation and Semantic Analysis},
author = { Agnese Augello and Ignazio Infantino and Giovanni Pilato and Riccardo Rizzo and Filippo Vella},
doi = {10.1109/ICSC.2014.58},
isbn = {978-1-4799-4002-8},
year = {2014},
date = {2014-01-01},
booktitle = {Proceedings - 2014 IEEE International Conference on Semantic Computing, ICSC 2014},
pages = {285--289},
publisher = {IEEE Computer Society},
abstract = {The paper proposes a system architecture for artificial creativity that enables a robot to perform portraits. The proposed cognitive architecture is inspired by the PSI model, and it requires that the motivation of the robot in the execution of its tasks is influenced by urges. Such parameters depend on both internal and external evaluation mechanisms. The system is a premise for the development of an artificial artist able to develop a personality and a behavior that depends on its experience of successes and failures (competence), and the availability of different painting techniques (certainty). The creative execution is driven by the motivation arising from the urges, and the perception of the work being executed or performed. The external evaluation is obtained by analyzing the opinions expressed in natural language from people watching the realized portrait. textcopyright 2014 IEEE.},
keywords = {Artificial intelligence, Chatbots, Cognitive Architectures, Computational Creativity, Creative Agents, Motivation, Natural Language Processing, PSI, Semantic Computing, Social Robots},
pubstate = {published},
tppubtype = {inproceedings}
}
The paper proposes a system architecture for artificial creativity that enables a robot to perform portraits. The proposed cognitive architecture is inspired by the PSI model, and it requires that the motivation of the robot in the execution of its tasks is influenced by urges. Such parameters depend on both internal and external evaluation mechanisms. The system is a premise for the development of an artificial artist able to develop a personality and a behavior that depends on its experience of successes and failures (competence), and the availability of different painting techniques (certainty). The creative execution is driven by the motivation arising from the urges, and the perception of the work being executed or performed. The external evaluation is obtained by analyzing the opinions expressed in natural language from people watching the realized portrait. textcopyright 2014 IEEE.