AHCI RESEARCH GROUP
Publications
Papers published in international journals,
proceedings of conferences, workshops and books.
OUR RESEARCH
Scientific Publications
How to
Here you can find the complete list of our publications.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
2009
Gambino, Orazio; Augello, Agnese; Caronia, Alessandro; Pilato, Giovanni; Pirrone, Roberto; Gaglio, Salvatore
A Web-Oriented Java 3D Talking Head Journal Article
In: Advances in Intelligent and Soft Computing, vol. 60, pp. 295–311, 2009, ISSN: 18675662.
Abstract | Links | BibTeX | Tags: 3D Modelling, Animation, Human computer interaction, Natural Language Processing
@article{gambinoWeborientedJava3D2009,
title = {A Web-Oriented Java 3D Talking Head},
author = { Orazio Gambino and Agnese Augello and Alessandro Caronia and Giovanni Pilato and Roberto Pirrone and Salvatore Gaglio},
editor = { Kulikowski J.L. Hippe Z.S.},
doi = {10.1007/978-3-642-03202-8_24},
issn = {18675662},
year = {2009},
date = {2009-01-01},
journal = {Advances in Intelligent and Soft Computing},
volume = {60},
pages = {295--311},
abstract = {Facial animation denotes all those systems performing speech synchronization with an animated face model. These kinds of systems are named Talking Heads or Talking Faces. At the same time simple dialogue systems called chatbots have been developed. Chatbots are software agents able to interact with users through pattern-matching based rules. In this paper a Talking Head oriented to the creation of a Chatbot is presented. An answer is generated in form of text triggered by an input query. The answer is converted into a facial animation using a 3D face model whose lips movements are synchronized with the sound produced by a speech synthesis module. Our Talking Head exploits the naturalness of the facial animation and provides a real-time interactive interface to the user. Besides, it is specifically suited for being used on the web. This leads to a set of requirements to be satisfied, like: simple installation, visual quality, fast download, and interactivity in real time. The web infrastructure has been realized using the Client-Server model. The Chatbot, the Natural Language Processing and the Digital Signal Processing services are delegated to the server. The client is involved in animation and synchronization. This way, the server can handle multiple requests from clients. The conversation module has been implemented using the A.L.I.C.E. (Artificial Linguistic Internet Computer Entity) technology. The output of the chatbot is given input to the Natural Language Processing (Comedia Speech), incorporating a text analyzer, a letter-to-sound module and a module for the generation of prosody. The client, through the synchronization module, computes the time of real duration of the animation and the duration of each phoneme and consequently of each viseme. The morphing module performs the animation of the facial model and the voice reproduction. As a result, the user will see the answer to question both in textual form and in the form of visual animation. textcopyright Springer-Verlag Berlin Heidelberg 2009.},
keywords = {3D Modelling, Animation, Human computer interaction, Natural Language Processing},
pubstate = {published},
tppubtype = {article}
}
Facial animation denotes all those systems performing speech synchronization with an animated face model. These kinds of systems are named Talking Heads or Talking Faces. At the same time simple dialogue systems called chatbots have been developed. Chatbots are software agents able to interact with users through pattern-matching based rules. In this paper a Talking Head oriented to the creation of a Chatbot is presented. An answer is generated in form of text triggered by an input query. The answer is converted into a facial animation using a 3D face model whose lips movements are synchronized with the sound produced by a speech synthesis module. Our Talking Head exploits the naturalness of the facial animation and provides a real-time interactive interface to the user. Besides, it is specifically suited for being used on the web. This leads to a set of requirements to be satisfied, like: simple installation, visual quality, fast download, and interactivity in real time. The web infrastructure has been realized using the Client-Server model. The Chatbot, the Natural Language Processing and the Digital Signal Processing services are delegated to the server. The client is involved in animation and synchronization. This way, the server can handle multiple requests from clients. The conversation module has been implemented using the A.L.I.C.E. (Artificial Linguistic Internet Computer Entity) technology. The output of the chatbot is given input to the Natural Language Processing (Comedia Speech), incorporating a text analyzer, a letter-to-sound module and a module for the generation of prosody. The client, through the synchronization module, computes the time of real duration of the animation and the duration of each phoneme and consequently of each viseme. The morphing module performs the animation of the facial model and the voice reproduction. As a result, the user will see the answer to question both in textual form and in the form of visual animation. textcopyright Springer-Verlag Berlin Heidelberg 2009.
Gambino, Orazio; Augello, Agnese; Caronia, Alessandro; Pilato, Giovanni; Pirrone, Roberto; Gaglio, Salvatore
A web-oriented java 3D talking head Journal Article
In: Advances in Intelligent and Soft Computing, vol. 60, pp. 295–311, 2009, ISSN: 18675662.
Abstract | Links | BibTeX | Tags: 3D Modelling, Animation, Human computer interaction, Natural Language Processing
@article{gambino_web-oriented_2009,
title = {A web-oriented java 3D talking head},
author = {Orazio Gambino and Agnese Augello and Alessandro Caronia and Giovanni Pilato and Roberto Pirrone and Salvatore Gaglio},
editor = {Kulikowski J. L. Hippe Z.S.},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-84994752280&doi=10.1007%2f978-3-642-03202-8_24&partnerID=40&md5=1ff9a3013619a32fc37ca7dbbe5cf66a},
doi = {10.1007/978-3-642-03202-8_24},
issn = {18675662},
year = {2009},
date = {2009-01-01},
journal = {Advances in Intelligent and Soft Computing},
volume = {60},
pages = {295–311},
abstract = {Facial animation denotes all those systems performing speech synchronization with an animated face model. These kinds of systems are named Talking Heads or Talking Faces. At the same time simple dialogue systems called chatbots have been developed. Chatbots are software agents able to interact with users through pattern-matching based rules. In this paper a Talking Head oriented to the creation of a Chatbot is presented. An answer is generated in form of text triggered by an input query. The answer is converted into a facial animation using a 3D face model whose lips movements are synchronized with the sound produced by a speech synthesis module. Our Talking Head exploits the naturalness of the facial animation and provides a real-time interactive interface to the user. Besides, it is specifically suited for being used on the web. This leads to a set of requirements to be satisfied, like: simple installation, visual quality, fast download, and interactivity in real time. The web infrastructure has been realized using the Client-Server model. The Chatbot, the Natural Language Processing and the Digital Signal Processing services are delegated to the server. The client is involved in animation and synchronization. This way, the server can handle multiple requests from clients. The conversation module has been implemented using the A.L.I.C.E. (Artificial Linguistic Internet Computer Entity) technology. The output of the chatbot is given input to the Natural Language Processing (Comedia Speech), incorporating a text analyzer, a letter-to-sound module and a module for the generation of prosody. The client, through the synchronization module, computes the time of real duration of the animation and the duration of each phoneme and consequently of each viseme. The morphing module performs the animation of the facial model and the voice reproduction. As a result, the user will see the answer to question both in textual form and in the form of visual animation. © Springer-Verlag Berlin Heidelberg 2009.},
keywords = {3D Modelling, Animation, Human computer interaction, Natural Language Processing},
pubstate = {published},
tppubtype = {article}
}
Facial animation denotes all those systems performing speech synchronization with an animated face model. These kinds of systems are named Talking Heads or Talking Faces. At the same time simple dialogue systems called chatbots have been developed. Chatbots are software agents able to interact with users through pattern-matching based rules. In this paper a Talking Head oriented to the creation of a Chatbot is presented. An answer is generated in form of text triggered by an input query. The answer is converted into a facial animation using a 3D face model whose lips movements are synchronized with the sound produced by a speech synthesis module. Our Talking Head exploits the naturalness of the facial animation and provides a real-time interactive interface to the user. Besides, it is specifically suited for being used on the web. This leads to a set of requirements to be satisfied, like: simple installation, visual quality, fast download, and interactivity in real time. The web infrastructure has been realized using the Client-Server model. The Chatbot, the Natural Language Processing and the Digital Signal Processing services are delegated to the server. The client is involved in animation and synchronization. This way, the server can handle multiple requests from clients. The conversation module has been implemented using the A.L.I.C.E. (Artificial Linguistic Internet Computer Entity) technology. The output of the chatbot is given input to the Natural Language Processing (Comedia Speech), incorporating a text analyzer, a letter-to-sound module and a module for the generation of prosody. The client, through the synchronization module, computes the time of real duration of the animation and the duration of each phoneme and consequently of each viseme. The morphing module performs the animation of the facial model and the voice reproduction. As a result, the user will see the answer to question both in textual form and in the form of visual animation. © Springer-Verlag Berlin Heidelberg 2009.
2008
Gaglio, Salvatore; Pilato, Giovanni; Pirrone, Roberto; Gambino, Orazio; Augello, Agnese; Caronia, Alessandro
A Java3D Talking Head for a Chatbot Proceedings Article
In: Proceedings - CISIS 2008: 2nd International Conference on Complex, Intelligent and Software Intensive Systems, pp. 709–714, 2008, ISBN: 0-7695-3109-1 978-0-7695-3109-0.
Abstract | Links | BibTeX | Tags: 3D Modelling, Animation, Artificial intelligence, Human computer interaction, Talking Heads
@inproceedings{gaglioJava3DTalkingHead2008,
title = {A Java3D Talking Head for a Chatbot},
author = { Salvatore Gaglio and Giovanni Pilato and Roberto Pirrone and Orazio Gambino and Agnese Augello and Alessandro Caronia},
doi = {10.1109/CISIS.2008.57},
isbn = {0-7695-3109-1 978-0-7695-3109-0},
year = {2008},
date = {2008-01-01},
booktitle = {Proceedings - CISIS 2008: 2nd International Conference on Complex, Intelligent and Software Intensive Systems},
pages = {709--714},
abstract = {Facial animation is referred to all those systems performing the speech synchronization with an animated face model. This kind of systems are called "Talking Head" or "Talking Face". In this paper a Talking Head oriented to the creation of a Chatbot is presented. It requires an input query and an answer is generated in form of text. The answer is transduced into a facial animation using a 3D face model whose lips movements are synchronized with the sound produced by a speech synthesis module. Our "Talking Head" explores the naturalness of the facial animation and provides a real-time interactive interface to the user. The WEB infrastructure has been realized using the Client-Server model delegating the Chatbot, the Natural Language Processing and the Digital Signal Processing services to the server, while the client is involved in animation, synchronization; in this way, the server can handle multiple requests from clients. textcopyright 2008 IEEE.},
keywords = {3D Modelling, Animation, Artificial intelligence, Human computer interaction, Talking Heads},
pubstate = {published},
tppubtype = {inproceedings}
}
Facial animation is referred to all those systems performing the speech synchronization with an animated face model. This kind of systems are called "Talking Head" or "Talking Face". In this paper a Talking Head oriented to the creation of a Chatbot is presented. It requires an input query and an answer is generated in form of text. The answer is transduced into a facial animation using a 3D face model whose lips movements are synchronized with the sound produced by a speech synthesis module. Our "Talking Head" explores the naturalness of the facial animation and provides a real-time interactive interface to the user. The WEB infrastructure has been realized using the Client-Server model delegating the Chatbot, the Natural Language Processing and the Digital Signal Processing services to the server, while the client is involved in animation, synchronization; in this way, the server can handle multiple requests from clients. textcopyright 2008 IEEE.
Gambino, Orazio; Augello, Agnese; Caronia, Alessandro; Pilato, Giovanni; Pirrone, Roberto; Gaglio, Salvatore
Virtual Conversation with a Real Talking Head Proceedings Article
In: 2008 Conference on Human System Interaction, HSI 2008, pp. 263–268, 2008, ISBN: 1-4244-1543-8 978-1-4244-1543-4.
Abstract | Links | BibTeX | Tags: 3D Modelling, Animation, Artificial intelligence, Computational Linguistics, Conversational Agents, Human computer interaction, Natural Language Processing, Talking Heads
@inproceedings{gambinoVirtualConversationReal2008,
title = {Virtual Conversation with a Real Talking Head},
author = { Orazio Gambino and Agnese Augello and Alessandro Caronia and Giovanni Pilato and Roberto Pirrone and Salvatore Gaglio},
doi = {10.1109/HSI.2008.4581446},
isbn = {1-4244-1543-8 978-1-4244-1543-4},
year = {2008},
date = {2008-01-01},
booktitle = {2008 Conference on Human System Interaction, HSI 2008},
pages = {263--268},
abstract = {A talking head is system performing an animated face model synchronized with a speech synthesis module. It is used as a presentation layer of a conversational Agent which provide an answer . It provides an answer when a query is written as an input by the user. The textual answer is converted into facial movements of a 3D face model whose lips and tongue movements are synchronized with the sound of the synthetic voice. The Client-Server paradigm has been used for the WEB infrastructure delegating the animation and synchronization to the client, so that the server can satisfy multiple requests from clients; while the Chatbot, the Digital Signal Processing and the Natural language Processing are provided by the server. textcopyright 2008 IEEE.},
keywords = {3D Modelling, Animation, Artificial intelligence, Computational Linguistics, Conversational Agents, Human computer interaction, Natural Language Processing, Talking Heads},
pubstate = {published},
tppubtype = {inproceedings}
}
A talking head is system performing an animated face model synchronized with a speech synthesis module. It is used as a presentation layer of a conversational Agent which provide an answer . It provides an answer when a query is written as an input by the user. The textual answer is converted into facial movements of a 3D face model whose lips and tongue movements are synchronized with the sound of the synthetic voice. The Client-Server paradigm has been used for the WEB infrastructure delegating the animation and synchronization to the client, so that the server can satisfy multiple requests from clients; while the Chatbot, the Digital Signal Processing and the Natural language Processing are provided by the server. textcopyright 2008 IEEE.
Gambino, Orazio; Augello, Agnese; Caronia, Alessandro; Pilato, Giovanni; Pirrone, Roberto; Gaglio, Salvatore
Virtual conversation with a real talking head Proceedings Article
In: 2008 Conference on Human System Interaction, HSI 2008, pp. 263–268, 2008, ISBN: 1-4244-1543-8 978-1-4244-1543-4.
Abstract | Links | BibTeX | Tags: 3D Modelling, Animation, Artificial intelligence, Computational Linguistics, Conversational Agents, Human computer interaction, Natural Language Processing, Talking Heads
@inproceedings{gambino_virtual_2008,
title = {Virtual conversation with a real talking head},
author = {Orazio Gambino and Agnese Augello and Alessandro Caronia and Giovanni Pilato and Roberto Pirrone and Salvatore Gaglio},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-52149107110&doi=10.1109%2fHSI.2008.4581446&partnerID=40&md5=2ecaaf7a50db7564a6fa4e5b1e1da73e},
doi = {10.1109/HSI.2008.4581446},
isbn = {1-4244-1543-8 978-1-4244-1543-4},
year = {2008},
date = {2008-01-01},
booktitle = {2008 Conference on Human System Interaction, HSI 2008},
pages = {263–268},
abstract = {A talking head is system performing an animated face model synchronized with a speech synthesis module. It is used as a presentation layer of a conversational Agent which provide an answer . It provides an answer when a query is written as an input by the user. The textual answer is converted into facial movements of a 3D face model whose lips and tongue movements are synchronized with the sound of the synthetic voice. The Client-Server paradigm has been used for the WEB infrastructure delegating the animation and synchronization to the client, so that the server can satisfy multiple requests from clients; while the Chatbot, the Digital Signal Processing and the Natural language Processing are provided by the server. ©2008 IEEE.},
keywords = {3D Modelling, Animation, Artificial intelligence, Computational Linguistics, Conversational Agents, Human computer interaction, Natural Language Processing, Talking Heads},
pubstate = {published},
tppubtype = {inproceedings}
}
A talking head is system performing an animated face model synchronized with a speech synthesis module. It is used as a presentation layer of a conversational Agent which provide an answer . It provides an answer when a query is written as an input by the user. The textual answer is converted into facial movements of a 3D face model whose lips and tongue movements are synchronized with the sound of the synthetic voice. The Client-Server paradigm has been used for the WEB infrastructure delegating the animation and synchronization to the client, so that the server can satisfy multiple requests from clients; while the Chatbot, the Digital Signal Processing and the Natural language Processing are provided by the server. ©2008 IEEE.
Gaglio, Salvatore; Pilato, Giovanni; Pirrone, Roberto; Gambino, Orazio; Augello, Agnese; Caronia, Alessandro
A Java3D Talking Head for a Chatbot Proceedings Article
In: Proceedings - CISIS 2008: 2nd International Conference on Complex, Intelligent and Software Intensive Systems, pp. 709–714, 2008, ISBN: 0-7695-3109-1 978-0-7695-3109-0.
Abstract | Links | BibTeX | Tags: 3D Modelling, Animation, Artificial intelligence, Human computer interaction, Talking Heads
@inproceedings{gaglio_java3d_2008,
title = {A Java3D Talking Head for a Chatbot},
author = {Salvatore Gaglio and Giovanni Pilato and Roberto Pirrone and Orazio Gambino and Agnese Augello and Alessandro Caronia},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-54749105850&doi=10.1109%2fCISIS.2008.57&partnerID=40&md5=6fa3ebbb7631bb6a0acdff3820f29546},
doi = {10.1109/CISIS.2008.57},
isbn = {0-7695-3109-1 978-0-7695-3109-0},
year = {2008},
date = {2008-01-01},
booktitle = {Proceedings - CISIS 2008: 2nd International Conference on Complex, Intelligent and Software Intensive Systems},
pages = {709–714},
abstract = {Facial animation is referred to all those systems performing the speech synchronization with an animated face model. This kind of systems are called "Talking Head" or "Talking Face". In this paper a Talking Head oriented to the creation of a Chatbot is presented. It requires an input query and an answer is generated in form of text. The answer is transduced into a facial animation using a 3D face model whose lips movements are synchronized with the sound produced by a speech synthesis module. Our "Talking Head" explores the naturalness of the facial animation and provides a real-time interactive interface to the user. The WEB infrastructure has been realized using the Client-Server model delegating the Chatbot, the Natural Language Processing and the Digital Signal Processing services to the server, while the client is involved in animation, synchronization; in this way, the server can handle multiple requests from clients. © 2008 IEEE.},
keywords = {3D Modelling, Animation, Artificial intelligence, Human computer interaction, Talking Heads},
pubstate = {published},
tppubtype = {inproceedings}
}
Facial animation is referred to all those systems performing the speech synchronization with an animated face model. This kind of systems are called "Talking Head" or "Talking Face". In this paper a Talking Head oriented to the creation of a Chatbot is presented. It requires an input query and an answer is generated in form of text. The answer is transduced into a facial animation using a 3D face model whose lips movements are synchronized with the sound produced by a speech synthesis module. Our "Talking Head" explores the naturalness of the facial animation and provides a real-time interactive interface to the user. The WEB infrastructure has been realized using the Client-Server model delegating the Chatbot, the Natural Language Processing and the Digital Signal Processing services to the server, while the client is involved in animation, synchronization; in this way, the server can handle multiple requests from clients. © 2008 IEEE.