AHCI RESEARCH GROUP

Publications

Papers published in international journals,
proceedings of conferences, workshops and books.

OUR RESEARCH

Scientific Publications

How to

Here you can find the complete list of our publications.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.

Show all

2024

Clocchiatti, A.; Fumero, N.; Soccini, A. M.

Character Animation Pipeline based on Latent Diffusion and Large Language Models Proceedings Article

In: Proc. - IEEE Int. Conf. Artif. Intell. Ext. Virtual Real., AIxVR, pp. 398–405, Institute of Electrical and Electronics Engineers Inc., 2024, ISBN: 979-835037202-1 (ISBN).

Abstract | Links | BibTeX | Tags: Animation, Animation pipeline, Artificial intelligence, Augmented Reality, Character animation, Computational Linguistics, Computer animation, Deep learning, Diffusion, E-Learning, Extended reality, Film production, Generative art, Language Model, Learning systems, Learning techniques, Natural language processing systems, Pipelines, Production pipelines, Virtual Reality

@inproceedings{clocchiatti_character_2024,

title = {Character Animation Pipeline based on Latent Diffusion and Large Language Models},

author = {A. Clocchiatti and N. Fumero and A. M. Soccini},

url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85187217072&doi=10.1109%2fAIxVR59861.2024.00067&partnerID=40&md5=d88b9ba7c80d49b60fd0d7acd5e7c4f0},

doi = {10.1109/AIxVR59861.2024.00067},

isbn = {979-835037202-1 (ISBN)},

year  = {2024},

date = {2024-01-01},

booktitle = {Proc. - IEEE Int. Conf. Artif. Intell. Ext. Virtual Real., AIxVR},

pages = {398–405},

publisher = {Institute of Electrical and Electronics Engineers Inc.},

abstract = {Artificial intelligence and deep learning techniques are revolutionizing the film production pipeline. The majority of the current screenplay-to-animation pipelines focus on understanding the screenplay through natural language processing techniques, and on the generation of the animation through custom engines, missing the possibility to customize the characters. To address these issues, we propose a high-level pipeline for generating 2D characters and animations starting from screenplays, through a combination of Latent Diffusion Models and Large Language Models. Our approach uses ChatGPT to generate character descriptions starting from the screenplay. Then, using that data, it generates images of custom characters with Stable Diffusion and animates them according to their actions in different scenes. The proposed approach avoids well-known problems in generative AI tools such as temporal inconsistency and lack of control on the outcome. The results suggest that the pipeline is consistent and reliable, benefiting industries ranging from film production to virtual, augmented and extended reality content creation. © 2024 IEEE.},

keywords = {Animation, Animation pipeline, Artificial intelligence, Augmented Reality, Character animation, Computational Linguistics, Computer animation, Deep learning, Diffusion, E-Learning, Extended reality, Film production, Generative art, Language Model, Learning systems, Learning techniques, Natural language processing systems, Pipelines, Production pipelines, Virtual Reality},

pubstate = {published},

tppubtype = {inproceedings}

}

Cheng, M.; Yu, Z.; Dang, X.

Landscape Illusions: An AI and AR Powered Journey from Nature to Imagined Futures Proceedings Article

In: ACM Int. Conf. Proc. Ser., pp. 603–607, Association for Computing Machinery, 2024, ISBN: 978-145038376-9 (ISBN).

Abstract | Links | BibTeX | Tags: Artificial intelligence, Artificial Intelligence Art, Augmented Reality, Augmented Reality Art, Augmented reality arts, Chinese Landscape Painting, Climate Change, Coexistence, Generative art, Human perception, Landscape & Nature, Natural world, Speculative Future, Traverse time

@inproceedings{cheng_landscape_2024,

title = {Landscape Illusions: An AI and AR Powered Journey from Nature to Imagined Futures},

author = {M. Cheng and Z. Yu and X. Dang},

url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85197887048&doi=10.1145%2f3635636.3660500&partnerID=40&md5=eb8ac2b5fc35828e117a1111dbe05428},

doi = {10.1145/3635636.3660500},

isbn = {978-145038376-9 (ISBN)},

year  = {2024},

date = {2024-01-01},

booktitle = {ACM Int. Conf. Proc. Ser.},

pages = {603–607},

publisher = {Association for Computing Machinery},

abstract = {"Landscape Illusions"ventures into the realm where human perception intertwines with the natural world, unveiling a series of AR-infused Chinese landscape painting scrolls with animated experience. This collaboration between artists and generative AI crafts a dialogue that traverses time and space, merging the ancient allure of nature with the innovative pulse of digital creativity. The collection, comprising "Metropolis Veins,""Rising Tides,""Symbiotic Horizons,"and "Stellar Reflections,"acts as a mirror reflecting various environmental and societal themes. It invites viewers to engage deeply with the artwork, challenging them to rethink their relationship with the environment around them. This series is a reflection on the complex narratives nature weaves, marrying the serene beauty of traditional landscapes with the inventive power of AI and the immersive experience of AR technology. "Landscape Illusions"prompts critical discussions about nature's role in our lives and the impact we have on it, making it a poignant commentary on contemporary environmental issues and inspiring a reimagined vision for our collective future. © 2024 Owner/Author.},

keywords = {Artificial intelligence, Artificial Intelligence Art, Augmented Reality, Augmented Reality Art, Augmented reality arts, Chinese Landscape Painting, Climate Change, Coexistence, Generative art, Human perception, Landscape & Nature, Natural world, Speculative Future, Traverse time},

pubstate = {published},

tppubtype = {inproceedings}

}