AHCI RESEARCH GROUP
Publications
Papers published in international journals,
proceedings of conferences, workshops and books.
OUR RESEARCH
Scientific Publications
How to
Here you can find the complete list of our publications.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
You can use the tag cloud to select only the papers dealing with specific research topics.
You can expand the Abstract, Links and BibTex record for each paper.
2025
Li, C.; Da, F.
Refined dense face alignment through image matching Journal Article
In: Visual Computer, vol. 41, no. 1, pp. 157–171, 2025, ISSN: 01782789 (ISSN).
Abstract | Links | BibTeX | Tags: 3D Avatars, Alignment, Dense geometric supervision, Face alignment, Face deformations, Face reconstruction, Geometry, Human computer interaction, Image enhancement, Image matching, Image Reconstruction, Metaverses, Outlier mixup, Pixels, Rendered images, Rendering (computer graphics), State of the art, Statistics, Target images, Three dimensional computer graphics
@article{li_refined_2025,
title = {Refined dense face alignment through image matching},
author = {C. Li and F. Da},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85187924785&doi=10.1007%2fs00371-024-03316-3&partnerID=40&md5=839834c6ff3320398d5ef75b055947cb},
doi = {10.1007/s00371-024-03316-3},
issn = {01782789 (ISSN)},
year = {2025},
date = {2025-01-01},
journal = {Visual Computer},
volume = {41},
number = {1},
pages = {157–171},
abstract = {Face alignment is the foundation of building 3D avatars for virtue communication in the metaverse, human-computer interaction, AI-generated content, etc., and therefore, it is critical that face deformation is reflected precisely to better convey expression, pose and identity. However, misalignment exists in the currently best methods that fit a face model to a target image and can be easily captured by human perception, thus degrading the reconstruction quality. The main reason is that the widely used metrics for training, including the landmark re-projection loss, pixel-wise loss and perception-level loss, are insufficient to address the misalignment and suffer from ambiguity and local minimums. To address misalignment, we propose an image MAtchinG-driveN dEnse geomeTrIC supervision (MAGNETIC). Specifically, we treat face alignment as a matching problem and establish pixel-wise correspondences between the target and rendered images. Then reconstructed facial points are guided towards their corresponding points on the target image, thus improving reconstruction. Synthesized image pairs are mixed up with face outliers to simulate the target and rendered images with ground-truth pixel-wise correspondences to enable the training of a robust prediction network. Compared with existing methods that turn to 3D scans for dense geometric supervision, our method reaches comparable shape reconstruction results with much lower effort. Experimental results on the NoW testset show that we reach the state-of-the-art among all self-supervised methods and even outperform methods using photo-realistic images. We also achieve comparable results with the state-of-the-art on the benchmark of Feng et al. Codes will be available at: github.com/ChunLLee/ReconstructionFromMatching. © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2024.},
keywords = {3D Avatars, Alignment, Dense geometric supervision, Face alignment, Face deformations, Face reconstruction, Geometry, Human computer interaction, Image enhancement, Image matching, Image Reconstruction, Metaverses, Outlier mixup, Pixels, Rendered images, Rendering (computer graphics), State of the art, Statistics, Target images, Three dimensional computer graphics},
pubstate = {published},
tppubtype = {article}
}
Face alignment is the foundation of building 3D avatars for virtue communication in the metaverse, human-computer interaction, AI-generated content, etc., and therefore, it is critical that face deformation is reflected precisely to better convey expression, pose and identity. However, misalignment exists in the currently best methods that fit a face model to a target image and can be easily captured by human perception, thus degrading the reconstruction quality. The main reason is that the widely used metrics for training, including the landmark re-projection loss, pixel-wise loss and perception-level loss, are insufficient to address the misalignment and suffer from ambiguity and local minimums. To address misalignment, we propose an image MAtchinG-driveN dEnse geomeTrIC supervision (MAGNETIC). Specifically, we treat face alignment as a matching problem and establish pixel-wise correspondences between the target and rendered images. Then reconstructed facial points are guided towards their corresponding points on the target image, thus improving reconstruction. Synthesized image pairs are mixed up with face outliers to simulate the target and rendered images with ground-truth pixel-wise correspondences to enable the training of a robust prediction network. Compared with existing methods that turn to 3D scans for dense geometric supervision, our method reaches comparable shape reconstruction results with much lower effort. Experimental results on the NoW testset show that we reach the state-of-the-art among all self-supervised methods and even outperform methods using photo-realistic images. We also achieve comparable results with the state-of-the-art on the benchmark of Feng et al. Codes will be available at: github.com/ChunLLee/ReconstructionFromMatching. © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2024.
2023
Wang, Z.; Joshi, A.; Zhang, G.; Ren, W.; Jia, F.; Sun, X.
Elevating Perception: Unified Recognition Framework and Vision-Language Pre-Training Using Three-Dimensional Image Reconstruction Proceedings Article
In: Proc. - Int. Conf. Artif. Intell., Human-Comput. Interact. Robot., AIHCIR, pp. 592–596, Institute of Electrical and Electronics Engineers Inc., 2023, ISBN: 979-835036036-3 (ISBN).
Abstract | Links | BibTeX | Tags: 3D Model LLM, 3D modeling, 3D models, 3D Tech, 3d-modeling, Augmented Reality, Character recognition, Component, Computer aided design, Computer vision, Continuous time systems, Data handling, Generative AI, Image enhancement, Image Reconstruction, Image to Text Generation, Medical Imaging, Pattern recognition, Pre-training, Reconstructive Training, Text generations, Three dimensional computer graphics, Virtual Reality
@inproceedings{wang_elevating_2023,
title = {Elevating Perception: Unified Recognition Framework and Vision-Language Pre-Training Using Three-Dimensional Image Reconstruction},
author = {Z. Wang and A. Joshi and G. Zhang and W. Ren and F. Jia and X. Sun},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85192837757&doi=10.1109%2fAIHCIR61661.2023.00105&partnerID=40&md5=0fe17cc622a9aa90e88b8c3e6a3bed3b},
doi = {10.1109/AIHCIR61661.2023.00105},
isbn = {979-835036036-3 (ISBN)},
year = {2023},
date = {2023-01-01},
booktitle = {Proc. - Int. Conf. Artif. Intell., Human-Comput. Interact. Robot., AIHCIR},
pages = {592–596},
publisher = {Institute of Electrical and Electronics Engineers Inc.},
abstract = {This research project explores a paradigm shift in perceptual enhancement by integrating a Unified Recognition Framework and Vision-Language Pre-Training in three-dimensional image reconstruction. Through the synergy of advanced algorithms from computer vision & language processing, the project tries to enhance the precision and depth of perception in reconstructed images. This innovative approach holds the potential to revolutionize fields such as medical imaging, virtual reality, and computer-aided design, providing a comprehensive perspective on the intersection of multimodal data processing and perceptual advancement. The anticipated research outcomes are expected to significantly contribute to the evolution of technologies that rely on accurate and contextually rich three-dimensional reconstructions. Moreover, the research aims to reduce the constant need for new datasets by improving pattern recognition through 3D image patterning on backpropagation. This continuous improvement of vectors is envisioned to enhance the efficiency and accuracy of pattern recognition, contributing to the optimization of perceptual systems over time. © 2023 IEEE.},
keywords = {3D Model LLM, 3D modeling, 3D models, 3D Tech, 3d-modeling, Augmented Reality, Character recognition, Component, Computer aided design, Computer vision, Continuous time systems, Data handling, Generative AI, Image enhancement, Image Reconstruction, Image to Text Generation, Medical Imaging, Pattern recognition, Pre-training, Reconstructive Training, Text generations, Three dimensional computer graphics, Virtual Reality},
pubstate = {published},
tppubtype = {inproceedings}
}
This research project explores a paradigm shift in perceptual enhancement by integrating a Unified Recognition Framework and Vision-Language Pre-Training in three-dimensional image reconstruction. Through the synergy of advanced algorithms from computer vision & language processing, the project tries to enhance the precision and depth of perception in reconstructed images. This innovative approach holds the potential to revolutionize fields such as medical imaging, virtual reality, and computer-aided design, providing a comprehensive perspective on the intersection of multimodal data processing and perceptual advancement. The anticipated research outcomes are expected to significantly contribute to the evolution of technologies that rely on accurate and contextually rich three-dimensional reconstructions. Moreover, the research aims to reduce the constant need for new datasets by improving pattern recognition through 3D image patterning on backpropagation. This continuous improvement of vectors is envisioned to enhance the efficiency and accuracy of pattern recognition, contributing to the optimization of perceptual systems over time. © 2023 IEEE.
2020
Scianna, Andrea; Gaglio, Giuseppe Fulvio; Guardia, Marcello La
DIGITAL PHOTOGRAMMETRY, TLS SURVEY and 3D MODELLING for VR and AR APPLICATIONS in CH Proceedings Article
In: N., Mallet C. Lafarge F. Remondino F. Toschi I. Fuse T. Paparoditis (Ed.): International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, pp. 901–909, International Society for Photogrammetry and Remote Sensing, 2020.
Abstract | Links | BibTeX | Tags: 3D Modelling, Augmented Reality, Digital Photogrammetry, Image Reconstruction, Terrestrial Laser Scanners, Unmanned Aerial Vehicles, Virtual Reality
@inproceedings{sciannaDIGITALPHOTOGRAMMETRYTLS2020a,
title = {DIGITAL PHOTOGRAMMETRY, TLS SURVEY and 3D MODELLING for VR and AR APPLICATIONS in CH},
author = { Andrea Scianna and Giuseppe Fulvio Gaglio and Marcello La Guardia},
editor = { Mallet C. Lafarge F. Remondino F. Toschi I. Fuse T. Paparoditis N.},
doi = {10.5194/isprs-archives-XLIII-B2-2020-901-2020},
year = {2020},
date = {2020-01-01},
booktitle = {International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives},
volume = {43},
pages = {901--909},
publisher = {International Society for Photogrammetry and Remote Sensing},
abstract = {The world of valorization of Cultural Heritage is even more focused on the virtual representation and reconstructions of digital 3D models of monuments and archaeological sites. In this scenario the quality and the performances offered by the virtual reality (VR) and augmented reality (AR) navigation take primary importance, improving the accessibility of cultural sites where the real access is not allowed for natural conditions or human possibilities. The creation of a virtual environment useful for these purposes requires a specific workflow to follow, combining different strategies in the fields of survey, 3D modelling and virtual navigation. In this work a specific case of study has been analyzed as a practical example, the church of ^gtexteuro San Giorgio dei Genovesi', settled in the Historic Centre of Palermo (Italy). The acquisition of geometric information has been obtained with the integration of Terrestrial Laser Scanner (TLS) technologies and the photogrammetric reconstruction from mini Unmanned Aerial Vehicle (UAV) equipment. The obtained point cloud has been georeferred considering a network of Ground Control Points (GCP) acquired by a Global Navigation Satellite System (GNSS) receiver. The final point cloud has been processed and properly simplified through 3D modelling procedures, to obtain a realistic and light 3D model reconstruction. The model has hence employed into a VR WEB navigation system and will be used for AR outdoor application in the future, allowing to obtain different solutions for empowering the accessibility of the cultural good. The strategy of 3D CH model reconstruction, followed in this work, could be considered a reference methodology for the development of VR gaming applications finalized to CH valorization and AR applications, applied to museums or touristic paths in historical centres. textcopyright 2020 International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives.},
keywords = {3D Modelling, Augmented Reality, Digital Photogrammetry, Image Reconstruction, Terrestrial Laser Scanners, Unmanned Aerial Vehicles, Virtual Reality},
pubstate = {published},
tppubtype = {inproceedings}
}
The world of valorization of Cultural Heritage is even more focused on the virtual representation and reconstructions of digital 3D models of monuments and archaeological sites. In this scenario the quality and the performances offered by the virtual reality (VR) and augmented reality (AR) navigation take primary importance, improving the accessibility of cultural sites where the real access is not allowed for natural conditions or human possibilities. The creation of a virtual environment useful for these purposes requires a specific workflow to follow, combining different strategies in the fields of survey, 3D modelling and virtual navigation. In this work a specific case of study has been analyzed as a practical example, the church of ^gtexteuro San Giorgio dei Genovesi', settled in the Historic Centre of Palermo (Italy). The acquisition of geometric information has been obtained with the integration of Terrestrial Laser Scanner (TLS) technologies and the photogrammetric reconstruction from mini Unmanned Aerial Vehicle (UAV) equipment. The obtained point cloud has been georeferred considering a network of Ground Control Points (GCP) acquired by a Global Navigation Satellite System (GNSS) receiver. The final point cloud has been processed and properly simplified through 3D modelling procedures, to obtain a realistic and light 3D model reconstruction. The model has hence employed into a VR WEB navigation system and will be used for AR outdoor application in the future, allowing to obtain different solutions for empowering the accessibility of the cultural good. The strategy of 3D CH model reconstruction, followed in this work, could be considered a reference methodology for the development of VR gaming applications finalized to CH valorization and AR applications, applied to museums or touristic paths in historical centres. textcopyright 2020 International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives.
Scianna, Andrea; Gaglio, Giuseppe Fulvio; Guardia, Marcello La
DIGITAL PHOTOGRAMMETRY, TLS SURVEY and 3D MODELLING for VR and AR APPLICATIONS in CH Proceedings Article
In: N., Lafarge F. Mallet C. Paparoditis (Ed.): International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, pp. 901–909, International Society for Photogrammetry and Remote Sensing, 2020, (Issue: B2).
Abstract | Links | BibTeX | Tags: 3D model reconstruction, 3D modeling, 3D Modelling, Antennas, Augmented Reality, Digital Photogrammetry, Geometric information, Global Navigation Satellite Systems, Global positioning system, Ground control points, Image Reconstruction, Mini unmanned aerial vehicles, Photogrammetry, Rock mechanics, Surveying instruments, Surveys, Terrestrial Laser Scanners, Three dimensional computer graphics, Unmanned Aerial Vehicles, Unmanned aerial vehicles (UAV), Virtual Reality, Virtual representations
@inproceedings{scianna_digital_2020,
title = {DIGITAL PHOTOGRAMMETRY, TLS SURVEY and 3D MODELLING for VR and AR APPLICATIONS in CH},
author = {Andrea Scianna and Giuseppe Fulvio Gaglio and Marcello La Guardia},
editor = {Lafarge F. Mallet C. Paparoditis N.},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85091094351&doi=10.5194%2fisprs-archives-XLIII-B2-2020-901-2020&partnerID=40&md5=02cb4e9119a689d19125360cf3c388de},
doi = {10.5194/isprs-archives-XLIII-B2-2020-901-2020},
year = {2020},
date = {2020-01-01},
booktitle = {International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives},
volume = {43},
pages = {901–909},
publisher = {International Society for Photogrammetry and Remote Sensing},
abstract = {The world of valorization of Cultural Heritage is even more focused on the virtual representation and reconstructions of digital 3D models of monuments and archaeological sites. In this scenario the quality and the performances offered by the virtual reality (VR) and augmented reality (AR) navigation take primary importance, improving the accessibility of cultural sites where the real access is not allowed for natural conditions or human possibilities. The creation of a virtual environment useful for these purposes requires a specific workflow to follow, combining different strategies in the fields of survey, 3D modelling and virtual navigation. In this work a specific case of study has been analyzed as a practical example, the church of ĝ€ San Giorgio dei Genovesi', settled in the Historic Centre of Palermo (Italy). The acquisition of geometric information has been obtained with the integration of Terrestrial Laser Scanner (TLS) technologies and the photogrammetric reconstruction from mini Unmanned Aerial Vehicle (UAV) equipment. The obtained point cloud has been georeferred considering a network of Ground Control Points (GCP) acquired by a Global Navigation Satellite System (GNSS) receiver. The final point cloud has been processed and properly simplified through 3D modelling procedures, to obtain a realistic and light 3D model reconstruction. The model has hence employed into a VR WEB navigation system and will be used for AR outdoor application in the future, allowing to obtain different solutions for empowering the accessibility of the cultural good. The strategy of 3D CH model reconstruction, followed in this work, could be considered a reference methodology for the development of VR gaming applications finalized to CH valorization and AR applications, applied to museums or touristic paths in historical centres. © 2020 International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives.},
note = {Issue: B2},
keywords = {3D model reconstruction, 3D modeling, 3D Modelling, Antennas, Augmented Reality, Digital Photogrammetry, Geometric information, Global Navigation Satellite Systems, Global positioning system, Ground control points, Image Reconstruction, Mini unmanned aerial vehicles, Photogrammetry, Rock mechanics, Surveying instruments, Surveys, Terrestrial Laser Scanners, Three dimensional computer graphics, Unmanned Aerial Vehicles, Unmanned aerial vehicles (UAV), Virtual Reality, Virtual representations},
pubstate = {published},
tppubtype = {inproceedings}
}
The world of valorization of Cultural Heritage is even more focused on the virtual representation and reconstructions of digital 3D models of monuments and archaeological sites. In this scenario the quality and the performances offered by the virtual reality (VR) and augmented reality (AR) navigation take primary importance, improving the accessibility of cultural sites where the real access is not allowed for natural conditions or human possibilities. The creation of a virtual environment useful for these purposes requires a specific workflow to follow, combining different strategies in the fields of survey, 3D modelling and virtual navigation. In this work a specific case of study has been analyzed as a practical example, the church of ĝ€ San Giorgio dei Genovesi', settled in the Historic Centre of Palermo (Italy). The acquisition of geometric information has been obtained with the integration of Terrestrial Laser Scanner (TLS) technologies and the photogrammetric reconstruction from mini Unmanned Aerial Vehicle (UAV) equipment. The obtained point cloud has been georeferred considering a network of Ground Control Points (GCP) acquired by a Global Navigation Satellite System (GNSS) receiver. The final point cloud has been processed and properly simplified through 3D modelling procedures, to obtain a realistic and light 3D model reconstruction. The model has hence employed into a VR WEB navigation system and will be used for AR outdoor application in the future, allowing to obtain different solutions for empowering the accessibility of the cultural good. The strategy of 3D CH model reconstruction, followed in this work, could be considered a reference methodology for the development of VR gaming applications finalized to CH valorization and AR applications, applied to museums or touristic paths in historical centres. © 2020 International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives.
2019
Scianna, Andrea; Gaglio, Giuseppe Fulvio; la Guardia, Marcello
Augmented Reality for Cultural Heritage: The Rebirth of a Historical Square Proceedings Article
In: P., Murtiyoso A. Macher H. Assi R. Grussenmeyer (Ed.): International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, pp. 303–308, International Society for Photogrammetry and Remote Sensing, 2019.
Abstract | Links | BibTeX | Tags: 3D Modelling, 3D Printing, Augmented Reality, Cultural heritage, Image Reconstruction, Mobile Applications, Photogrammetry, Terrestrial Laser Scanners
@inproceedings{sciannaAugmentedRealityCultural2019a,
title = {Augmented Reality for Cultural Heritage: The Rebirth of a Historical Square},
author = { Andrea Scianna and Giuseppe Fulvio Gaglio and Marcello {la Guardia}},
editor = { Murtiyoso A. Macher H. Assi R. Grussenmeyer P.},
doi = {10.5194/isprs-archives-XLII-2-W17-303-2019},
year = {2019},
date = {2019-01-01},
booktitle = {International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives},
volume = {42},
pages = {303--308},
publisher = {International Society for Photogrammetry and Remote Sensing},
abstract = {The case study, faced in this paper, arises in the context of Interreg Italia-Malta European project named I-Access, dedicated to the improvement of accessibility to Cultural Heritage (CH). Accessibility considered not only as the demolition of physical architectural barriers, but also as the possibility of fruition of CH through technological tools that can increase its perception and knowledge. Last achievements in photogrammetry and terrestrial laser scanner (TLS) technology offered new methods of data acquisition in the field of CH, giving the possibility of monitoring and processing big data, in the form of point clouds. Ever in this field, reverse engineering techniques and computer graphics are even more used for involving visitors to discover CH, with navigation into 3D reconstructions, empowering the real visualization adding further 3D information through the Augmented Reality (AR). At the same time, recent advances on rapid prototyping technologies grant the automated 3D printing of scaled 3D model reconstructions of real CH elements allowing the tactile fruition of visitors that suffer from visual defects and the connection with 3D AR visualizations. The presented work shows how these technologies could revive an historical square, the Piazza Garraffo in Palermo (Italy), with the virtual insertion of its baroque fountain, originally placed there. The final products of this work are an indoor and an outdoor AR mobile application, that allow the visualization of the historical original asset of the square. This study case shows how the mixing of AR and the rapid prototyping technologies could be useful for the improvement of the fruition of CH. This work could be considered a multidisciplinary experimentation, where different technologies, today still in development, contribute to the same goal aimed at improving the accessibility of the monument for enhancing the fruition of CH. textcopyright Authors 2019. CC BY 4.0 License},
keywords = {3D Modelling, 3D Printing, Augmented Reality, Cultural heritage, Image Reconstruction, Mobile Applications, Photogrammetry, Terrestrial Laser Scanners},
pubstate = {published},
tppubtype = {inproceedings}
}
The case study, faced in this paper, arises in the context of Interreg Italia-Malta European project named I-Access, dedicated to the improvement of accessibility to Cultural Heritage (CH). Accessibility considered not only as the demolition of physical architectural barriers, but also as the possibility of fruition of CH through technological tools that can increase its perception and knowledge. Last achievements in photogrammetry and terrestrial laser scanner (TLS) technology offered new methods of data acquisition in the field of CH, giving the possibility of monitoring and processing big data, in the form of point clouds. Ever in this field, reverse engineering techniques and computer graphics are even more used for involving visitors to discover CH, with navigation into 3D reconstructions, empowering the real visualization adding further 3D information through the Augmented Reality (AR). At the same time, recent advances on rapid prototyping technologies grant the automated 3D printing of scaled 3D model reconstructions of real CH elements allowing the tactile fruition of visitors that suffer from visual defects and the connection with 3D AR visualizations. The presented work shows how these technologies could revive an historical square, the Piazza Garraffo in Palermo (Italy), with the virtual insertion of its baroque fountain, originally placed there. The final products of this work are an indoor and an outdoor AR mobile application, that allow the visualization of the historical original asset of the square. This study case shows how the mixing of AR and the rapid prototyping technologies could be useful for the improvement of the fruition of CH. This work could be considered a multidisciplinary experimentation, where different technologies, today still in development, contribute to the same goal aimed at improving the accessibility of the monument for enhancing the fruition of CH. textcopyright Authors 2019. CC BY 4.0 License
Scianna, Andrea; Gaglio, Giuseppe Fulvio; Guardia, Marcello
Augmented reality for cultural heritage: The rebirth of a historical square Proceedings Article
In: P., Macher H. Murtiyoso A. Grussenmeyer (Ed.): International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, pp. 303–308, International Society for Photogrammetry and Remote Sensing, 2019, (Issue: 2/W17).
Abstract | Links | BibTeX | Tags: 3-D printing, 3D model reconstruction, 3D modeling, 3D Modelling, 3D printers, 3D Printing, Augmented Reality, Cultural heritage, Cultural heritages, Data acquisition, Data handling, Image Reconstruction, Mobile Applications, Photogrammetry, Rapid prototyping, Rapid prototyping technology, Repair, Reverse engineering, Reverse engineering techniques, Surveying instruments, Terrestrial Laser Scanners, Thallium, Three dimensional computer graphics, Virtual heritage, Visualization
@inproceedings{scianna_augmented_2019,
title = {Augmented reality for cultural heritage: The rebirth of a historical square},
author = {Andrea Scianna and Giuseppe Fulvio Gaglio and Marcello Guardia},
editor = {Macher H. Murtiyoso A. Grussenmeyer P.},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85078130517&doi=10.5194%2fisprs-archives-XLII-2-W17-303-2019&partnerID=40&md5=7c28c9b8bf88d7a1af810aeca9c2cff9},
doi = {10.5194/isprs-archives-XLII-2-W17-303-2019},
year = {2019},
date = {2019-01-01},
booktitle = {International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives},
volume = {42},
pages = {303–308},
publisher = {International Society for Photogrammetry and Remote Sensing},
abstract = {The case study, faced in this paper, arises in the context of Interreg Italia-Malta European project named I-Access, dedicated to the improvement of accessibility to Cultural Heritage (CH). Accessibility considered not only as the demolition of physical architectural barriers, but also as the possibility of fruition of CH through technological tools that can increase its perception and knowledge. Last achievements in photogrammetry and terrestrial laser scanner (TLS) technology offered new methods of data acquisition in the field of CH, giving the possibility of monitoring and processing big data, in the form of point clouds. Ever in this field, reverse engineering techniques and computer graphics are even more used for involving visitors to discover CH, with navigation into 3D reconstructions, empowering the real visualization adding further 3D information through the Augmented Reality (AR). At the same time, recent advances on rapid prototyping technologies grant the automated 3D printing of scaled 3D model reconstructions of real CH elements allowing the tactile fruition of visitors that suffer from visual defects and the connection with 3D AR visualizations. The presented work shows how these technologies could revive an historical square, the Piazza Garraffo in Palermo (Italy), with the virtual insertion of its baroque fountain, originally placed there. The final products of this work are an indoor and an outdoor AR mobile application, that allow the visualization of the historical original asset of the square. This study case shows how the mixing of AR and the rapid prototyping technologies could be useful for the improvement of the fruition of CH. This work could be considered a multidisciplinary experimentation, where different technologies, today still in development, contribute to the same goal aimed at improving the accessibility of the monument for enhancing the fruition of CH. © Authors 2019. CC BY 4.0 License},
note = {Issue: 2/W17},
keywords = {3-D printing, 3D model reconstruction, 3D modeling, 3D Modelling, 3D printers, 3D Printing, Augmented Reality, Cultural heritage, Cultural heritages, Data acquisition, Data handling, Image Reconstruction, Mobile Applications, Photogrammetry, Rapid prototyping, Rapid prototyping technology, Repair, Reverse engineering, Reverse engineering techniques, Surveying instruments, Terrestrial Laser Scanners, Thallium, Three dimensional computer graphics, Virtual heritage, Visualization},
pubstate = {published},
tppubtype = {inproceedings}
}
The case study, faced in this paper, arises in the context of Interreg Italia-Malta European project named I-Access, dedicated to the improvement of accessibility to Cultural Heritage (CH). Accessibility considered not only as the demolition of physical architectural barriers, but also as the possibility of fruition of CH through technological tools that can increase its perception and knowledge. Last achievements in photogrammetry and terrestrial laser scanner (TLS) technology offered new methods of data acquisition in the field of CH, giving the possibility of monitoring and processing big data, in the form of point clouds. Ever in this field, reverse engineering techniques and computer graphics are even more used for involving visitors to discover CH, with navigation into 3D reconstructions, empowering the real visualization adding further 3D information through the Augmented Reality (AR). At the same time, recent advances on rapid prototyping technologies grant the automated 3D printing of scaled 3D model reconstructions of real CH elements allowing the tactile fruition of visitors that suffer from visual defects and the connection with 3D AR visualizations. The presented work shows how these technologies could revive an historical square, the Piazza Garraffo in Palermo (Italy), with the virtual insertion of its baroque fountain, originally placed there. The final products of this work are an indoor and an outdoor AR mobile application, that allow the visualization of the historical original asset of the square. This study case shows how the mixing of AR and the rapid prototyping technologies could be useful for the improvement of the fruition of CH. This work could be considered a multidisciplinary experimentation, where different technologies, today still in development, contribute to the same goal aimed at improving the accessibility of the monument for enhancing the fruition of CH. © Authors 2019. CC BY 4.0 License
2018
Scianna, Andrea; Guardia, Marcello La
3D Virtual CH Interactive Information Systems for a Smart Web Browsing Experience for Desktop PCs and Mobile Devices Proceedings Article
In: F., Toschi I. Fuse T. Remondino (Ed.): International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, pp. 1053–1059, International Society for Photogrammetry and Remote Sensing, 2018.
Abstract | Links | BibTeX | Tags: 3D Modelling, Cultural heritage, Image Reconstruction, Information Systems, Photogrammetry, Virtual Reality, WebGL
@inproceedings{scianna3DVirtualCH2018a,
title = {3D Virtual CH Interactive Information Systems for a Smart Web Browsing Experience for Desktop PCs and Mobile Devices},
author = { Andrea Scianna and Marcello La Guardia},
editor = { Toschi I. Fuse T. Remondino F.},
doi = {10.5194/isprs-archives-XLII-2-1053-2018},
year = {2018},
date = {2018-01-01},
booktitle = {International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives},
volume = {42},
pages = {1053--1059},
publisher = {International Society for Photogrammetry and Remote Sensing},
abstract = {Recently, the diffusion of knowledge on Cultural Heritage (CH) has become an element of primary importance for its valorization. At the same time, the diffusion of surveys based on U AV Unmanned Aerial Vehicles (UAV) technologies and new methods of photogrammetric reconstruction have opened new possibilities for 3D CH representation. Furthermore the recent development of faster and more stable internet connections leads people to increase the use of mobile devices. In the light of all this, the importance of the development of Virtual Reality (VR) environments applied to CH is strategic for the diffusion of knowledge in a smart solution. In particular, the present work shows how, starting from a basic survey and the further photogrammetric reconstruction of a cultural good, is possible to built a 3D CH interactive information system useful for desktop and mobile devices. For this experimentation the Arab-Norman church of the Trinity of Delia (in Castelvetrano-Sicily-Italy) has been adopted as case study. The survey operations have been carried out considering different rapid methods of acquisition (UAV camera, SLR camera and smartphone camera). The web platform to publish the 3D information has been built using HTML5 markup language and WebGL JavaScript libraries (Three.js libraries). This work presents the construction of a 3D navigation system for a web-browsing of a virtual CH environment, with the integration of first person controls and 3D popup links. This contribution adds a further step to enrich the possibilities of open-source technologies applied to the world of CH valorization on web. textcopyright Authors 2018. CC BY 4.0 License.},
keywords = {3D Modelling, Cultural heritage, Image Reconstruction, Information Systems, Photogrammetry, Virtual Reality, WebGL},
pubstate = {published},
tppubtype = {inproceedings}
}
Recently, the diffusion of knowledge on Cultural Heritage (CH) has become an element of primary importance for its valorization. At the same time, the diffusion of surveys based on U AV Unmanned Aerial Vehicles (UAV) technologies and new methods of photogrammetric reconstruction have opened new possibilities for 3D CH representation. Furthermore the recent development of faster and more stable internet connections leads people to increase the use of mobile devices. In the light of all this, the importance of the development of Virtual Reality (VR) environments applied to CH is strategic for the diffusion of knowledge in a smart solution. In particular, the present work shows how, starting from a basic survey and the further photogrammetric reconstruction of a cultural good, is possible to built a 3D CH interactive information system useful for desktop and mobile devices. For this experimentation the Arab-Norman church of the Trinity of Delia (in Castelvetrano-Sicily-Italy) has been adopted as case study. The survey operations have been carried out considering different rapid methods of acquisition (UAV camera, SLR camera and smartphone camera). The web platform to publish the 3D information has been built using HTML5 markup language and WebGL JavaScript libraries (Three.js libraries). This work presents the construction of a 3D navigation system for a web-browsing of a virtual CH environment, with the integration of first person controls and 3D popup links. This contribution adds a further step to enrich the possibilities of open-source technologies applied to the world of CH valorization on web. textcopyright Authors 2018. CC BY 4.0 License.
Scianna, Andrea; Guardia, Marcello La
3D virtual CH interactive information systems for a smart web browsing experience for desktop PCs and mobile devices Proceedings Article
In: F., Fuse T. Toschi I. Remondino (Ed.): International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, pp. 1053–1059, International Society for Photogrammetry and Remote Sensing, 2018, (Issue: 2).
Abstract | Links | BibTeX | Tags: 3-d modeling, 3D Modelling, Antennas, Cameras, Cultural heritage, Cultural heritages, Diffusion, Diffusion of knowledge, HTML, HTML5, Image Reconstruction, Information Systems, Information use, Interactive informations, Internet connection, Libraries, Navigation systems, Open-source technology, Photogrammetry, Surveys, Unmanned aerial vehicles (UAV), Virtual Reality, WebGL
@inproceedings{scianna_3d_2018,
title = {3D virtual CH interactive information systems for a smart web browsing experience for desktop PCs and mobile devices},
author = {Andrea Scianna and Marcello La Guardia},
editor = {Fuse T. Toschi I. Remondino F.},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85048377074&doi=10.5194%2fisprs-archives-XLII-2-1053-2018&partnerID=40&md5=1c2badcf13bc32fcc40282085af9a980},
doi = {10.5194/isprs-archives-XLII-2-1053-2018},
year = {2018},
date = {2018-01-01},
booktitle = {International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives},
volume = {42},
pages = {1053–1059},
publisher = {International Society for Photogrammetry and Remote Sensing},
abstract = {Recently, the diffusion of knowledge on Cultural Heritage (CH) has become an element of primary importance for its valorization. At the same time, the diffusion of surveys based on U AV Unmanned Aerial Vehicles (UAV) technologies and new methods of photogrammetric reconstruction have opened new possibilities for 3D CH representation. Furthermore the recent development of faster and more stable internet connections leads people to increase the use of mobile devices. In the light of all this, the importance of the development of Virtual Reality (VR) environments applied to CH is strategic for the diffusion of knowledge in a smart solution. In particular, the present work shows how, starting from a basic survey and the further photogrammetric reconstruction of a cultural good, is possible to built a 3D CH interactive information system useful for desktop and mobile devices. For this experimentation the Arab-Norman church of the Trinity of Delia (in Castelvetrano-Sicily-Italy) has been adopted as case study. The survey operations have been carried out considering different rapid methods of acquisition (UAV camera, SLR camera and smartphone camera). The web platform to publish the 3D information has been built using HTML5 markup language and WebGL JavaScript libraries (Three.js libraries). This work presents the construction of a 3D navigation system for a web-browsing of a virtual CH environment, with the integration of first person controls and 3D popup links. This contribution adds a further step to enrich the possibilities of open-source technologies applied to the world of CH valorization on web. © Authors 2018. CC BY 4.0 License.},
note = {Issue: 2},
keywords = {3-d modeling, 3D Modelling, Antennas, Cameras, Cultural heritage, Cultural heritages, Diffusion, Diffusion of knowledge, HTML, HTML5, Image Reconstruction, Information Systems, Information use, Interactive informations, Internet connection, Libraries, Navigation systems, Open-source technology, Photogrammetry, Surveys, Unmanned aerial vehicles (UAV), Virtual Reality, WebGL},
pubstate = {published},
tppubtype = {inproceedings}
}
Recently, the diffusion of knowledge on Cultural Heritage (CH) has become an element of primary importance for its valorization. At the same time, the diffusion of surveys based on U AV Unmanned Aerial Vehicles (UAV) technologies and new methods of photogrammetric reconstruction have opened new possibilities for 3D CH representation. Furthermore the recent development of faster and more stable internet connections leads people to increase the use of mobile devices. In the light of all this, the importance of the development of Virtual Reality (VR) environments applied to CH is strategic for the diffusion of knowledge in a smart solution. In particular, the present work shows how, starting from a basic survey and the further photogrammetric reconstruction of a cultural good, is possible to built a 3D CH interactive information system useful for desktop and mobile devices. For this experimentation the Arab-Norman church of the Trinity of Delia (in Castelvetrano-Sicily-Italy) has been adopted as case study. The survey operations have been carried out considering different rapid methods of acquisition (UAV camera, SLR camera and smartphone camera). The web platform to publish the 3D information has been built using HTML5 markup language and WebGL JavaScript libraries (Three.js libraries). This work presents the construction of a 3D navigation system for a web-browsing of a virtual CH environment, with the integration of first person controls and 3D popup links. This contribution adds a further step to enrich the possibilities of open-source technologies applied to the world of CH valorization on web. © Authors 2018. CC BY 4.0 License.
2017
Prescia, Renata; Scianna, Andrea
Arab-Norman Heritage: State of Knowledge and New Actions and Innovative Proposal Proceedings Article
In: G., Bonora V. Tucci (Ed.): International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, pp. 535–541, International Society for Photogrammetry and Remote Sensing, 2017.
Abstract | Links | BibTeX | Tags: Geomatics, Historic Preservation, Image Reconstruction, Information Systems, Restoration
@inproceedings{presciaArabnormanHeritageState2017a,
title = {Arab-Norman Heritage: State of Knowledge and New Actions and Innovative Proposal},
author = { Renata Prescia and Andrea Scianna},
editor = { Bonora V. Tucci G.},
doi = {10.5194/isprs-Archives-XLII-5-W1-535-2017},
year = {2017},
date = {2017-01-01},
booktitle = {International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives},
volume = {42},
pages = {535--541},
publisher = {International Society for Photogrammetry and Remote Sensing},
abstract = {This paper wants to offers a perlustrative recognition on the 'state of the studies', concerning to the Arab-Norman architecture of Palermo, admissed by Unesco in 2015 and explain a research in progress which, starting from re-cognition of the peculiarities of the restoration work carried out on it, consisting of the identification of authentic material-constructive values and / or reconstruction, it orients itself to develop a concrete proposal of filing for a more conscious knowledge. She, moreover, wants contribute to real enhancement through the use of targeted communication strategies that use innovative means capable, on one hand, to attracting the greatest possible number of users, on the other hand, to plan further interventions of conservation coherent with the previous data. The product that you want to achieve is that of a Bank-data that allows the "networking" of monumental emergencies, that become the virtual itineraries waypoint, which can be implemented periodically and whose boards meet the cataloging needs and documentation but with reference at geo-referred systems, compatible with the conservation and management of heritage and with need of usability, real and virtual.},
keywords = {Geomatics, Historic Preservation, Image Reconstruction, Information Systems, Restoration},
pubstate = {published},
tppubtype = {inproceedings}
}
This paper wants to offers a perlustrative recognition on the 'state of the studies', concerning to the Arab-Norman architecture of Palermo, admissed by Unesco in 2015 and explain a research in progress which, starting from re-cognition of the peculiarities of the restoration work carried out on it, consisting of the identification of authentic material-constructive values and / or reconstruction, it orients itself to develop a concrete proposal of filing for a more conscious knowledge. She, moreover, wants contribute to real enhancement through the use of targeted communication strategies that use innovative means capable, on one hand, to attracting the greatest possible number of users, on the other hand, to plan further interventions of conservation coherent with the previous data. The product that you want to achieve is that of a Bank-data that allows the "networking" of monumental emergencies, that become the virtual itineraries waypoint, which can be implemented periodically and whose boards meet the cataloging needs and documentation but with reference at geo-referred systems, compatible with the conservation and management of heritage and with need of usability, real and virtual.
Prescia, Renata; Scianna, Andrea
Arab-norman heritage: State of knowledge and new actions and innovative proposal Proceedings Article
In: G., Bonora V. Tucci (Ed.): International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, pp. 535–541, International Society for Photogrammetry and Remote Sensing, 2017, (Issue: 5W1).
Abstract | Links | BibTeX | Tags: Cataloguing, Communication strategy, Geomatics, Historic Preservation, Image Reconstruction, Information Management, Information Systems, Restoration, Restoration works, Surveying, Waypoints
@inproceedings{prescia_arab-norman_2017,
title = {Arab-norman heritage: State of knowledge and new actions and innovative proposal},
author = {Renata Prescia and Andrea Scianna},
editor = {Bonora V. Tucci G.},
url = {https://www.scopus.com/inward/record.uri?eid=2-s2.0-85020722388&doi=10.5194%2fisprs-Archives-XLII-5-W1-535-2017&partnerID=40&md5=5940db03a12f0626e2bb6455ea1443b7},
doi = {10.5194/isprs-Archives-XLII-5-W1-535-2017},
year = {2017},
date = {2017-01-01},
booktitle = {International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives},
volume = {42},
pages = {535–541},
publisher = {International Society for Photogrammetry and Remote Sensing},
abstract = {This paper wants to offers a perlustrative recognition on the 'state of the studies', concerning to the Arab-Norman architecture of Palermo, admissed by Unesco in 2015 and explain a research in progress which, starting from re-cognition of the peculiarities of the restoration work carried out on it, consisting of the identification of authentic material-constructive values and / or reconstruction, it orients itself to develop a concrete proposal of filing for a more conscious knowledge. She, moreover, wants contribute to real enhancement through the use of targeted communication strategies that use innovative means capable, on one hand, to attracting the greatest possible number of users, on the other hand, to plan further interventions of conservation coherent with the previous data. The product that you want to achieve is that of a Bank-data that allows the "networking" of monumental emergencies, that become the virtual itineraries waypoint, which can be implemented periodically and whose boards meet the cataloging needs and documentation but with reference at geo-referred systems, compatible with the conservation and management of heritage and with need of usability, real and virtual.},
note = {Issue: 5W1},
keywords = {Cataloguing, Communication strategy, Geomatics, Historic Preservation, Image Reconstruction, Information Management, Information Systems, Restoration, Restoration works, Surveying, Waypoints},
pubstate = {published},
tppubtype = {inproceedings}
}
This paper wants to offers a perlustrative recognition on the 'state of the studies', concerning to the Arab-Norman architecture of Palermo, admissed by Unesco in 2015 and explain a research in progress which, starting from re-cognition of the peculiarities of the restoration work carried out on it, consisting of the identification of authentic material-constructive values and / or reconstruction, it orients itself to develop a concrete proposal of filing for a more conscious knowledge. She, moreover, wants contribute to real enhancement through the use of targeted communication strategies that use innovative means capable, on one hand, to attracting the greatest possible number of users, on the other hand, to plan further interventions of conservation coherent with the previous data. The product that you want to achieve is that of a Bank-data that allows the "networking" of monumental emergencies, that become the virtual itineraries waypoint, which can be implemented periodically and whose boards meet the cataloging needs and documentation but with reference at geo-referred systems, compatible with the conservation and management of heritage and with need of usability, real and virtual.