Abstract
(Englisch)
|
Since antiquity, images were used as records of both events-lifestyles, as well as decorations. The possibility of reviving them would add a new dimension in understanding our past. Therefore, LIFEPLUS proposes new developments for the innovative revival of life in ancient frescos and creation of narrative spaces. The revival is based on real scenes captured on live video sequences augmented with real-time behaviour groups of 3D virtual fauna and flora. The metaphor, which will inspire the project approach, is oriented to make the 'transportation in fictional and historical spaces', as uniquely depicted by frescos, as realistic, immerse and interactive as possible. The whole experience will be presented to the user on-site during his/her visit, through an immerse, mobile Augmented Reality-based Guide featuring wearable computing and multi-modal interaction.
Objectives:
LIFEPLUS proposes the innovative 3D reconstruction of ancient frescos through the real-time revival of their fauna and flora, featuring virtual animated characters with artificial life dramaturgical behaviours, in an immerse AR environment. In greater detail LIFEPLUS objectives are:
1) Real-time hyper realistic virtual life in AR environments;
2) Automatic Real-time Camera Tracking in unknown environments;
3) Perceptual issues in Augmented Reality (Occlusions, Shadow cues);
4) Design of successful character based installations;
5) Expressive autonomous cinematography for interactive Virtual Environments.
Although initially targeted at cultural heritage centres, the paradigm is not limited to those, but encompasses future location-based entertainments, e-visitor attractions and on-set visualisations for the TV/movie industry.
Work description:
The goal of LIFEPLUS is to push the limits of current Augmented Reality (AR) technologies, exploring the processes of narrative design of fictional spaces (e.g. frescos) where users can experience a high degree of realistic interactive immersion. Based on a captured/real-time video of a real scene, the project is oriented in enhancing these scenes by allowing the possibility to render realistic 3D simulations of virtual flora and fauna (humans, animals and plants) in real-time. According to its key technology, visitors are provided with a see-through Head-Mounted-Display (HMD), earphone and mobile computing equipment. A tracking system determines their location within the site and audio-visual information is presented to them in context with their exploration, superimposed on their current view of the site. LIFEPLUS will extend that system and provide key new technologies to render lively, real-time animations and simulations of ancient virtual life (3D human crowds, animals and plants). By its very nature, LIFEPLUS is a highly interdisciplinary project involving computer vision, computer graphics, user interfaces, human factors, wearable computing, mobile computing, computer networks, distributed computing, information access and information visualization. Two case study applications on virtual heritage will be developed and demonstrated. Historical world-class frescos will be 'brought to life', through lively 3D animated revival of their content, superimposed on their real environment. Thus the ancient characters of the frescoes (including humans, animals and plants) will be revived and simulated in real-time in 3D, exhibiting in a new innovative manner their unique aesthetic, dramaturgical and emotional elements.
Milestones:
M1 End of Project;
M2 Completion of the functional specifications;
M3 Completion of Preliminary Camera Tracking SDK;
M4 Finalised prototypes of Virtual Flora and Fauna simulation SDKs;
M5 Final Authoring Tools suite;
M6 Final Mobile On-Site AR Guide;
M7 Final Middleware prototype;
M8 Final Demonstrator.
|
