Partners and International Organizations
(English)
|
European Design Centre (NL), ANDROME (B), BRTN (B), EPFL (CH), Limburg University Centre (B), NOB Interactive (NL), University Geneva (CH), VPRO Television (NL)
|
Abstract
(English)
|
The objective of VISTA is the development of tools and applications enabling the production of interactive TV programs featuring mixing real environment and virtual actors. Some specific applications have been developed, tested and broadcasted: interactive drama, interactive presenter, and defensive driving.
MIRALab's main involvement is in creating the virtual presenter system (WP7).
We participate in the writing of this papers describing our work on virtual presenters facial animation and system integration in VISTA.
· Sumedha Kshirsagar, Marc Escher, Gael Sannier, Nadia M.-Thalmann, 'Multimodal Animation System Based on the MPEG-4 Standard', Multimedia Modelling 99, Ottawa, Canada, October 4-6 1999, pp.215-232.
· G. Sannier, S. Balcisoy, N. Magnenat-Thalmann, D. Thalmann, VHD: A System for Directing Real-Time Virtual Actors, The Visual Computer, Springer, Vol.15, No 7/8, 1999, pp.320-329.
During this period, we continued intensive development of Virtual Human Director (VHD) system designed for real-time and interactive control of virtual humans inside virtual environments. This system allows as well real-time mixing of virtual and real elements which in effects provides a potential for placing virtual humans inside real scenes. Virtual humans can be controlled using graphical user interface or directly by the use of magnetic sensors motion capture technology (Flock Of Birds). The system allows for smooth blending of animations coming from algorithmic motion generators like walking motor, keyframes, real-time motion capture, etc. Actors clothes are simulated using real-time textures. Additionally to body animations the system provides powerful control over facial expressions, online speech synthesis and generation of respective facial animations. The system is integrated with Flock Of Birds real-time motion capture technology that allows for real-time direct control of the virtual actors.
We developed new virtual control tools for the VHD system that allows convenient authoring of the interactive content especially for the purpose of TV production and augmented reality. We have finalized the tool to record actions through time and to program the randomised action. By 'action' we mean high level control of virtual human (such as the action 'blink eyes', for example). This tool is designed for the creation of scenario involving virtual humans or to program complex behaviour of the virtual humans.
Participations:
Productions of 'Life After Death' TV pilot program together with VPRO TV Dutch production house. The production involved application of the VHD system in the field of real-time interactive augment reality. The project officially ended last year and was considered as successful by the commission.
|
