Conference paper
Human-computer interaction and animation system for simple interfacing to virtual environments
Proceedings of the 1997 IEEE International Conference on Systems, Man, and Cybernetics, Vol.5, pp.4242-4247
IEEE International Conference on Systems, Man, and Cybernetics: Comutational Cypernetics and Simulation, 1997 (Orlando, United States, 12-Oct-1997–15-Oct-1997)
Institute of Electrical and Electronics Engineers
1997
Abstract
Presents MARTI (Man-machine Animation Real-Time Interface) for simple interfacing to virtual environments. The system is designed for automated special-effect animation and human-computer interaction, and can immerse people, irrespective of their expertise, into new technologies. Previous research has used image recognition systems to extract control signals for lip synchronisation; however, the analysis requires that the key articulatory points be highlighted. Researchers have also considered acoustic soundtracks. However, these systems are limited by the accuracy of their speech recognition and must be trained on the single animator's voice. Furthermore, they do not provide timing information, which prevents accurate synchronisation. MARTI overcomes these limitations, allowing automatic lip synchronisation from a single speech input, and without the normal constraints of head-sets, reflectors and complex puppeteer control hardware. The system achieves a lip synchronisation performance in excess of 81% and does not require pre-training to the performer's voice, but instead operates with continuous speech in `normal' non-laboratory conditions. Furthermore, the system returns timing information, and is invariant to regional accents and dialects, race, age and gender. MARTI introduces novel research from a number of engineering fields in order to realise the first natural interface and animation system to be capable of high performance for real users and real-world applications.
Details
- Title
- Human-computer interaction and animation system for simple interfacing to virtual environments
- Authors
- Christian M Jones (Author) - University of Newcastle upon Tyne, United KingdomS S Dlay (Author) - University of Newcastle upon Tyne, United Kingdom
- Publication details
- Proceedings of the 1997 IEEE International Conference on Systems, Man, and Cybernetics, Vol.5, pp.4242-4247
- Conference details
- IEEE International Conference on Systems, Man, and Cybernetics: Comutational Cypernetics and Simulation, 1997 (Orlando, United States, 12-Oct-1997–15-Oct-1997)
- Publisher
- Institute of Electrical and Electronics Engineers
- Date published
- 1997
- DOI
- 10.1109/ICSMC.1997.637366
- ISSN
- 1062-922X
- ISBN
- 0780340531
- Organisation Unit
- School of Social Sciences - Legacy; University of the Sunshine Coast, Queensland; Engage Research Lab; School of Law and Society
- Language
- English
- Record Identifier
- 99449942202621
- Output Type
- Conference paper
Metrics
1 File views/ downloads
734 Record Views