Conference paper
MARTI: man-machine animation real-time interface
Proceedings Volume 362: Stereoscopic Displays and Virtual Reality Systems IV, pp.362-373
SPIE Symposium on Electronic Imaging, 1997 (San Jose, United States, 15-May-1997)
SPIE: International Society for Optical Engineering
1997
Abstract
The research introduces MARTI (man-machine animation real-time interface) for the realization of natural human-machine interfacing. The system uses simple vocal sound-tracks of human speakers to provide lip synchronization of computer graphical facial models. We present novel research in a number of engineering disciplines, which include speech recognition, facial modeling, and computer animation. This interdisciplinary research utilizes the latest, hybrid connectionist/hidden Markov model, speech recognition system to provide very accurate phone recognition and timing for speaker independent continuous speech, and expands on knowledge from the animation industry in the development of accurate facial models and automated animation. The research has many real-world applications which include the provision of a highly accurate and 'natural' man-machine interface to assist user interactions with computer systems and communication with one other using human idiosyncrasies; a complete special effects and animation toolbox providing automatic lip synchronization without the normal constraints of head-sets, joysticks, and skilled animators; compression of video data to well below standard telecommunication channel bandwidth for video communications and multi-media systems; assisting speech training and aids for the handicapped; and facilitating player interaction for 'video gaming' and 'virtual worlds.' MARTI has introduced a new level of realism to man-machine interfacing and special effect animation which has been previously unseen.
Details
- Title
- MARTI: man-machine animation real-time interface
- Authors
- Christian M Jones (Author) - University of Newcastle upon Tyne, United KingdomS S Dlay (Author) - University of Newcastle upon Tyne, United Kingdom
- Contributors
- Scott S Fisher (Editor)John O Merritt (Editor)Mark T Bolas (Editor)
- Publication details
- Proceedings Volume 362: Stereoscopic Displays and Virtual Reality Systems IV, pp.362-373
- Conference details
- SPIE Symposium on Electronic Imaging, 1997 (San Jose, United States, 15-May-1997)
- Publisher
- SPIE: International Society for Optical Engineering
- Date published
- 1997
- DOI
- 10.1117/12.274477
- Organisation Unit
- School of Social Sciences - Legacy; University of the Sunshine Coast, Queensland; Engage Research Lab; School of Law and Society
- Language
- English
- Record Identifier
- 99449296702621
- Output Type
- Conference paper
Metrics
1 File views/ downloads
770 Record Views