Logo image
Automated lip synchronisation for human-computer interaction and special effect animation
Conference paper   Peer reviewed

Automated lip synchronisation for human-computer interaction and special effect animation

Christian M Jones and S S Dlay
Proceedings of the IEEE International Conference on Multimedia Computing and Systems, pp.589-596
IEEE International Conference on Multimedia Computing and Systems, 1997 (Ottawa, Canada, 03-Jun-1997–06-Jun-1997)
IEEE (Institute of Electrical and Electronics Engineers)
1997
url
https://doi.org/10.1109/MMCS.1997.609773View
Published Version

Abstract

Artificial Intelligence and Image Processing computer animation automated lip synchronisation human-computer interfacing
The research presents MARTI (Man-machine Animation Real-Time Interface) for the realisation of automated special effect animation and human computer interaction. MARTI introduces novel research in a number of engineering disciplines, which include speech recognition, facial modelling, and computer animation. This interdisciplinary research utilises the latest, hybrid connectionist/hidden Markov model system, providing very accurate phone recognition and timing for speaker independent continuous speech, and expands' knowledge from the animation industry in the development of accurate facial models and automated animation. The system uses simple vocal soundtracks of human speakers to provide lip synchronisation of computer graphical facial models, to realise the first natural interface and animation system capable of high performance for real users and real-world applications.

Details

Metrics

1 File views/ downloads
788 Record Views
Logo image