Optimization of an image-based talking head system

Download statistics - Document (COUNTER):

Liu, K.; Ostermann, J.: Optimization of an image-based talking head system. In: Eurasip Journal on Audio, Speech, and Music Processing 2009 (2009), 174192. DOI: https://doi.org/10.1155/2009/174192

Repository version

To cite the version in the repository, please use this identifier: https://doi.org/10.15488/1743

Selected time period:

year: 
month: 

Sum total of downloads: 49




Thumbnail
Abstract: 
This paper presents an image-based talking head system, which includes two parts: analysis and synthesis. The audiovisual analysis part creates a face model of a recorded human subject, which is composed of a personalized 3D mask as well as a large database of mouth images and their related information. The synthesis part generates natural looking facial animations from phonetic transcripts of text. A critical issue of the synthesis is the unit selection which selects and concatenates these appropriate mouth images from the database such that they match the spoken words of the talking head. Selection is based on lip synchronization and the similarity of consecutive images. The unit selection is refined in this paper, and Pareto optimization is used to train the unit selection. Experimental results of subjective tests show that most people cannot distinguish our facial animations from real videos. Copyright © 2009 K. Liu and J. Ostermann.
License of this version: CC BY 4.0
Document Type: article
Publishing status: publishedVersion
Issue Date: 2009
Appears in Collections:Fakultät für Elektrotechnik und Informatik

distribution of downloads over the selected time period:

downloads by country:

pos. country downloads
total perc.
1 image of flag of Germany Germany 39 79.59%
2 image of flag of France France 5 10.20%
3 image of flag of Denmark Denmark 2 4.08%
4 image of flag of Sweden Sweden 1 2.04%
5 image of flag of Indonesia Indonesia 1 2.04%
6 image of flag of Brazil Brazil 1 2.04%

Further download figures and rankings:


Hinweis

Zur Erhebung der Downloadstatistiken kommen entsprechend dem „COUNTER Code of Practice for e-Resources“ international anerkannte Regeln und Normen zur Anwendung. COUNTER ist eine internationale Non-Profit-Organisation, in der Bibliotheksverbände, Datenbankanbieter und Verlage gemeinsam an Standards zur Erhebung, Speicherung und Verarbeitung von Nutzungsdaten elektronischer Ressourcen arbeiten, welche so Objektivität und Vergleichbarkeit gewährleisten sollen. Es werden hierbei ausschließlich Zugriffe auf die entsprechenden Volltexte ausgewertet, keine Aufrufe der Website an sich.

Search the repository


Browse