Researcher in Multimodal Spoken Dialogue System

 

Natural Language Processing Group ,
Department of Computer Science ,
University of Sheffield .
Regent Court, 211 Portobello Street, Sheffield,  
S1 4DP, UNITED KINGDOM

Email: w.cheng@dcs.shef.ac.uk

I currently work as a research assistant in the Department of Computer Science, University of Sheffield. My research job mainly foucs on multimodal spoken dialogue system which aims to provide a rich and natural interface, for example, using speech and gesture instead of traditionaly keyboard and mouse, between human and computer. It integrates several cutting-edge techonologies such as Automatic Speech Recognition, Natural Language Processing, Dialogue Management and Speech Synthesis into one system to achieve its goal.

At this moment, I'm working on a four-years EU-funded project called Companions. Companions is one of the largest European Multimodal and Multilingual Spoken Dialogue system with budget over 10 million euro. "It aims to change the way we think about the relationships of people to computers and the Internet by developing a virtual conversational 'Companion'." Two different types of Companions are under development-- Senior Companions and Health and Fitness Companions. The Senior Companions aims to faciliate elderly people access internet and manage their daily life while the Health and Fitness Companions is with the goal of tracking and improving user's health state. I'm the system architect and developer of the Senior Companions.

© 2006 WeiWei Cheng, The Department of Computer Science, University of Sheffield.