國立清華大學資訊工程學系

Department of Computer Science

National Tsing Hua University

專題演講

SEMINAR

SPEAKER

主講人：許之凡 

   TOPIC   

題　目：Toward User Immersed Multimedia Applications: Studies on Gaze Correction in Live Video Communication  

DATE

時  間： 108年09月3日(二)上午10點30至12點

PLACE

地　點：台達館615教室

Abstract:

Following the increase of the network bandwidth, the improvement of hardware devices, and the development of algorithms, multimedia applications gradually participate in our daily lives. Traditional system design determined by developers becomes insufficient to meet consumers’ demands. Improving the user experience (UX) of applications according to users’ opinions has become important. In numerous approaches, making consumers immersed is a convincing means to improve the UX of systems. This talk aims to explore the methods that improve the UX according to making user immersed. One killer application, live video communication, is selected as our research target because the most common use of multimedia applications is communication from the viewpoint of consumers. Besides, making users immersed is the goal of the application. We study a well-known but challenging problem, missing eye contact in live video commination. Eye contact is an important nonverbal language in communication. However, lacking eye contact is a common but serious problem of video communication. Hence, a gap between video and face-to-face communications still exists. We aim to solve the problem by proposing a deep learning-based gaze correction system that can real-time redirect gaze direction by image postprocessing to correct the gaze direction for establishing eye contact during the video communication. The effectiveness of the proposed gaze correction system is objectively and subjectively evaluated. Furthermore, the implemented system is open-source and expect to improve the future development of live video communication.

聯絡人：徐正炘 教授