Smart seminar room baesd on multi-modal recognition of verbal and non-verbal information

Research Project Outline

Based on a multi-modal analysis and modeling of speech communication used for human intellectual activities, we design IT-enhanced environments for seminars and meetings, which provide real-time supports to participants and make their effective archive for later reference. In addition to the conventional approach to process main speaker's utterances, a novel indexing approach focusing on audience reaction is incorporated.