Michita Imai

A study on mutual understanding computing based on simultaneous contextualization and interpreting

Grant No.：JPMJCR19A1

Research Director

Michita Imai

Collaborator

Kazuhiro Ueda	Professor Graduate School of Interdisciplinary Information Studies The University of Tokyo
Komei Sugiura	Professor Faculty of Science and Technology Keio University
Masaki Takahashi	Professor Faculty of Science and Technology Keio University

Outline

The research studies the mechanism of Simultaneous Contextualization And INterpreting (SCAIN) that can simultaneously estimate the meaning of spoken words and context. The idea of the mechanism is inspired by the SLAM algorithm for a mobile robot. The resarch investigates what computation can handle human-initiated context throughout developing a low-stress multimodal dialogue system and the user assistant system for a mutual understanding between people by using SCAIN algorithm.

Kenji Suzuki

Supporting Empathic Behavior by Sharing and Extending Social Signals

Grant No.：JPMJCR19A2

Research Director

Kenji Suzuki

Collaborator

Yasuyo Minagawa

Professor Faculty of Letters Keio University

Outline

We aim at supporting to augment and convey human intention, to understand others, and to perform empathic behavior based on several approaches of research such as augmented human technology that shares and extends social signals, the understanding of its neural basis, and feasibility study. The social interaction is a model of a series of behavior chains. We challenge to deepen understanding of the information process of social signals and to create a foundation of empathic AI that generates empathic behavioral responses.

Tomoki Toda

Creation of Cooperative Human Augmentation Techniques in Sound Media Communication

Grant No.：JPMJCR19A3

Research Director

Tomoki Toda

Collaborator

Nobutaka Ono	Professor Graduate School of System Design Tokyo Metropolitan University
Hirokazu Kameoka	Distinguished Researcher Media Information Laboratory NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation

Outline

This project aims at creating fundamental techniques for augmenting the speech production function and the hearing function beyond physhical constraints based on cooperative actions between a user and a system. We will develop cooperatively augmented speech production and hearing techniques capable of low-latency real-time processing, involuntary system control, and intentional system control through human-machine interaction in a data-driven framework based on machine learning, making it possible to recorver and enhance our speech production and hearing functions.

Jin Nakazawa

Symbiotic Interaction Platform beyond Bounded Human Rationality

Grant No.：JPMJCR19A4

Research Director

Jin Nakazawa

Collaborator

Masashi Toyoda	Professor Institute of Industrial Science The University of Tokyo
Yasuto Nakanishi	Professor Faculty of Environment and Information Studies Keio University

Outline

This project aims at establishing the Symbiotic Interaction Platform beyond bounded human rationality focusing on creating the next generation sustainable society with the power of information. The city of the future will be an interface between people and information space, and the function and meaning of physical space will change greatly. There, the interaction beyond the limited rationality realized by this study will silently expand the throughput between people and information space, and people with expanded intellectual rationality will improve the wellbeing of the city and society. The project will contribute to this vision with the following three novel interaction techniques, acute notification, robotic intervention, and personalized interaction.

Satoshi Nakamura

Training Adapted Personalised Affective Social Skills with Cultural Virtual Agents

Grant No.：JPMJCR19A5

Research Director

Satoshi Nakamura

Collaborator

Kosuke Okazaki	Postdoctoral Researcher Department of Psychiatry Nara Medical University
Hiroki Tanaka	Assistant Professor College of Liberal Arts International Christian University

Outline

This project aims to develop personalised tools and methods for Social Skill Training (SST) to help overcome social stress in such everyday situations involving presentation at school and at work. Our aim is to develop a platform based on conventional SST and Cognitive Behavior Therapy (CBT) allowing participants to role play a social interaction. The targeted population is participants with different scales of social difficulties, going from shyness, Social Anxiety Disorder (SAD), to Autism Spectrum Disorder (ASD).