Progress Report

Last updated:

Development of “Jizai Hon-yaku-ki (At-will Translator)” connecting various minds based on brain and body functions[4 and 5] Social implementation of JIZAI Translator (neurodiversity / education)

Progress until FY2025

1. Outline of the project

In R&D Items 4 and 5, we analyze and solve problems in JIZAI Translator implemented in the following two contexts. R&D item 4 focuses on using JIZAI Translator as supported communication, especially involving people with developmental conditions. While our R&D project is not dedicated specifically to disabled people, it may have the social benefit of improving our communication while respecting neurodiversity.

R&D item 5 addresses classroom use of JIZAI Translator for education. Along with the MEXT initiative to install up-to-date devices for students to utilize in their study, our R&D Item 5 aims at providing proof-of-concept cases of educational application.
Close engagement with the relevant parties (like those with developmental conditions, their supporters, children, and teachers) is necessary from the very beginning of our R&D. The common task of these two R&D items is to incorporate their viewpoints to make JIZAI Translator useful to them.

図
Communication problems can be alleviated by JIZAI Translator.

2. Outcome so far

  1. Identifying the features that should be implemented as a priority in "JIZAI Translator"
  2. Acquisition of physiological and behavioral data using EEG and behavioral measurement systems, and establishment of a database and social implementation hub
  3. Started research into the social implementation of "JIZAI Translator"

Outcome 1: Through a Delphi survey co-designed with autistic individuals, we identified priority elements and functions for JIZAI Translator. Repeated surveys clarified four key difficulties: interpersonal relationships, sensory hypersensitivity, emotional/physical difficulties, and task performance. These findings have been shared with the R&D teams to guide core function development for social implementation.

図
Outcome 1 — illustrative summary
Source: S. Kumagaya (U Tokyo)

Outcome 2: Using the previously developed system for simultaneous, low-burden recording of EEG and behavioral data, we are collecting physiological and behavioral data from individuals with developmental conditions. We are also establishing a framework that serves as a hub for collaboration among PIs, enabling them to use these data and test prototypes of JIZAI Translator in real-world settings.

図
Outcome 2 — illustrative summary
Source: M. Nakamura (Showa Medical U)

Outcome 3: In addition to promoting the development of a wide range of environments with a view to implementing the prototype of JIZAI Translator in society, we have begun demonstrations at specialized day care centers for autistic people and to individuals with autism in collaboration with R&D Item 3. Based on feedback from participants, we will continue to select and implement useful elemental functions.
So far, we are engaging with potential users — especially those with developmental conditions — in various ways to lead our R&D better.

3. Future plans

We continue the ongoing engagement with users in every stage of our R&D, from basic research to trial and assessment of the products. Our R&D project also plans to build partnerships with educational sectors to proceed to trial implementations of JIZAI Translator for educational use.

(Tokyo U: S. Kumagaya, Showa Medical U: M. Nakamura, Tohoku U: K.I. Tsutsui)