Progress Report

Liberation from Biological Limitations via Physical, Cognitive and Perceptual Augmentation[4] Study of issues common to the project and R&D for social implementation

Progress until FY2024

1. Outline of the project

This research and development team focuses on building a common infrastructure that supports the activities of other research teams. To strengthen the team structure, we have appointed additional principal investigator, including those from overseas. Through the creation of a BrainTech Guidebook and Evidence Book, we aim to enhance understanding of Brain-Machine Interface (BMI) technologies. We are also examining the legal implications of neurotechnological advances and issuing recommendations both domestically and internationally. Outreach efforts are underway to promote broader public understanding of non-invasive BMI and raise global awareness. In the OpenCA project — an open platform for operating, expanding, and reusing Cybernetic Avatar (CA) technologies — we are developing systems for multi-signal integration, open-source collaboration, and international partnerships to support trustworthy social implementation.

2. Outcome so far

<Research and Development Toward the Examination of Common Challenges and Social Implementation>

In the “Neu World” sci-fi prototyping project, we created and released 11 new works — including manga and short fiction — to encourage public dialogue on the ethical and social issues surrounding BMI-CA technologies. These works serve as tools for connecting science and society. We also collaborated with the WIRED Sci-Fi Prototyping Lab to develop a narrative world for future immersive experiences. In the use of digital twins at the construction field, we identified issues through interviews and visualized progress using point cloud and 360-degree data. As a proof of concept for remote operation and sensory support, we built a virtual system enabling a single CA to navigate the environment and tested the effectiveness of AI-based object recognition.

<Establishing a Social Foundation for Trusted BMI>

To support evaluating the reliability of BMI products for general consumer, we published the BrainTech Guidebook Vol. 2 in both Japanese and English. This edition presents five virtual product examples and a practical checklist. It has also been adopted by the OECD’s Neurotechnology Toolkit and contributed to the development of international guidelines. In parallel, we completed systematic reviews (SR) ※1 for 10 out of 12 selected topics — including neurofeedback and EEG applications — and updated the Evidence Book to reflect findings from nine of them. To enhance the efficiency of the review process, we are developing automation tools. Comparative analysis with large language models (LLMs) has confirmed improved classification accuracy and reductions in processing time. We will continue to build a reliable and transparent foundation for evaluating emerging neurotechnologies.

※1 A systematic scientific method for gathering, assessing, and integrating results from published research.

<Legal and Ethical Considerations in the Use of BMI-CA>

To advance international dialogue on ELSI and deliver concrete proposals from Japan, we undertook several initiatives. At an international workshop featuring Marcello Ienca, key ELSI topics were discussed, and agreement was reached on a follow-up presentation at next year’s global forum. We also revised and published a report based on the findings of the IoB-S research group, which was introduced widely at a launch event. At the International Neuroethics Society, we organized a plenary session and were invited by the UN Human Rights Council to provide input on a forthcoming report. These efforts have contributed to strengthening global ELSI networks and laying the groundwork for the development of new normative frameworks, including the emerging field of neurolaw.

<International Outreach of AI-Assisted BMI-CA Technology>

To promote the social implementation of AI-assisted BMI-CA technologies, we organized an international Brainpic event with 18 international students from seven countries and six participants with disabilities. The goal was to enhance public awareness and user experience by gathering feedback on operability and wearability. Based on the insights collected, we improved the design of the EEG headset, calibration process, and coordination with the CA, and developed a new four-player competition system. In preparation for Expo 2025 Osaka, Kansai, we strengthened durability and added a sliding mechanism. We also implemented an automatic calibration feature to accommodate individual differences and advanced integration with the OpenCA platform. Additionally, revised teaching materials for junior high, high school, and university students were introduced into classrooms to support formal education and expand outreach to the AYA (adolescent and young adult) generation.

Fig
<Advancing R&D on BMI and Promoting International Demonstration Projects Toward the Realization of OpenCA>

This year, we developed a prototype of the BMI-CA system as a foundation for broader implementation. The system is designed to handle multiple biosignals, including EEG and EMG, and allows users to build customizable control interfaces. It supports both physical robot operation and interaction within virtual environments. With future open-source release via ROS2 (Robot Operating System 2) in mind, we adopted a highly versatile system architecture. In parallel, we organized a workshop for researchers to gather detailed feedback on operability and signal stability. Additionally, we initiated collaboration with Dubai Future Lab to design user experiences for international deployment and began building a framework for future joint research.

3. Future plans

The social implementation of CA technologies requires the integration of practicality, reliability, and ethical standards within a global framework.

  • We will accelerate a development framework for BMI-CA through international collaboration on OpenCA and on-site validation.
  • We will establish a foundation of trust for BMI-CA by updating guidebooks, applying checklists, automating SR, and evaluating biological impacts.
  • Through mock trials and global symposia, we will promote policy proposals, talent development, and academic society formation.
  • At Expo 2025 Osaka, we will showcase AI-assisted BMI-CA and share implementation guidelines.
  • Exhibitions and partnerships in Dubai will further promote global recognition and expansion.