Progress Report

The Realization of an Avatar-Symbiotic Society where Everyone can Perform Active Roles without Constraint[5] Development of CA platform

Progress until FY2024

1. Outline of the project

We are developing the Cybernetic Avatar(CA) Platform (CA-PF), a software system that connects multiple CAs and tele-operators to enable service delivery. To construct this platform, we are defining its hierarchical structure, implementing the functions of each layer, and specifying inter-layer protocols. The platform consists of a monitoring layer, experience management layer, coordination layer, and operator assignment layer. Based on this design, we are prototyping the CA-PF, testing its performance in field environments, and identifying areas for improvement. In collaboration with R&D item 7 and a corporate consortium, we aim to enhance the CA-PF through field experiments that address interoperability and scalability across diverse CA services and types.

Fig.1
Fig. 1: Overview of the CA-PF prototype

2. Outcome so far

Development of CA-PF and Field Experiments

We developed the fourth-generation CA-PF prototype (Fig. 1), simulating various conditions including operator status (home-based, mobile), service locations (multi-site, high customer density), and service types. To support large-scale deployments, we enhanced the FY2023 CA group management functions with features such as location-based CA control (Fig. 2), real-time connection monitoring (RTT: round-trip time), and tele-operator workload visualization (Fig. 3). Building on successful FY2023 tests with over 100 CAs at one site, we expanded the system to support multi-site operations. Its scalability was confirmed in both simulations and real-world settings. The prototype's effectiveness was demonstrated through the “Avatar Land” field test, where 47 CAs were deployed at two sites in Osaka and Tokyo, in collaboration with R&D Themes 1, 2, 4, 7, and 8. Four types of CA services were provided via teleoperation from five locations across Japan.

Fig.2
Fig. 2: Location-based CA management
Fig.3
Fig. 3: Visualization for CA and tele-operator status

To promote wider adoption, the platform was temporarily offered free to consortium members under Moonshot Goal 1 and Research Theme 7.

Standardization of CA Service Function Description

We have been working to incorporate the specifications for describing CA service functions into two standardization efforts led by the Object Management Group (OMG): Robotic Service Ontology (RoSO), which defines functional requirements for robotic services, and Robotic Interaction Service (RoIS) Framework, which specifies functional components for robotic interaction services.
In RoSO, the service functions of CAs were included in the RoSO 1.0 Finalization Task Force (FTF) report, which was submitted and accepted in December 2024—effectively completing the standardization of RoSO 1.0. In RoIS, we developed and submitted the RoIS 2.0 Revised Draft to OMG in September 2024. It includes definitions for CA platform architecture, modularized CA functions, and operation interface specifications.

3. Future plans

The CA-PF is designed to operate in various conditions, including different types of CAs, operator situations, service locations, and service functions. Going forward, we will continue R&D and international standardization efforts with a focus on interoperability and scalability for heterogeneous services and CAs. We will also demonstrate the platform’s effectiveness through large-scale field trials in public and commercial facilities, as well as at major events such as Expo 2025 Osaka, Kansai.