When designing virtual experiences in a VR space, it's necessary to mathematically grasp the user's psychological state (aspiration and pleasure) to determine what kind of content (visual and audio signals) the system should provide - a system design theory is needed. As a foundation for establishing this design theory, we built a system capable of uniformly recording VR content visuals, audio, user biometric data (gaze, pupil diameter, skin potential, heart rate, electrocardiogram, brain measurement data), and full-body movement data (Figure 1).

Furthermore, in collaboration with the members of Research and Development Project 3-2 using the above platform, we built an experimental system to analyze mobility experiences related to aspiration and pleasure through travel in VR space. Specifically, we used a VR walking device that allowed actual movement in VR and created a VR application to tour six tourist spots. To investigate the impact of mobility experiences on memory, we built a feature that allows for photo taking on a smartphone during VR travel. This provides for retrospectively looking back on memories and establishing a system foundation for evaluating proactive actions.

Creation of VR Content in Collaboration with Sociology

In sociology, the research method known as the capability approach aims to clarify the factors that influence pleasure and aspiration by identifying the typical "can do or cannot do" elements in everyday life. In collaboration with the Research and Development Project 1 member, we have established a foundation to quantitatively analyze the impact on users' pleasure and aspiration by realistically experiencing these "can do or cannot do" scenarios in a VR environment. Specifically, as shown in Figure 2, by comparing experiences under conditions such as "engaging in prosocial behavior with others vs. being ignored by others," it becomes possible to investigate the factors that delight in pleasure and aspiration unique to each user.