[Yuki Arase] Grounded Phrase Embedding for Multimodal Information Processing

Researcher

Yuki Arase

Yuki Arase

Osaka University
Graduate school of information science and technology
Associate Professor

Website

Outline

Text is not computable as is, since it is composed of symbols. This project aims to project text into numerical vectors embedding their syntactic structures, as well as ground the vectors based on their semantic relations. For example, a linguistic structure in “ripe yellow banana” represents that something ripped is banana. Also, we can easily come up with its paraphrase, “mellow banana.” We replicate such syntactic and semantic information on the vector. With this technology, language can be computed together with image and sensor vectors, which contributes to create robots with human-like recognition abilities.

Program

  • CREST
  • PRESTO
  • ACT-I
  • ERATO
  • ACT-C
  • ACCEL
  • ALCA
  • RISTEX
Finish programs
  • Pamphlet
  • ProjectDB
  • GlobalActivity
  • Diversity-EN
  • OS_Policy-EN
  • Question-E