Mutual recall between onomatopoeia and motion using doll play corpus

Onomatopoeia is used to describe the state and degree of movement. Since onomatopoeia is a linguistic symbol, it is expected that many people will recall the same image corresponding to the onomatopoeia. Is this really true? In this paper, we focus on playing with dolls, collect onomatopoeia uttered during doll play, and construct a corpus of co-occurrence relations between onomatopoeia and doll movements. In order to verify the value of this corpus, we confirm the recall of movement from onomatopoeia and vice versa. As an application example based on this corpus, we also present a prototype of “onomatopoeia camera,” a system that automatically adds onomatopoeia and comic-like expressions to subjects’ movements.