Constructing a Knowledge Base of Onomatopoeia-Action Relations for an Interactive Illustrated Storybook

This paper presents an interactive illustrated storybook for PCs and tablets, which can impart virtual actions to the characters and phenomena (e.g., “raining,” “flowers swaying”) in a story on the basis of onomatopoeias (e.g., “Para Para,” “ByuByu-.”) input by the user. In order to create a knowledge base for this system, we investigate the correspondence between the onomatopoeias and the characters/phenomena using tweets containing onomatopoeias. This paper describes the proposed system and the method for obtaining the above mentioned correspondence.