Augmented Tactile Book: Design of a Multisensory Page Prototype

Stud Health Technol Inform. 2023 Aug 23;306:543-550. doi: 10.3233/SHTI230675.ABSTRACTIn the framework of the LTA project, focusing on leisure reading for children with visual impairment, we present a prototype of multisensory illustration that will be used as a model for future accessible tactile interactive books. This multisensory illustration is based on two approaches to illustrate the storytelling. The first approach consists in embodying the character's legs with the index and middle fingers in order for the user to imitate actions such as walking. The second approach is to offer interactions feedback according to the readers actions. The main goal of this multisensory illustration prototype is to test and evaluate a selection of interactions and their associated sensors. These interactions help visually impaired readers to identify the environment of the story. They also help to understand actions behind the verbs. Readers are engaged to produce actions such as touching and imitating with their fingers. These interactions are developed according to hypotheses based on the literature. This multisensory illustration prototype was tested with a panel of children. The results comfort the idea that these interactions are useful for them.PMID:37638960 | DOI:10.3233/SHTI230675
Source: Studies in Health Technology and Informatics - Category: Information Technology Authors: Source Type: research