Logo image
Understanding Device–Body Coordination in Children’s Handheld Spatial AR Storytelling: Device–Body Coordination in Handheld Spatial AR
Conference poster   Open access

Understanding Device–Body Coordination in Children’s Handheld Spatial AR Storytelling: Device–Body Coordination in Handheld Spatial AR

Wenxue Yan, Femi Adeyemi-Ejeye and Minhua Ma
Proceedings of the ACM on human-computer interaction (ACM ISS 2026)
Proceedings of the ACM on Human-Computer Interaction, Association for Computing Machinery (ACM)
ACM Interactive Surfaces and Spaces 2026 (ISS 2026) (Turin, Italy, 23/11/2026–26/11/2026)
12/10/2026

Abstract

CCS CONCEPTS @BULLET Human-centered computing → Empirical studies in HCI Mixed / augmented reality User studies Additional Keywords and Phrases: handheld augmented reality, preschool children, embodied interaction, spatial storytelling * Corresponding author Spatial AR Device–Body Coordination Preschool Children Embodied Interaction Interactive Storytelling Augmented Reality

Handheld spatial augmented reality (AR) stories require readers to coordinate bodily movement and device use to access virtual content situated in physical space. This exploratory study examined 20 preschool children aged 5–6 using a spatial AR story prototype that combined character following with voice input. Structured observations, immediate verbal responses, and available iPad screen recordings were analyzed to interpret bodily actions in relation to narrative demands, content visibility, and subsequent behavior. Observed actions supported story following, exploration of physical–virtual relations, and adjustments to device holding, while also extending beyond the current narrative event. Their functions could not be inferred from movement alone. Two related analytical concepts organize these findings: movement-mediated access describes how bodily displacement and device adjustment shape access to story content; device–body coordination describes how children arrange body position, device orientation, and grip to maintain viewing and interaction. Coordination remained relevant during stationary story stages, when children could adjust device support or explore the virtual character through bodily action. Reported fatigue did not map directly onto willingness to replay. The study provides a contextual account of bodily interaction and suggests designing for continuity of story access across changes in movement requirements and device holding.

pdf
ISS 2026 Accepted Extended Abstract361.47 kBDownloadView
Author's Accepted Manuscript Open Access
url
https://iss.acm.org/2026/View
Event Website Conference website

Metrics

1 File views/ downloads
3 Record Views

Details

Logo image

Usage Policy