Logo image
SignSparK: Efficient Multilingual Sign Language Production via Sparse Keyframe Learning
Conference proceeding   Peer reviewed

SignSparK: Efficient Multilingual Sign Language Production via Sparse Keyframe Learning

Computer Vision – ECCV 2026
19th European Conference on Computer Vision (Malmö, Sweden, 08/09/2026–12/09/2026)
23/07/2026

Abstract

Sign Language Production Sign Segmentation Sparse Keyframe Learning 3D Human Motion Generation Flow Matching

Sign Language Production (SLP) faces a fundamental tradeoff: direct text-to-pose models suffer from regression-to-the-mean effects, while dictionary-retrieval methods produce disjointed transitions. To resolve this, we propose a novel training paradigm that leverages sparse keyframes to capture the underlying kinematic distribution of human signing. By generating dense motion from discrete anchors, our approach mitigates regression-to-the-mean while ensuring fluid articulation. To achieve this at scale, we introduce FAST, an ultra-efficient sign segmentation model that automatically mines precise temporal boundaries. We then present SignSparK, a Conditional Flow Matching (CFM) framework that utilizes these temporal anchors to synthesize 3D signing sequences. This keyframe-driven formulation also unlocks Keyframe-toPose (KF2P) generation, making precise spatiotemporal editing of signing sequences possible. Furthermore, SignSparK scales across four distinct sign languages, constituting the largest multilingual SLP framework to date, and integrates 3D Gaussian Splatting for photorealistic rendering. Extensive evaluations demonstrate that SignSparK achieves state-of-the-art across diverse SLP tasks and multilingual benchmarks. Our code is available at https://github.com/JianHe0628/SignSparK .

pdf
LEO_ECCV_2026 (8)11.15 MB
Author's Accepted Manuscript Embargoed Access, Embargo ends: 08/09/2026
url
https://eccv.ecva.net/Conferences/2026View
Event Website Conference website

Metrics

9 Record Views

Details

Logo image

Usage Policy