Logo image
May the force be with you: Force-aligned signwriting for automatic subunit annotation of corpora
Journal article   Open access   Peer reviewed

May the force be with you: Force-aligned signwriting for automatic subunit annotation of corpora

O Koller, H Ney and R Bowden
2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013, pp.1-6
20/08/2013

Abstract

We propose a method to generate linguistically meaningful subunits in a fully automated fashion for sign language corpora. The ability to automate the process of subunit annotation has profound effects on the data available for training sign language recognition systems. The approach is based on the idea that subunits are shared among different signs. With sufficient data and knowledge of possible signing variants, accurate automatic subunit sequences are produced, matching the specific characteristics of given sign language data. Specifically we demonstrate how an iterative forced alignment algorithm can be used to transfer the knowledge of a user-edited open sign language dictionary to the task of annotating a challenging, large vocabulary, multi-signer corpus recorded from public TV. Existing approaches focus on labour intensive manual subunit annotations or on data-driven approaches. Our method yields an average precision and recall of 15% under the maximum achievable accuracy with little user intervention beyond providing a simple word gloss. © 2013 IEEE.
pdf
Koller_FG2013250.86 kBDownloadView
Text Open Access SRIDA
url
http://dx.doi.org/10.1109/FG.2013.6553777View
Published (Version of record)

Metrics

196 File views/ downloads
82 Record Views

Details

Logo image

Usage Policy