GLoT: A Novel Gated-Logarithmic Transformer for Efficient Sign Language Translation

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Machine Translation has played a critical role in reducing language barriers, but its adaptation for Sign Language Machine Translation (SLMT) has been less explored. Existing works on SLMT mostly use the Transformer neural network which exhibits low performance due to the dynamic nature of the sign language. In this paper, we propose a novel Gated-Logarithmic Transformer (GLoT) that captures the long-term temporal dependencies of the sign language as a time-series data. We perform a comprehensive evaluation of GloT with the transformer and transformer-fusion models as a baseline, for Sign-to-Gloss-to-Text translation. Our results demonstrate that GLoT consistently outperforms the other models across all metrics. These findings underscore its potential to address the communication challenges faced by the Deaf and Hard of Hearing community.

Original languageEnglish
Title of host publication2024 IEEE Future Networks World Forum, FNWF 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages885-890
Number of pages6
ISBN (Electronic)9798350379495
DOIs
Publication statusPublished - 2024
Event2024 IEEE Future Networks World Forum, FNWF 2024 - Dubai, United Arab Emirates
Duration: Oct 15 2024Oct 17 2024

Publication series

Name2024 IEEE Future Networks World Forum, FNWF 2024

Conference

Conference2024 IEEE Future Networks World Forum, FNWF 2024
Country/TerritoryUnited Arab Emirates
CityDubai
Period10/15/2410/17/24

Keywords

  • Artificial intelligence
  • Deep learning
  • Natural language processing
  • Neural machine translation
  • Neural Network
  • Sign language translation
  • Time-Series data
  • Transformers

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Hardware and Architecture
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'GLoT: A Novel Gated-Logarithmic Transformer for Efficient Sign Language Translation'. Together they form a unique fingerprint.

Cite this