Sign Language Recognition of Autistic Children using Wearable Sensors Signals Features Selection

Farman Ullah, Mohamed Isa, Ahmed Abdulraheim Alhammadi, Abdalla Ahmed Ali Alyassi, Shumayla Yaqoob, Ihtesham Jadoon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Children with autism spectrum disorder (ASD) often face difficulties and challenges in social interactions, communication, and eye contact due to neurological disorders. This neurological disorder causes children to have a lack of social interaction, sensory processing issues, repetitive behaviours, trouble adapting to change, and executive functioning problems. This article proposes the autistic children's gesture recognition framework using wearable sensors feature selection-based machine learning techniques. The system records and analyzes individuals' gestures, providing valuable data for understanding their behaviour. A dataset of 2 4 gestures from 10 children with ASD was collected, and various machine learning models, such as KNN-Manhattan, KNN-Euclidean, neural networks, and random forests, were trained using time-and frequency-domain features extracted from the sensor data. Cross-validation techniques were applied to evaluate the models' accuracy, with most classifiers achieving around 8 8% and the highest accuracy of about 9 1. 5%. This approach demonstrates the potential of wearable technology and machine learning in improving the understanding and support of individuals with ASD.

Original languageEnglish
Title of host publicationProceedings - 7th International Conference on Advanced Communication Technologies and Networking, CommNet 2024
EditorsFaissal El Bouanani, Fouad Ayoub
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350367027
DOIs
Publication statusPublished - 2024
Event7th International Conference on Advanced Communication Technologies and Networking, CommNet 2024 - Hybrid, Rabat, Morocco
Duration: Dec 4 2024Dec 6 2024

Publication series

NameProceedings - 7th International Conference on Advanced Communication Technologies and Networking, CommNet 2024

Conference

Conference7th International Conference on Advanced Communication Technologies and Networking, CommNet 2024
Country/TerritoryMorocco
CityHybrid, Rabat
Period12/4/2412/6/24

Keywords

  • Austim
  • Features Selection
  • Machine Learning
  • Wearable Sensors

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality
  • Control and Optimization

Fingerprint

Dive into the research topics of 'Sign Language Recognition of Autistic Children using Wearable Sensors Signals Features Selection'. Together they form a unique fingerprint.

Cite this