Hand gesture recognition based on auto‐landmark localization and reweighted genetic algorithm for healthcare muscle activities

Hira Ansar, Ahmad Jalal, Munkhjargal Gochoo, Kibum Kim

Research output: Contribution to journalArticlepeer-review

35 Citations (Scopus)


Due to the constantly increasing demand for the automatic localization of landmarks in hand gesture recognition, there is a need for a more sustainable, intelligent, and reliable system for hand gesture recognition. The main purpose of this study was to develop an accurate hand gesture recognition system that is capable of error‐free auto‐landmark localization of any gesture dateable in an RGB image. In this paper, we propose a system based on landmark extraction from RGB images regardless of the environment. The extraction of gestures is performed via two methods, namely, fused and directional image methods. The fused method produced greater extracted gesture recognition accuracy. In the proposed system, hand gesture recognition (HGR) is done via several different methods, namely, (1) HGR via point‐based features, which consist of (i) distance features, (ii) angular features, and (iii) geometric features; (2) HGR via full hand features, which are composed of (i) SONG mesh geometry and (ii) active model. To optimize these features, we applied gray wolf optimization. After optimization, a reweighted genetic algorithm was used for classification and gesture recognition. Experimentation was performed on five challenging datasets: Sign Word, Dexter1, Dexter + Object, STB, and NYU. Experimental results proved that auto landmark localization with the proposed feature extraction technique is an efficient approach towards developing a robust HGR system. The classification results of the reweighted genetic algorithm were compared with Artificial Neural Network (ANN) and decision tree. The developed system plays a significant role in healthcare muscle exercise.

Original languageEnglish
Article number2961
JournalSustainability (Switzerland)
Issue number5
Publication statusPublished - Mar 1 2021


  • Directional image
  • Geodesic distance
  • Gray wolf optimization
  • Hand gesture recognition
  • Landmark localization
  • Reweighted genetic algorithm
  • Saliency map

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Environmental Science (miscellaneous)
  • Geography, Planning and Development
  • Energy Engineering and Power Technology
  • Hardware and Architecture
  • Management, Monitoring, Policy and Law
  • Computer Networks and Communications
  • Renewable Energy, Sustainability and the Environment


Dive into the research topics of 'Hand gesture recognition based on auto‐landmark localization and reweighted genetic algorithm for healthcare muscle activities'. Together they form a unique fingerprint.

Cite this