Skip to main navigation Skip to search Skip to main content

Development of a Fully Autonomous Offline Assistive System for Visually Impaired Individuals: A Privacy-First Approach

  • Fitsum Yebeka Mekonnen
  • , Mohammad F. Al Bataineh
  • , Dana Abu Abdoun
  • , Ahmed Serag
  • , Kena Teshale Tamiru
  • , Winner Abula
  • , Simon Darota

Research output: Contribution to journalArticlepeer-review

Abstract

Visual impairment affects millions worldwide, creating significant barriers to environmental interaction and independence. Existing assistive technologies often rely on cloud-based processing, raising privacy concerns and limiting accessibility in resource-constrained environments. This paper explores the integration and potential of open-source AI models in developing a fully offline assistive system that can be locally set up and operated to support visually impaired individuals. Built on a Raspberry Pi 5, the system combines real-time object detection (YOLOv8), optical character recognition (Tesseract), face recognition with voice-guided registration, and offline voice command control (VOSK), delivering hands-free multimodal interaction without dependence on cloud infrastructure. Audio feedback is generated using Piper for real-time environmental awareness. Designed to prioritize user privacy, low latency, and affordability, the platform demonstrates that effective assistive functionality can be achieved using only open-source tools on low-power edge hardware. Evaluation results in controlled conditions show 75–90% detection and recognition accuracies, with sub-second response times, confirming the feasibility of deploying such systems in privacy-sensitive or resource-constrained environments.

Original languageEnglish
Article number6006
JournalSensors
Volume25
Issue number19
DOIs
Publication statusPublished - Oct 2025

Keywords

  • OCR
  • Raspberry Pi
  • assistive technology
  • face recognition
  • object detection
  • offline AI
  • voice recognition

ASJC Scopus subject areas

  • Analytical Chemistry
  • Information Systems
  • Atomic and Molecular Physics, and Optics
  • Biochemistry
  • Instrumentation
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Development of a Fully Autonomous Offline Assistive System for Visually Impaired Individuals: A Privacy-First Approach'. Together they form a unique fingerprint.

Cite this