A Cooperative EEG-based BCI Control System for Robot-Drone Interaction

Research output: Chapter in Book/Report/Conference proceedingConference contribution

15 Citations (Scopus)

Abstract

Brain-computer interfaces (BCIs) are an emerging technology with applications for persons with disabilities as well as the able-bodied. In this paper, we present a new framework of cooperative BCI control system for robot-drone interaction using P300-based BCI. This system is aimed at supporting and assisting complex and cooperative multitask military applications. In our online experiments, a robot”BB-8” and a parrot drone are separately mind-controlled to execute cooperative tasks using noninvasive brain measurements. We use real-time electroencephalography (EEG) signals to drive cooperative mission-based tasks by exchanging control information between two BCI users. The proposed cooperative BCI system is based on controlling the mobile robot and drone using the P300 speller modality and exchanging mapped messages between these two wearable EEG-headset-based systems. Using the EEG Unicorn Hybrid Black equipment, we quickly construct an interface that contains predefined visual cues for robot movements to be selected by the first BCI user; these cues are sent online as commands to the robot through the JavaScript server code. Another interface has been constructed that contains visual cues that are to be converted to drone-movement commands through the Python server code. The robot will perform a ground survey while the drone performs an aerial survey, and the final task will be performed by mutual communication between them. This cooperative BCI application can be operated by two soldiers. For instance, the actions of a robot may indicate different signs for the drone to undertake specific actions. This novel BCI application is evaluated based on the ability of two users to send commands using their brain activity, as well as the capability of the control algorithm to receive, send, and map the commands between the drone and the BB8 robot to allow them to achieve their mission.

Original languageEnglish
Title of host publication2021 International Wireless Communications and Mobile Computing, IWCMC 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages297-302
Number of pages6
ISBN (Electronic)9781728186160
DOIs
Publication statusPublished - 2021
Event17th IEEE International Wireless Communications and Mobile Computing, IWCMC 2021 - Virtual, Online, China
Duration: Jun 28 2021Jul 2 2021

Publication series

Name2021 International Wireless Communications and Mobile Computing, IWCMC 2021

Conference

Conference17th IEEE International Wireless Communications and Mobile Computing, IWCMC 2021
Country/TerritoryChina
CityVirtual, Online
Period6/28/217/2/21

Keywords

  • A cooperative BCI
  • BB8 control
  • Brain-computer interface
  • Drone control
  • P300 speller

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Signal Processing
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'A Cooperative EEG-based BCI Control System for Robot-Drone Interaction'. Together they form a unique fingerprint.

Cite this