TY - GEN
T1 - A Cooperative EEG-based BCI Control System for Robot-Drone Interaction
AU - Belkacem, Abdelkader Nasreddine
AU - Lakas, Abderrahmane
N1 - Publisher Copyright:
© 2021 IEEE
PY - 2021
Y1 - 2021
N2 - Brain-computer interfaces (BCIs) are an emerging technology with applications for persons with disabilities as well as the able-bodied. In this paper, we present a new framework of cooperative BCI control system for robot-drone interaction using P300-based BCI. This system is aimed at supporting and assisting complex and cooperative multitask military applications. In our online experiments, a robot”BB-8” and a parrot drone are separately mind-controlled to execute cooperative tasks using noninvasive brain measurements. We use real-time electroencephalography (EEG) signals to drive cooperative mission-based tasks by exchanging control information between two BCI users. The proposed cooperative BCI system is based on controlling the mobile robot and drone using the P300 speller modality and exchanging mapped messages between these two wearable EEG-headset-based systems. Using the EEG Unicorn Hybrid Black equipment, we quickly construct an interface that contains predefined visual cues for robot movements to be selected by the first BCI user; these cues are sent online as commands to the robot through the JavaScript server code. Another interface has been constructed that contains visual cues that are to be converted to drone-movement commands through the Python server code. The robot will perform a ground survey while the drone performs an aerial survey, and the final task will be performed by mutual communication between them. This cooperative BCI application can be operated by two soldiers. For instance, the actions of a robot may indicate different signs for the drone to undertake specific actions. This novel BCI application is evaluated based on the ability of two users to send commands using their brain activity, as well as the capability of the control algorithm to receive, send, and map the commands between the drone and the BB8 robot to allow them to achieve their mission.
AB - Brain-computer interfaces (BCIs) are an emerging technology with applications for persons with disabilities as well as the able-bodied. In this paper, we present a new framework of cooperative BCI control system for robot-drone interaction using P300-based BCI. This system is aimed at supporting and assisting complex and cooperative multitask military applications. In our online experiments, a robot”BB-8” and a parrot drone are separately mind-controlled to execute cooperative tasks using noninvasive brain measurements. We use real-time electroencephalography (EEG) signals to drive cooperative mission-based tasks by exchanging control information between two BCI users. The proposed cooperative BCI system is based on controlling the mobile robot and drone using the P300 speller modality and exchanging mapped messages between these two wearable EEG-headset-based systems. Using the EEG Unicorn Hybrid Black equipment, we quickly construct an interface that contains predefined visual cues for robot movements to be selected by the first BCI user; these cues are sent online as commands to the robot through the JavaScript server code. Another interface has been constructed that contains visual cues that are to be converted to drone-movement commands through the Python server code. The robot will perform a ground survey while the drone performs an aerial survey, and the final task will be performed by mutual communication between them. This cooperative BCI application can be operated by two soldiers. For instance, the actions of a robot may indicate different signs for the drone to undertake specific actions. This novel BCI application is evaluated based on the ability of two users to send commands using their brain activity, as well as the capability of the control algorithm to receive, send, and map the commands between the drone and the BB8 robot to allow them to achieve their mission.
KW - A cooperative BCI
KW - BB8 control
KW - Brain-computer interface
KW - Drone control
KW - P300 speller
UR - http://www.scopus.com/inward/record.url?scp=85125165897&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85125165897&partnerID=8YFLogxK
U2 - 10.1109/IWCMC51323.2021.9498781
DO - 10.1109/IWCMC51323.2021.9498781
M3 - Conference contribution
AN - SCOPUS:85125165897
T3 - 2021 International Wireless Communications and Mobile Computing, IWCMC 2021
SP - 297
EP - 302
BT - 2021 International Wireless Communications and Mobile Computing, IWCMC 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 17th IEEE International Wireless Communications and Mobile Computing, IWCMC 2021
Y2 - 28 June 2021 through 2 July 2021
ER -