TY - JOUR
T1 - Quadcopter robot control based on hybrid brain-computer interface system
AU - Chen, Chao
AU - Zhou, Peng
AU - Belkacem, Abdelkader Nasreddine
AU - Lu, Lin
AU - Xu, Rui
AU - Wang, Xiaotian
AU - Tan, Wenjun
AU - Qiao, Zhifeng
AU - Li, Penghai
AU - Gao, Qiang
AU - Shin, Duk
N1 - Funding Information:
This work was partially financially supported by the National Key Research & Development Program of China (2018YFC1314500), the National Natural Science Foundation of China (61806146, 61971118, and 81901860), the Natural Science Foundation of Tianjin City (17JCQNJC04200 and 18JCYBJC95400), the Tianjin Science and Technology Plan Project (No. 19YFSLQY00050), the United Arab Emirates University (Start-up grant G00003270 “31T130”), JSPS KAKENHI grants (19K11428), and the FY2018 MEXT Private University Research Branding Project.
Publisher Copyright:
© MYU K.K.
PY - 2020
Y1 - 2020
N2 - A hybrid brain-computer interface (hBCI) has recently been proposed to address the limitations of existing single-modal brain computer interfaces (BCIs) in terms of accuracy and information transfer rate (ITR) by combining more than one modality. The hBCI system also showed promising prospects for patients because the design of a human-centered smart robot control system may allow the performance of multiple tasks with high efficiency. In this paper, we present a hybrid multicontrol system that simultaneously uses electroencephalography (EEG) and electrooculography (EOG) signals. After the preprocessing phase, we used a common spatial pattern (CSP) algorithm to extract EEG and EOG features from motor imagery and eye movements. Moreover, a support vector machine (SVM) was used to solve a multiclass problem and complete flight operations through the asynchronous hBCI control of a four-axis quadcopter (e.g., takeoff, forward, backward, rightward, leftward, and landing). Online decoding of experimental results showed that 97.14, 95.23, 98.09, and 96.66% average accuracies, and 45.80, 43.99, 46.78, and 45.34 bits/min average ITRs were achieved in the control of a quadcopter. These online experimental results showed that the proposed hybrid system might be better in terms of completing multidirection control tasks to increase the multitasking and dimensionality of a BCI.
AB - A hybrid brain-computer interface (hBCI) has recently been proposed to address the limitations of existing single-modal brain computer interfaces (BCIs) in terms of accuracy and information transfer rate (ITR) by combining more than one modality. The hBCI system also showed promising prospects for patients because the design of a human-centered smart robot control system may allow the performance of multiple tasks with high efficiency. In this paper, we present a hybrid multicontrol system that simultaneously uses electroencephalography (EEG) and electrooculography (EOG) signals. After the preprocessing phase, we used a common spatial pattern (CSP) algorithm to extract EEG and EOG features from motor imagery and eye movements. Moreover, a support vector machine (SVM) was used to solve a multiclass problem and complete flight operations through the asynchronous hBCI control of a four-axis quadcopter (e.g., takeoff, forward, backward, rightward, leftward, and landing). Online decoding of experimental results showed that 97.14, 95.23, 98.09, and 96.66% average accuracies, and 45.80, 43.99, 46.78, and 45.34 bits/min average ITRs were achieved in the control of a quadcopter. These online experimental results showed that the proposed hybrid system might be better in terms of completing multidirection control tasks to increase the multitasking and dimensionality of a BCI.
KW - Common spatial pattern (CSP)
KW - Hierarchical support vector machine (hSVM)
KW - Hybrid brain computer interface (hBCI)
UR - http://www.scopus.com/inward/record.url?scp=85084510956&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85084510956&partnerID=8YFLogxK
U2 - 10.18494/SAM.2020.2517
DO - 10.18494/SAM.2020.2517
M3 - Article
AN - SCOPUS:85084510956
SN - 0914-4935
VL - 32
SP - 991
EP - 1004
JO - Sensors and Materials
JF - Sensors and Materials
IS - 3
ER -