Individually Adapted Imagery Improves Brain-Computer Interface Performance in End-Users with Disability

Reinhold Scherer; Josef Faller; Elisabeth V. C. Friedrich; Eloy Opisso; Ursula Costa; Andrea Kübler; Gernot R. Müller-Putz

doi:10.1371/journal.pone.0123727

Abstract

Brain-computer interfaces (BCIs) translate oscillatory electroencephalogram (EEG) patterns into action. Different mental activities modulate spontaneous EEG rhythms in various ways. Non-stationarity and inherent variability of EEG signals, however, make reliable recognition of modulated EEG patterns challenging. Able-bodied individuals who use a BCI for the first time achieve - on average - binary classification performance of about 75%. Performance in users with central nervous system (CNS) tissue damage is typically lower. User training generally enhances reliability of EEG pattern generation and thus also robustness of pattern recognition. In this study, we investigated the impact of mental tasks on binary classification performance in BCI users with central nervous system (CNS) tissue damage such as persons with stroke or spinal cord injury (SCI). Motor imagery (MI), that is the kinesthetic imagination of movement (e.g. squeezing a rubber ball with the right hand), is the "gold standard" and mainly used to modulate EEG patterns. Based on our recent results in able-bodied users, we hypothesized that pair-wise combination of "brain-teaser" (e.g. mental subtraction and mental word association) and "dynamic imagery" (e.g. hand and feet MI) tasks significantly increases classification performance of induced EEG patterns in the selected end-user group. Within-day (How stable is the classification within a day?) and between-day (How well does a model trained on day one perform on unseen data of day two?) analysis of variability of mental task pair classification in nine individuals confirmed the hypothesis. We found that the use of the classical MI task pair hand vs. feed leads to significantly lower classification accuracy - in average up to 15% less - in most users with stroke or SCI. User-specific selection of task pairs was again essential to enhance performance. We expect that the gained evidence will significantly contribute to make imagery-based BCI technology become accessible to a larger population of users including individuals with special needs due to CNS damage.

Citation: Scherer R, Faller J, Friedrich EVC, Opisso E, Costa U, Kübler A, et al. (2015) Individually Adapted Imagery Improves Brain-Computer Interface Performance in End-Users with Disability. PLoS ONE 10(5): e0123727. https://doi.org/10.1371/journal.pone.0123727

Academic Editor: Luigi Bianchi, UNIVERSITY OF ROME TOR VERGATA, ITALY

Received: June 8, 2014; Accepted: March 6, 2015; Published: May 18, 2015

Copyright: © 2015 Scherer et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited

Data Availability: The data are available from the BNCI-Horizon 2020 project homepage (http://bnci-horizon-2020.eu/database/data-sets).

Funding: This work was supported by the FP7 EU Research Projects BrainAble (No. 247447; http://www.brainable.org/), ABC (No. 287774; http://www.abc-project.eu/) and BackHome (No. 288566; http://www.backhome-fp7.eu/). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

Introduction

Some mental activities induce changes in spontaneous electroencephalogram (EEG) rhythms in a very specific and predictive way. This means that an individual can generate distinct EEG patterns at will and independently from sensory stimulation. Brain-computer interfaces (BCIs) detect such EEG patterns and translate them into action. See [1–6] for a review on BCI technology.

The majority of modern imagery-based BCIs utilize motor imagery (MI) to encode messages (e.g. [4, 7–16]). MI, that is the kinesthetic imagination of movement, induces transient changes in sensorimotor EEG rhythms. More precisely, MI results in amplitude suppression (event-related desynchronization, ERD) or enhancement (event-related synchronization, ERS) in specific oscillatory components over defined brain areas [17]. The literature rarely provides very specific details on the MI tasks individual users perform. Common MI tasks are the kinesthetic imagination of movements of the left or right hand (e.g. wrist extension and flexion or squeezing movements) or both feet (e.g. dorsiflexion or foot pedal pressing tasks). We typically ask users whether they have preferred movements or whether they are familiar with specific movements from daily activities (e.g. sport-related activities or playing a musical instrument). Once movements are identified, subjects are usually asked to repetitively perform the mental motor task at a comfortable speed for a given period of time with the aim to induce sustained ERD and/or ERS patterns. Note that users are asked to keep their attention on the MI task and avoid imagining very fast or very slow movements. The issue is to prevent users from imagining automated motion sequences or successions of individual isolated movements. In both cases, (sub)cortical neural networks are activated in different ways, which may result in discontinuous ERD and/or ERS patterns (for example, mu rhythm ERD is followed by beta ERS (rebound) after end of individual movement). This is in line with the finding that sensory motor rhythm BCI performance correlates with prefrontal activation [18].

Operating mental imagery-based BCIs is a skill that has to be trained [3, 19, 20]. Users need to learn to generate EEG patterns reliably (feedback or reinforcement learning) for the machine to be able to translate them correctly (machine learning). Conventional training methods, however, often do not lead to the desired success (“BCI inefficiency”) [12, 21–23]. Discrimination between two distinct MI tasks is < 70% in about 40% of users [12]. There is common agreement that accuracy below 70% does not allow useful BCI operation [24]. Non-stationarity and inherent variability of EEG is one major issue for pattern classification: EEG signals typically change over time and EEG patterns are user-specific. Data-based time-invariant models are commonly used to characterize time-variant EEG [4, 25–27]. Various methods including time-invariant subspace decomposition, online co-adaptation and transfer learning are currently being examined to enhance classification performance [15, 28–31]. First results of these novel approaches are encouraging. Parallel to studying machine learning aspects of BCI to enhance performance, we have been investigating EEG pattern generation. We showed that kinesthetic imagery induces patterns that are more distinct and result in higher classification performances, when compared to the use of visual imagery of movements [32]. Furthermore, we found that the use of hand vs. feet MI leads to higher classification performances compared to the use of left hand vs. right hand MI tasks [33, 34]. Encouraged by the result that mental task choice impacts on pattern recognition performance, we recently started exploring possible alternatives to MI. Besides the use of MI, the literature reports on the use of e.g. mental mathematics, spatial navigation or object manipulation for operating a BCI (e.g. [7, 35–37]). Since the already mentioned mental tasks activate spatially distinct cortical areas, we hypothesized that an appropriate pair-wise combination of mental tasks inherently leads to highly discriminable EEG patterns [38]. Firstly, in off-line simulations [38–40] and recently, in online studies [37, 41], we were able to confirm our hypothesis. Key to enhance performance was the combination of “brain-teaser”, i.e., tasks that require problem specific mental work (e.g. mental subtraction or word association), and “dynamic imagery” tasks (e.g. MI or spatial navigation) [38], as well as subject-specific selection of task combination [37].

The mental task pair studies presented above were conducted in able bodied users in lab environments. Our primary goal in the context of BCI, however, is to develop novel augmentative communication applications and motor function restoration for individuals with functional disability (e.g. [11, 31, 42–45]). Functional disability means any long-term limitation in activity resulting from central nervous system (CNS) tissue damage. Highest priority is to provide them with a switch function, i.e., a reliable binary control signal. The goal of this study is to provide baseline evidence that appropriate pair-wise combination of mental tasks leads to enhanced EEG pattern discrimination in users with functional disability. The performance in this end-user group is typically lower than the performances able-bodied users achieve (< 70%, e.g. [46]).

Results

To establish a baseline, we recorded multi-channel EEG while participants performed five distinct mental tasks on two different days. Mental tasks included word association (WORD), mental subtraction (SUB), spatial navigation (NAV), MI of the right hand (HAND), and MI of both feet (FEET). User details and the number of trials with artifacts that were excluded from the analysis are summarized in Table 1. Within-day and between-day variability of pair-wise single-trial mental task classification was investigated by offline simulation (10-times 10-fold cross validation). Within-day variability was assessed by ranking the discriminability of mental task pairs for each day separately. Peak true positive rate (TPR) and true negative rate (TNR) values in the range of 43–94% were calculated for individual subjects (Fig 1(a)). The temporal dynamics of TPR and TNR detections are shown in Fig 1(b). To favor a balanced classification performance, imagery pairs are ranked based on the geometric mean accuracy $G M A C = \sqrt{T P R \cdot T N R}$ . With a median GMAC over participants md ≥ 77% on both days the class combination SUB vs. FEET achieved the highest single-trial classification performance. For seven out of the nine participants' peak GMAC > 70% (range 70–83%) were found on both days. Performances for mental task pairs WORD vs. HAND, SUB vs. HAND, and WORD vs. FEET were md ≥ 70% and md ≥ 77% on day one and two, respectively. The mental task combination HAND vs. FEET performed worst in average on both days (md ≤ 64%). For this pair md > 70% was calculated only for 4 out of 9 subjects (day 1: subject E, 71%; F: 74%; day 2: F, 76%; G, 84%; C, 71%;). There was a statistical significant difference in performance depending on the mental task pairs involved (Friedman Test, X²(9) = 25.95, p = 0.0021). Post-hoc analysis with Wilcoxon signed rank tests was conducted with a Bonferroni correction applied, resulting in a significance level set at p = 0.05/45 = 0.0011 (pair-wise comparison of performance of 10 mental task pairs results in 45 combinations). Median GMAC over participants and days (MD) are listed in Fig 1(a). We found that both SUB vs. FEET (Z = −3.375, p = 0.0007) and WORD vs. HAND (Z = −3.288, p = 0.0010) performed significantly better than HAND vs. FEET, as well as that WORD vs. FEET performed better than NAV vs. FEET (Z = −3.332, p = 0.0009).

Download:

Table 1. Participant details.

The ID, gender (Gndr), age in years, months (Mth) since occurrence and the type of event are shown for each individual. The number of trials with artifacts excluded from the analysis are listed for day 1/day 2 for each mental task. The last column lists EEG channels with artifacts that were excluded from analysis.

https://doi.org/10.1371/journal.pone.0123727.t001

Download:

Fig 1. Within-day variability results.

(a) Cross-validated within-day TPRs and TNRs. Peak TPR and TNR values, respectively, for the segment S_t = [t−1 t] with the highest geometric mean accuracy $G M A C = \sqrt{T P R \cdot T N R}$ during the imagery time period (t = [3.0, 3.5, …, 9.5]s after trial on-set) are presented. For better interpretation of the results, the rows and columns are sorted according to the median GMAC over class-pairs and day (1 and 2), and median over participants (user ID: A-L), respectively. Table entries are subdivided into three different levels of performances and color-coded. The last three columns list median GMAC values for each class-pair. The first column shows the median GMAC over subjects and days (MD). Column two and three list the median GMAC (md) and the number of subjects (n) with GMAC > 70% for each day. (b) Mean TPR and TNR curves, averaged over all subjects, for each day and mental task pair individually. The visual cue providing the information on the mental task to be performed was presented at t = 3s (vertical line).

https://doi.org/10.1371/journal.pone.0123727.g001

Between-day variability was assessed by training BCI models for each participant with data from day one and by applying the model on day two. To mitigate the problem of EEG non-stationarity between days, the classifier bias was adapted from the first few trials of day two [47]. Fig 2(a) summarizes peak TPR and TNR. Corresponding curves are summarized in Fig 2(b). With md = 82% and seven out of nine subjects performing better than GMAC > 70% the mental task combination WORD vs. HAND achieved the highest overall performance. Worst performance was calculated for HAND vs. FEET (md = 68%). Only for one participant the performance threshold of md > 70% was exceeded. Achieved performances vary among users.

Download:

Fig 2. Between-day variability results.

(a) Simulated peak TPR and TNR values (color coded), respectively, for the segment S_t with the highest $G M A C = \sqrt{T P R \cdot T N R}$ during the imagery period (t = [3.0, 3.5, …, 9.0]s). The column on the right list the median GMAC (md) and the number of subjects (n) with GMAC > 70%. (b) Mean TPR and TNR curves for day two, averaged over all participants, for each mental task pair individually.

https://doi.org/10.1371/journal.pone.0123727.g002

Discussion

Both within-day analysis and between-day simulation confirm our hypothesis: Individual selection of mental task pairs significantly boosts binary classification accuracy of induced EEG patterns in end-users with functional disability.

Motor imagery tasks

The literature shows that the use of HAND vs. FEET mental tasks pairs leads to binary accuracy < 70% in about 40% of able-bodied first-time BCI users [12]. Initial classification performance in users with functional disability is typically lower and improves with training (e.g. [13, 42]). The results of this study support such an initial performance distribution. There can be several reasons why the use of MI leads to performance slump in users with functional disability. One explanation could be that central nervous system (CNS) tissue damage results in changes in structural connectivity that lead to unspecific activity and hence to very similar EEG patterns. A different explanation could be the enjoyment of performing MI. After each experiment, participants were asked about the ease and enjoyment of performing the different mental tasks. The analyses of self-reports showed that participants enjoyed motor tasks less than non-motor tasks [48]. The use of MI of affected body parts may cause some adverse effects on imagery (for example, frustration due of the inability to move). A recent study in able-bodied individuals suggests that the sensation of body ownership makes MI become “easier” [49]. Moreover, sensation of body ownership has a positive impact on BCI performance [50]. This, however, also raises the question on whether or not body ownership is fundamental for good MI-BCI performance? Individuals with motor disability may neglect or have lost the sensation of body ownership/agency over affected muscles. As a consequence, motor imagery of affected body parts may not be best strategy for gaining reliable BCI control without extensive training. Addressing this question is important future work and will help gaining a better understanding of the underlying neural processes. The result that MI tasks pairs induce EEG patterns that are suboptimal in terms of pattern classification does not mean that MI should no longer be used. Results of this study and from the literature show that MI leads to accuracy > 70% in some BCI users with functional disability. Moreover, for applications such as BCI-based stroke motor function rehabilitation the use of MI is most appropriate and reasonable [51–53].

“Brain-teasers” vs. “dynamic imagery” mental tasks

The increase in binary classification performance that results from using a combination of “brain-teaser” and “dynamic imagery” tasks as well as an individual selection of tasks is in line with previous offline and online studies with able-bodied users [37, 38, 40]. In general no clear differences in the computed performances between individuals with SCI and stroke were observed. We conclude that selecting user-specific mental task pairs enables a large number of individuals to benefit from BCI technology.

Between-day model transfer

The between-day variability analysis clearly shows different dynamics of the distinct mental tasks. Specifically for the best performing tasks WORD and SUB, which peak about 2 seconds earlier when compared to HAND and FEET, respectively (Fig 2(b)). This is a result of the selected model transfer procedure. We trained our BCI model with features extracted from 1-s EEG segments on day one. Incorporating more information on temporal dynamics will further enhance the prediction performance and reduce misclassification. However, at the cost of timely feedback presentation. We typically try to minimize feedback delays to support reinforcement learning in users. One open question in the context of temporal dynamics is whether “more frequent but less accurate” (update rate > 10 Hz) or “less frequent but more accurate” (≤ 1 Hz) feedback is more beneficial for BCI skill acquisition.

Note that for the between-day variability analysis we were interested in examining the maximum performance that can be achieved when transferring the BCI model between sessions. Several classifiers were computed for each mental task pair. The results reported summarize the maximum performance achieved by an individual classifier on unseen data of day two. The common approach for BCI is to select parameters on day one that achieve maximum classification performance and apply them to day two. Evaluation of the simulation results when applying the maximum performance criterion for parameter selection, however, led to accuracies ≥ 80% only in 4 out of the nine participants on day two. We emphasize this drop in performance issue because our between-day model transfer simulation results suggests that the common maximum classification performance strategy is not optimal. Finding more appropriate selection criteria for parameter optimization is of utmost importance and needs closer addressing in the future.

Conclusion

To conclude, in this study we systematically examined the impact of mental task choice on the performance of mental imagery-based BCIs in individuals with CNS tissue damage. The results of the study support that the choice of mental task significantly impacts on the classification performance in first-time imagery-based BCI users with functional disability. And, although motor imagery is the “gold standard”, the classification between hand vs. feet performs well only in a minority of users without training. The use of “brain-teaser” and “dynamic imagery” mental task combinations leads to significant performance increase in the majority of end-users with functional disability. Furthermore, the performance level that end-users with functional disability achieve is comparable to the performance that able-bodied users achieve.

Methods

Participants

Nine individuals with severe motor disabilities (seven female, age range 20–57 with a median age of 38, SD = 10) consented to participate in this study. The study, including the measurement protocol and the consent procedure were approved by the local ethics board, “Comitè d’Ètica Assistencial de l’Institut Guttman”. All participants gave informed, oral consent. In addition, written consent was obtained for every participant. The signed consent forms are stored with the participants’ clinical files. In many cases, written consent had to be provided by the participants’ legal representatives as many participants were not able to write due to tetraplegia. Details of the participants are summarized in Table 1. Participants attended a rehabilitation program at the Guttmann Institute in Barcelona, Spain, were naïve to the task and did not receive BCI training before participating in this study.

Recordings

EEG was recorded from 30 electrode channels placed on the scalp according to the international 10–20 system. Electrode positions included channels AFz, F7, F3, Fz, F4, F8, FC3, FCz, FC4, T3, C3, Cz, C4, T4, CP3, CPz, CP4, P7, P5, P3, P1, Pz, P2, P4, P6, P8, PO3, PO4, O1, and O2. Reference and ground were placed at the left and right mastoid, respectively. Additionally, electrooculographic (EOG) activity was recorded from two electrodes placed on the outer canthus of the left eye and above the nasion. The g.tec GAMMAsys system with g.LADYbird active electrodes and two g.USBamp biosignal amplifiers (Guger Technolgies, Graz, Austria) was used for recording the biosignals. Biosignals were band pass filtered 0.5–100 Hz (notch filter at 50 Hz) and sampled at a rate of 256 Hz.

Experimental paradigm

The experiment was conducted on two different days with at least 5 days in between within a two-week period. Details on the cue-guided experimental paradigm are summarized in Fig 3. The screening session for a single subject consisted of 8 runs resulting in 40 trials of each class for each day. One single experimental run consisted of 25 cues, with 5 of each mental task. Cues were presented in random order. Participants were asked to continuously perform the specified mental imagery task for 7 seconds. Mental tasks included:

Word association (WORD): Generation of as many words possible beginning with the presented letter in Spanish language (e.g. B = bank, bold, buy, etc). Letters were presented in pseudo-randomized order.
Mental subtraction (SUB): Calculation of successive elementary subtractions from the presented problem. More precisely, the task was to subtract a random 1-digit number from a randomly selected number between 15–30 (e.g. 27-6 = 21, 21-6 = 15, etc).
Spatial navigation (NAV): Imagination of navigating through a familiar house (flat) thereby focusing on orientation.
Motor imagery of the right hand (HAND): Kinesthetic imagination of repetitively squeezing a hand-sized ball with the own right hand.
Motor imagery of both feet (FEET): Kinesthetic imagination of repetitive self-paced movements of both feet without any actual movement.

Download:

Fig 3. Experimental paradigm.

The duration of single imagery trials (T_i) was 10 s. At t = 0 s, a cross was presented in the middle of the screen. Participants were asked to relax and fixate the cross to avoid eye movements. At t = 3 s, a beep was sounded to get the participant’s attention. The cue indicating the requested imagery task, one out of five graphical symbols, was presented from t = 3 s to t = 4.25 s. At t = 10 s, a second beep was sounded and the fixation-cross disappeared, which indicated the end of the trial. A variable break (inter-trial-interval, ITI) lasting between 2.5 s and 3.5 s occurred before the start of the next trial. Participants were asked to avoid movements during the imagery period, and to move and blink during the ITI. Experimental runs began and ended with a blank screen (duration 4 s). Modified from [38].

https://doi.org/10.1371/journal.pone.0123727.g003

Participants were seated about 0.7 m in front of a 17 inch computer monitor. Before each experiment began, participants received instructions on the task to be performed (both in writing as slideshow and verbally) and were asked to relax, avoid movements and reduce blinking during the experiment. To get acquainted with the experimental paradigm, subjects were asked to perform one exercise run consisting of two trials per class before the recording of imagery trials started. After the experiment participants were asked about the quality of their imagery, and the ease and enjoyment of mental tasks (5-point rating scale). Results on the questionnaires are presented elsewhere [48].

Data Analysis.

Recorded EEG signals were visually scored by an expert and trials contaminated with muscle or eye movement activity within the imagery period were excluded from further analysis. Furthermore, noisy channels or channels severely contaminated with artifacts were excluded. Different channels were affected on either of the two days. To keep the information for single-trial classification identical on both days, affected channels were removed from both days. However, due to this procedure the number of EEG channels and the number of trials included in the analysis was different for each subject. Please see Table 1 for a detailed list of channels/trials that were removed/excluded.

The procedure applied in [40] for comparing within- and between-day variability in able bodied individuals was utilized. All possible mental task pair combinations were analyzed separately. The well established method of common spatial patterns (CSP) was used to design class specific spatial filters in the 8–30 Hz frequency band, and Fisher's linear discriminant analysis (LDA) classifier was used to classify the log-transformed normalized variance from 4 projections (m = 2) [54]. The CSP method projects multi-channel EEG data segments from two classes into a low-dimensional spatial subspace in such a way that the variances of the time series are optimal for discrimination ([55], for a tutorial see [56]). Designing CSP filters involves two steps. The first step is to whiten the EEG, i.e., to transform the distribution of the EEG into a spherical Gaussian distribution with covariance matrix Σ = σ² ⋅ I, where I denotes the identity matrix. The second step is to align the variances σ² projected along the principal axes with the coordinate axes (rotation). Only the most discriminative projections Z_i, i = 1, …, 2m, obtained from the m-largest and m-smallest eigenvalues of the principal axes, are used for classification. For each projection Z_i the variance of the projection within the analyzed segment is computed and normalized by division by the sum of the variances of the 2m projections. Features used for classification are computed by taking the logarithm of the normalized values. Fisher’s LDA classifier is a linear hyper-plane classifier. LDA projects high-dimensional data onto a line and performs classification by thresholding in the projected one-dimensional space. The projection maximizes the distance between the means of the two classes while minimizing the variance within each class. See [57] for more details on LDA.

Within-day variability analysis.

Each day was analyzed separately to rank the discriminability of the imagery pairs and to evaluate the within-day variability. To get an overview of timing and dynamics of the induced EEG patterns, trials were subdivided into thirteen 1-s data segments with 0.5 s overlap (S_t = [t − 1 t], t = 3.0, 3.5, …, 9.5s). For each S_t and imagery pair, CSPs and LDA were computed and evaluated using a 10-times 10-fold cross-validation statistic. To favor a balanced classification performance, we ranked the imagery pairs based on the geometric mean accuracy $G M A C = \sqrt{T P R \cdot T N R}$ and not on the arithmetic mean accuracy.

Between-day variability Analysis.

BCI simulations were computed to assess the between-day variability. For every 1-s time segment S_t = [t − 1 t]s, t = 3.0, 3.5, …, 9.0s, within the imagery period of day one, CSP and LDA methods were trained and applied to day two. We typically use 1-s segments for classification because this segment length results in a reasonable tradeoff between classification accuracy and system reaction time during on-line feedback control [58]. To account for non-stationarities in EEG due to possible differences in the electrode montage and impedances between days and other noise sources, the first 4 trials of each class from day two were used to update the bias of the LDA [47]. CSP filter and LDA weights were not modified. Corresponding to on-line BCI signal processing, CSP filters were applied to 1-s EEG segments and classified by the re-biased LDA classifier. For comparison reasons, only EEG segments with a 0.5 s time-lag (1-s segment length) as used in the within-day variability analysis above were calculated.

Acknowledgments

This work was supported in part by the FP7 Framework EU Research Projects BrainAble (No. 247447), ABC (No. 287774) and BackHome (No. 288566). This paper only reflects the authors' views and funding agencies are not liable for any use that may be made of the information contained herein. The authors would like to thank Isabella Wagner for the help with EEG scoring and David Steyrl for fruitful discussion.

Author Contributions

Conceived and designed the experiments: RS JF EF EO. Performed the experiments: JF EF EO UC. Analyzed the data: RS JF. Wrote the paper: RS JF EF EO UC AK GM.

References

1. Pfurtscheller G, Neuper C. Motor imagery and direct brain-computer communication. Proceedings of the IEEE. 2001;89(7):1123–1134. Available from: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=939829.
- View Article
- Google Scholar
2. Kübler A, Kotchoubey B, Kaiser J, Wolpaw JR, Birbaumer N. Brain-computer communication: unlocking the locked in. Psychological Bulletin. 2001 May;127(3):358–375. Available from: http://psycnet.apa.org/doi/10.1037/0033-2909.127.3.358. pmid:11393301
- View Article
- PubMed/NCBI
- Google Scholar
3. Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM. Brain-computer interfaces for communication and control. Clinical Neurophysiology. 2002 Jun;113(6):767–791. Available from: http://dx.doi.org/10.1016/S1388-2457(02)00057-3. pmid:12048038
- View Article
- PubMed/NCBI
- Google Scholar
4. Mason S, Bashashati A, Fatourechi M, Navarro K, Birch G. A comprehensive survey of brain interface technology designs. Annals of biomedical engineering. 2007;35(2):137–169. Available from: http://link.springer.com/article/10.1007/s10439-006-9170-0. pmid:17115262
- View Article
- PubMed/NCBI
- Google Scholar
5. Millán JDR, Rupp R, Müller-Putz GR, Murray-Smith R, Giugliemma C, Tangermann M, et al. Combining Brain-Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges. Frontiers in Neuroprosthetics. 2010;4. Available from: http://dx.doi.org/10.3389/fnins.2010.00161.
- View Article
- Google Scholar
6. Nicolas-Alonso LF, Gomez-Gil J. Brain computer interfaces: a review. Sensors. 2012;12(2):1211–1279. Available from: http://dx.doi.org/10.3390/s120201211. pmid:22438708
- View Article
- PubMed/NCBI
- Google Scholar
7. Millán JdR, Mouriño J. Asynchronous BCI and local neural classifiers: an overview of the Adaptive Brain Interface project. Neural Systems and Rehabilitation Engineering, IEEE Transactions on. 2003 Jun;11(2):159–161. Available from: http://dx.doi.org/10.1109/TNSRE.2003.814435.
- View Article
- Google Scholar
8. Kübler A, Nijboer F, Mellinger J, Vaughan TM, Pawelzik H, Schalk G, et al. Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface. Neurology. 2005;64(10):1775–1777. Available from: http://www.neurology.org/content/64/10/1775.short. pmid:15911809
- View Article
- PubMed/NCBI
- Google Scholar
9. Pfurtscheller G, Müller-Putz GR, Schlögl A, Graimann B, Scherer R, Leeb R, et al. 15 years of BCI research at Graz University of Technology: current projects. Neural Systems and Rehabilitation Engineering, IEEE Transactions on. 2006 Jun;14(2):205–210. Available from: http://dx.doi.org/10.1109/TNSRE.2006.875528.
- View Article
- Google Scholar
10. Cincotti F, Mattia D, Aloise F, Bufalari S, Schalk G, Oriolo G, et al. Non-invasive brain-computer interface system: towards its application as assistive technology. Brain Research Bulletin. 2008 Apr;75(6):796–803. Available from: http://dx.doi.org/10.1016/j.brainresbull.2008.01.007. pmid:18394526
- View Article
- PubMed/NCBI
- Google Scholar
11. Scherer R, Müller-Putz GR, Pfurtscheller G. Flexibility and practicality: Graz Brain-Computer Interface approach. International review of neurobiology. 2009;86:119–131. Available from: http://www.sciencedirect.com/science/article/pii/S0074774209860091. pmid:19607995
- View Article
- PubMed/NCBI
- Google Scholar
12. Blankertz B, Sannelli C, Halder S, Hammer EM, Kübler A, Müller KR, et al. Neurophysiological predictor of SMR-based BCI performance. Neuroimage. 2010 Jul;51(4):1303–1309. Available from: http://dx.doi.org/10.1016/j.neuroimage.2010.03.022. pmid:20303409
- View Article
- PubMed/NCBI
- Google Scholar
13. McFarland DJ, Sarnacki WA, Wolpaw JR. Electroencephalographic (EEG) control of three-dimensional movement. Journal of Neural Engineering. 2010;7(3):036007. Available from: http://iopscience.iop.org/1741-2560/7/3/036007. pmid:20460690
- View Article
- PubMed/NCBI
- Google Scholar
14. Lotte F, Van Langhenhove A, Lamarche F, Ernest T, Renard Y, Arnaldi B, et al. Exploring large virtual environments by thoughts using a brain-computer interface based on motor imagery and high-level commands. Presence: teleoperators and virtual environments. 2010;19(1):54–70. Available from: http://www.mitpressjournals.org/doi/abs/10.1162/pres.19.1.54.
- View Article
- Google Scholar
15. Vidaurre C, Kawanabe M, von Bünau P, Blankertz B, Müller KR. Toward unsupervised adaptation of LDA for brain-computer interfaces. Biomedical Engineering, IEEE Transactions on. 2011 Mar;58(3):587–597. Available from: http://dx.doi.org/10.1109/TBME.2010.2093133.
- View Article
- Google Scholar
16. LaFleur K, Cassady K, Doud A, Shades K, Rogin E, He B. Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain-computer interface. Journal of Neural Engineering. 2013 Aug;10(4):046003. Available from: http://dx.doi.org/10.1088/1741-2560/10/4/046003. pmid:23735712
- View Article
- PubMed/NCBI
- Google Scholar
17. Pfurtscheller G, Lopes da Silva FH. Event-related EEG/MEG synchronization and desynchronization: basic principles. Clinical Neurophysiology. 1999;110(11):1842–1857. Available from: http://www.sciencedirect.com/science/article/pii/S1388245799001418. pmid:10576479
- View Article
- PubMed/NCBI
- Google Scholar
18. Halder S, Agorastos D, Veit R, Hammer EM, Lee S, Varkuti B, et al. Neural mechanisms of brain-computer interface control. Neuroimage. 2011 Apr;55(4):1779–1790. Available from: http://dx.doi.org/10.1016/j.neuroimage.2011.01.021. pmid:21256234
- View Article
- PubMed/NCBI
- Google Scholar
19. Curran EA, Stokes MJ. Learning to control brain activity: a review of the production and control of EEG components for driving brain-computer interface (BCI) systems. Brain and cognition. 2003;51(3):326–336. Available from: http://www.sciencedirect.com/science/article/pii/S0278262603000368. pmid:12727187
- View Article
- PubMed/NCBI
- Google Scholar
20. Toppi J, Risetti M, Quitadamo LR, Petti M, Bianchi L, Salinari S, et al. Investigating the effects of a sensorimotor rhythm-based BCI training on the cortical activity elicited by mental imagery. Journal of Neural Engineering. 2014 Jun;11(3):035010. Available from: http://dx.doi.org/10.1088/1741-2560/11/3/035010. pmid:24835634
- View Article
- PubMed/NCBI
- Google Scholar
21. Allison BZ, Neuper C. Could anyone use a BCI? In: Brain-computer interfaces. Springer; 2010. p. 35–54. Available from: http://dx.doi.org/10.1007/978-1-84996-272-8_3.
22. Vidaurre C, Pascual J, Ramos-Murguialday A, Lorenz R, Blankertz B, Birbaumer N, et al. Neuromuscular electrical stimulation induced brain patterns to decode motor imagery. Clinical Neurophysiology. 2013 Sep;124(9):1824–1834. Available from: http://dx.doi.org/10.1016/j.clinph.2013.03.009. pmid:23642833
- View Article
- PubMed/NCBI
- Google Scholar
23. Lotte F, Larrue F, Mühl C. Flaws in current human training protocols for spontaneous Brain-Computer Interfaces: lessons learned from instructional design. Frontiers in Human Neuroscience. 2013;7:568. Available from: http://dx.doi.org/10.3389/fnhum.2013.00568. pmid:24062669
- View Article
- PubMed/NCBI
- Google Scholar
24. Kübler A, Neumann N, Wilhelm B, Hinterberger T, Birbaumer N. Predictability of Brain-Computer Communication. Journal of Psychophysiology. 2004;18(2–3):121. Available from: http://dx.doi.org/10.1027/0269-8803.18.23.121.
- View Article
- Google Scholar
25. Lotte F, Congedo M, Lécuyer A, Lamarche F, Arnaldi B, et al. A review of classification algorithms for EEG-based brain-computer interfaces. Journal of Neural Engineering. 2007;4. Available from: http://iopscience.iop.org/1741-2552/4/2/R01. pmid:17409472
- View Article
- PubMed/NCBI
- Google Scholar
26. Bashashati A, Fatourechi M, Ward RK, Birch GE. A survey of signal processing algorithms in brain-computer interfaces based on electrical brain signals. Journal of Neural Engineering. 2007;4(2):R32–R57. Available from: http://iopscience.iop.org/1741-2560/4/2/R03. pmid:17409474
- View Article
- PubMed/NCBI
- Google Scholar
27. Fatourechi M, Bashashati A, Ward RK, Birch GE. EMG and EOG artifacts in brain computer interface systems: A survey. Clinical Neurophysiology. 2007;118(3):480–494. Available from: http://www.sciencedirect.com/science/article/pii/S1388245706015124. pmid:17169606
- View Article
- PubMed/NCBI
- Google Scholar
28. Vidaurre C, Blankertz B. Towards a cure for BCI illiteracy. Brain Topography. 2010 Jun;23(2):194–198. Available from: http://dx.doi.org/10.1007/s10548-009-0121-6. pmid:19946737
- View Article
- PubMed/NCBI
- Google Scholar
29. Faller J, Vidaurre C, Solis-Escalante T, Neuper C, Scherer R. Autocalibration and recurrent adaptation: towards a plug and play online ERD-BCI. Neural Systems and Rehabilitation Engineering, IEEE Transactions on. 2012;20(3):313–319. Available from: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6177271.
- View Article
- Google Scholar
30. Samek W, Meinecke FC, Müller KR. Transferring Subspaces Between Subjects in Brain-Computer Interfacing. Biomedical Engineering, IEEE Transactions on. 2013 Aug;60(8):2289–2298. Available from: http://dx.doi.org/10.1109/TBME.2013.2253608.
- View Article
- Google Scholar
31. Faller J, Scherer R, Costa U, Opisso E, Medina J, Müller-Putz GR. A co-adaptive brain-computer interface for end users with severe motor impairment. PLoS One. 2014;9(7):e101168. Available from: http://dx.doi.org/10.1371/journal.pone.0101168. pmid:25014055
- View Article
- PubMed/NCBI
- Google Scholar
32. Neuper C, Scherer R, Reiner M, Pfurtscheller G. Imagery of motor actions: Differential effects of kinesthetic and visual–motor mode of imagery in single-trial EEG. Cognitive Brain Research. 2005;25(3):668–677. Available from: http://www.sciencedirect.com/science/article/pii/S0926641005002533. pmid:16236487
- View Article
- PubMed/NCBI
- Google Scholar
33. Scherer R. Towards practical Brain-Computer Interfaces: Self-paced operation and reduction of the number of EEG sensors. Ph.D. Thesis, Graz University of Technology; 2008.
34. Müller-Putz G, Scherer R, Pfurtscheller G, Neuper C. Temporal coding of brain patterns for direct limb control in humans. Frontiers in Neuroprosthetics. 2010;4:34. Available from: http://dx.doi.org/10.3389/fnins.2010.00034.
- View Article
- Google Scholar
35. Obermaier B, Neuper C, Guger C, Pfurtscheller G. Information transfer rate in a five-classes brain-computer interface. Neural Systems and Rehabilitation Engineering, IEEE Transactions on. 2001 Sep;9(3):283–288. Available from: http://dx.doi.org/10.1109/7333.948456.
- View Article
- Google Scholar
36. Curran E, Sykacek P, Stokes M, Roberts SJ, Penny W, Johnsrude I, et al. Cognitive tasks for driving a brain-computer interfacing system: a pilot study. Neural Systems and Rehabilitation Engineering, IEEE Transactions on. 2004 Mar;12(1):48–54. Available from: http://dx.doi.org/10.1109/TNSRE.2003.821372.
- View Article
- Google Scholar
37. Friedrich EVC, Neuper C, Scherer R. Whatever works: a systematic user-centered training protocol to optimize brain-computer interfacing individually. PLoS One. 2013;8(9):e76214. Available from: http://dx.doi.org/10.1371/journal.pone.0076214. pmid:24086710
- View Article
- PubMed/NCBI
- Google Scholar
38. Friedrich EVC, Scherer R, Neuper C. The effect of distinct mental strategies on classification performance for brain-computer interfaces. International Journal of Psychophysiology. 2012 Apr;84(1):86–94. Available from: http://dx.doi.org/10.1016/j.ijpsycho.2012.01.014. pmid:22289414
- View Article
- PubMed/NCBI
- Google Scholar
39. Scherer R, Friedrich EC, Allison B, Pröll M, Chung M, Cheung W, et al. Non-invasive brain-computer interfaces: Enhanced gaming and robotic control. In: Advances in Computational Intelligence. Springer; 2011. p. 362–369. Available from: http://dx.doi.org/10.1007/978-3-642-21501-8_45.
40. Scherer R, Faller J, Balderas D, Friedrich EV, Pröll M, Allison B, et al. Brain-computer interfacing: more than the sum of its parts. Soft Computing. 2013;17(2):317–331. Available from: http://dx.doi.org/10.1007/s00500-012-0895-4.
- View Article
- Google Scholar
41. Friedrich EVC, Scherer R, Neuper C. Long-term evaluation of a 4-class imagery-based brain-computer interface. Clinical Neurophysiology. 2013 May;124(5):916–927. Available from: http://dx.doi.org/10.1016/j.clinph.2012.11.010. pmid:23290926
- View Article
- PubMed/NCBI
- Google Scholar
42. Neuper C, Müller G, Kübler A, Birbaumer N, Pfurtscheller G. Clinical application of an EEG-based brain-computer interface: a case study in a patient with severe motor impairment. Clinical Neurophysiology. 2003;114(3):399–409. Available from: http://www.sciencedirect.com/science/article/pii/S1388245702003875. pmid:12705420
- View Article
- PubMed/NCBI
- Google Scholar
43. Müller-Putz GR, Scherer R, Pfurtscheller G, Rupp R. EEG-based neuroprosthesis control: a step towards clinical practice. Neuroscience Letters. 2005;382(1):169–174. Available from: http://www.sciencedirect.com/science/article/pii/S0304394005003009. pmid:15911143
- View Article
- PubMed/NCBI
- Google Scholar
44. Horki P, Bauernfeind G, Klobassa DS, Pokorny C, Pichler G, Schippinger W, et al. Detection of mental imagery and attempted movements in patients with disorders of consciousness using EEG. Frontiers in Human Neuroscience. 2014;8:1009. Available from: http://dx.doi.org/10.3389/fnhum.2014.01009. pmid:25566029
- View Article
- PubMed/NCBI
- Google Scholar
45. Scherer R, Billinger M, Wagner J, Schwarz A, Hettich DT, Bolinger E, et al. Thought-based row-column scanning communication board for individuals with cerebral palsy. Annals of Physical and Rehabilitation Medicine. 2015;58(1):14–22. Available from: http://dx.doi.org/10.1016/j.rehab.2014.11.005. pmid:25661447
- View Article
- PubMed/NCBI
- Google Scholar
46. Pfurtscheller G, Linortner P, Winkler R, Korisek G, Müller-Putz G. Discrimination of motor imagery-induced EEG patterns in patients with complete spinal cord injury. Computational Intelligence and Neuroscience. 2009; Available from: http://dx.doi.org/10.1155/2009/104180.
- View Article
- Google Scholar
47. Shenoy P, Krauledat M, Blankertz B, Rao RP, Müller KR. Towards adaptive classification for BCI. Journal of Neural Engineering. 2006;3(1):R13–R23. Available from: http://iopscience.iop.org/1741-2552/3/1/R02. pmid:16510936
- View Article
- PubMed/NCBI
- Google Scholar
48. Friedrich E, Scherer R, Faller J, Neuper C. Do user-related factors of motor impaired and able-bodied participants correlate with classification accuracy. In: Proceedings of the 5th International Brain-Computer Interface Conference 2011. Verlag der Technischen Universität Graz, Austria; 2011. p. 156–159. Available from: https://bci.tugraz.at/ProcBCIConf2011.pdf.
49. Alimardani M, Nishio S, Ishiguro H. Humanlike robot hands controlled by brain activity arouse illusion of ownership in operators. Scientific Reports. 2013;3:2396. Available from: http://dx.doi.org/10.1038/srep02396. pmid:23928891
- View Article
- PubMed/NCBI
- Google Scholar
50. Alimardani M, Nishio S, Ishiguro H. Effect of biased feedback on motor imagery learning in BCI-teleoperation system. Frontiers in Systems Neuroscience. 2014;8:52. Available from: http://dx.doi.org/10.3389/fnsys.2014.00052. pmid:24782721
- View Article
- PubMed/NCBI
- Google Scholar
51. Pichiorri F, De Vico Fallani F, Cincotti F, Babiloni F, Molinari M, Kleih SC, et al. Sensorimotor rhythm-based brain-computer interface training: the impact on motor cortical responsiveness. Journal of Neural Engineering. 2011 Apr;8(2):025020. Available from: http://dx.doi.org/10.1088/1741-2560/8/2/025020. pmid:21436514
- View Article
- PubMed/NCBI
- Google Scholar
52. Cincotti F, Pichiorri F, Aricò P, Aloise F, Leotta F, de Vico Fallani F, et al. EEG-based Brain-Computer Interface to support post-stroke motor rehabilitation of the upper limb. In: Proceedings of the Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE. 2012; p. 4112–4115. Available from: http://dx.doi.org/10.1109/EMBC.2012.6346871.
53. Ang KK, Guan C, Phua KS, Wang C, Zhou L, Tang KY, et al. Brain-computer interface-based robotic end effector system for wrist and hand rehabilitation: results of a three-armed randomized controlled trial for chronic stroke. Frontiers in Neuroengineering. 2014;7:30. Available from: http://dx.doi.org/10.3389/fneng.2014.00030. pmid:25120465
- View Article
- PubMed/NCBI
- Google Scholar
54. Ramoser H, Müller-Gerking J, Pfurtscheller G. Optimal spatial filtering of single trial EEG during imagined hand movement. Rehabilitation Engineering, IEEE Transactions on. 2000 Dec;8(4):441–446. Available from: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=895946.
- View Article
- Google Scholar
55. Müller-Gerking J, Pfurtscheller G, Flyvbjerg H. Designing optimal spatial filters for single-trial EEG classification in a movement task. Clinical Neurophysiology. 1999;110(5):787–798. Available from: http://www.sciencedirect.com/science/article/pii/S1388245798000388. pmid:10400191
- View Article
- PubMed/NCBI
- Google Scholar
56. Blankertz B, Tomioka R, Lemm S, Kawanabe M, Müller KR. Optimizing spatial filters for robust EEG single-trial analysis. Signal Processing Magazine, IEEE. 2008;25(1):41–56. Available from: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4408441.
- View Article
- Google Scholar
57. Duda RO, Hart PE, Stork DG. Pattern classification. John Wiley & Sons; 2000.
58. Scherer R, Pfurtscheller G, Neuper C. Motor imagery induced changes in oscillatory EEG components: Speed vs. accuracy. In: Proceedings of the 4th International Brain-Computer Interface Workshop and Training Course 2008. Verlag der Technischen Universität Graz, Austria; 2008. p. 186–190. Available from: https://bci.tugraz.at/ProcBCIConf2008.pdf.

[ref1] 1. Pfurtscheller G, Neuper C. Motor imagery and direct brain-computer communication. Proceedings of the IEEE. 2001;89(7):1123–1134. Available from: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=939829.
View Article
Google Scholar

[2] View Article

[3] Google Scholar

[ref2] 2. Kübler A, Kotchoubey B, Kaiser J, Wolpaw JR, Birbaumer N. Brain-computer communication: unlocking the locked in. Psychological Bulletin. 2001 May;127(3):358–375. Available from: http://psycnet.apa.org/doi/10.1037/0033-2909.127.3.358. pmid:11393301
View Article
PubMed/NCBI
Google Scholar

[5] View Article

[6] PubMed/NCBI

[7] Google Scholar

[ref3] 3. Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM. Brain-computer interfaces for communication and control. Clinical Neurophysiology. 2002 Jun;113(6):767–791. Available from: http://dx.doi.org/10.1016/S1388-2457(02)00057-3. pmid:12048038
View Article
PubMed/NCBI
Google Scholar

[9] View Article

[10] PubMed/NCBI

[11] Google Scholar

[ref4] 4. Mason S, Bashashati A, Fatourechi M, Navarro K, Birch G. A comprehensive survey of brain interface technology designs. Annals of biomedical engineering. 2007;35(2):137–169. Available from: http://link.springer.com/article/10.1007/s10439-006-9170-0. pmid:17115262
View Article
PubMed/NCBI
Google Scholar

[13] View Article

[14] PubMed/NCBI

[15] Google Scholar

[ref5] 5. Millán JDR, Rupp R, Müller-Putz GR, Murray-Smith R, Giugliemma C, Tangermann M, et al. Combining Brain-Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges. Frontiers in Neuroprosthetics. 2010;4. Available from: http://dx.doi.org/10.3389/fnins.2010.00161.
View Article
Google Scholar

[17] View Article

[18] Google Scholar

[ref6] 6. Nicolas-Alonso LF, Gomez-Gil J. Brain computer interfaces: a review. Sensors. 2012;12(2):1211–1279. Available from: http://dx.doi.org/10.3390/s120201211. pmid:22438708
View Article
PubMed/NCBI
Google Scholar

[20] View Article

[21] PubMed/NCBI

[22] Google Scholar

[ref7] 7. Millán JdR, Mouriño J. Asynchronous BCI and local neural classifiers: an overview of the Adaptive Brain Interface project. Neural Systems and Rehabilitation Engineering, IEEE Transactions on. 2003 Jun;11(2):159–161. Available from: http://dx.doi.org/10.1109/TNSRE.2003.814435.
View Article
Google Scholar

[24] View Article

[25] Google Scholar

[ref8] 8. Kübler A, Nijboer F, Mellinger J, Vaughan TM, Pawelzik H, Schalk G, et al. Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface. Neurology. 2005;64(10):1775–1777. Available from: http://www.neurology.org/content/64/10/1775.short. pmid:15911809
View Article
PubMed/NCBI
Google Scholar

[27] View Article

[28] PubMed/NCBI

[29] Google Scholar

[ref9] 9. Pfurtscheller G, Müller-Putz GR, Schlögl A, Graimann B, Scherer R, Leeb R, et al. 15 years of BCI research at Graz University of Technology: current projects. Neural Systems and Rehabilitation Engineering, IEEE Transactions on. 2006 Jun;14(2):205–210. Available from: http://dx.doi.org/10.1109/TNSRE.2006.875528.
View Article
Google Scholar

[31] View Article

[32] Google Scholar

[ref10] 10. Cincotti F, Mattia D, Aloise F, Bufalari S, Schalk G, Oriolo G, et al. Non-invasive brain-computer interface system: towards its application as assistive technology. Brain Research Bulletin. 2008 Apr;75(6):796–803. Available from: http://dx.doi.org/10.1016/j.brainresbull.2008.01.007. pmid:18394526
View Article
PubMed/NCBI
Google Scholar

[34] View Article

[35] PubMed/NCBI

[36] Google Scholar

[ref11] 11. Scherer R, Müller-Putz GR, Pfurtscheller G. Flexibility and practicality: Graz Brain-Computer Interface approach. International review of neurobiology. 2009;86:119–131. Available from: http://www.sciencedirect.com/science/article/pii/S0074774209860091. pmid:19607995
View Article
PubMed/NCBI
Google Scholar

[38] View Article

[39] PubMed/NCBI

[40] Google Scholar

[ref12] 12. Blankertz B, Sannelli C, Halder S, Hammer EM, Kübler A, Müller KR, et al. Neurophysiological predictor of SMR-based BCI performance. Neuroimage. 2010 Jul;51(4):1303–1309. Available from: http://dx.doi.org/10.1016/j.neuroimage.2010.03.022. pmid:20303409
View Article
PubMed/NCBI
Google Scholar

[42] View Article

[43] PubMed/NCBI

[44] Google Scholar

[ref13] 13. McFarland DJ, Sarnacki WA, Wolpaw JR. Electroencephalographic (EEG) control of three-dimensional movement. Journal of Neural Engineering. 2010;7(3):036007. Available from: http://iopscience.iop.org/1741-2560/7/3/036007. pmid:20460690
View Article
PubMed/NCBI
Google Scholar

[46] View Article

[47] PubMed/NCBI

[48] Google Scholar

[ref14] 14. Lotte F, Van Langhenhove A, Lamarche F, Ernest T, Renard Y, Arnaldi B, et al. Exploring large virtual environments by thoughts using a brain-computer interface based on motor imagery and high-level commands. Presence: teleoperators and virtual environments. 2010;19(1):54–70. Available from: http://www.mitpressjournals.org/doi/abs/10.1162/pres.19.1.54.
View Article
Google Scholar

[50] View Article

[51] Google Scholar

[ref15] 15. Vidaurre C, Kawanabe M, von Bünau P, Blankertz B, Müller KR. Toward unsupervised adaptation of LDA for brain-computer interfaces. Biomedical Engineering, IEEE Transactions on. 2011 Mar;58(3):587–597. Available from: http://dx.doi.org/10.1109/TBME.2010.2093133.
View Article
Google Scholar

[53] View Article

[54] Google Scholar

[ref16] 16. LaFleur K, Cassady K, Doud A, Shades K, Rogin E, He B. Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain-computer interface. Journal of Neural Engineering. 2013 Aug;10(4):046003. Available from: http://dx.doi.org/10.1088/1741-2560/10/4/046003. pmid:23735712
View Article
PubMed/NCBI
Google Scholar

[56] View Article

[57] PubMed/NCBI

[58] Google Scholar

[ref17] 17. Pfurtscheller G, Lopes da Silva FH. Event-related EEG/MEG synchronization and desynchronization: basic principles. Clinical Neurophysiology. 1999;110(11):1842–1857. Available from: http://www.sciencedirect.com/science/article/pii/S1388245799001418. pmid:10576479
View Article
PubMed/NCBI
Google Scholar

[60] View Article

[61] PubMed/NCBI

[62] Google Scholar

[ref18] 18. Halder S, Agorastos D, Veit R, Hammer EM, Lee S, Varkuti B, et al. Neural mechanisms of brain-computer interface control. Neuroimage. 2011 Apr;55(4):1779–1790. Available from: http://dx.doi.org/10.1016/j.neuroimage.2011.01.021. pmid:21256234
View Article
PubMed/NCBI
Google Scholar

[64] View Article

[65] PubMed/NCBI

[66] Google Scholar

[ref19] 19. Curran EA, Stokes MJ. Learning to control brain activity: a review of the production and control of EEG components for driving brain-computer interface (BCI) systems. Brain and cognition. 2003;51(3):326–336. Available from: http://www.sciencedirect.com/science/article/pii/S0278262603000368. pmid:12727187
View Article
PubMed/NCBI
Google Scholar

[68] View Article

[69] PubMed/NCBI

[70] Google Scholar

[ref20] 20. Toppi J, Risetti M, Quitadamo LR, Petti M, Bianchi L, Salinari S, et al. Investigating the effects of a sensorimotor rhythm-based BCI training on the cortical activity elicited by mental imagery. Journal of Neural Engineering. 2014 Jun;11(3):035010. Available from: http://dx.doi.org/10.1088/1741-2560/11/3/035010. pmid:24835634
View Article
PubMed/NCBI
Google Scholar

[72] View Article

[73] PubMed/NCBI

[74] Google Scholar

[ref21] 21. Allison BZ, Neuper C. Could anyone use a BCI? In: Brain-computer interfaces. Springer; 2010. p. 35–54. Available from: http://dx.doi.org/10.1007/978-1-84996-272-8_3.

[ref22] 22. Vidaurre C, Pascual J, Ramos-Murguialday A, Lorenz R, Blankertz B, Birbaumer N, et al. Neuromuscular electrical stimulation induced brain patterns to decode motor imagery. Clinical Neurophysiology. 2013 Sep;124(9):1824–1834. Available from: http://dx.doi.org/10.1016/j.clinph.2013.03.009. pmid:23642833
View Article
PubMed/NCBI
Google Scholar

[77] View Article

[78] PubMed/NCBI

[79] Google Scholar

[ref23] 23. Lotte F, Larrue F, Mühl C. Flaws in current human training protocols for spontaneous Brain-Computer Interfaces: lessons learned from instructional design. Frontiers in Human Neuroscience. 2013;7:568. Available from: http://dx.doi.org/10.3389/fnhum.2013.00568. pmid:24062669
View Article
PubMed/NCBI
Google Scholar

[81] View Article

[82] PubMed/NCBI

[83] Google Scholar

[ref24] 24. Kübler A, Neumann N, Wilhelm B, Hinterberger T, Birbaumer N. Predictability of Brain-Computer Communication. Journal of Psychophysiology. 2004;18(2–3):121. Available from: http://dx.doi.org/10.1027/0269-8803.18.23.121.
View Article
Google Scholar

[85] View Article

[86] Google Scholar

[ref25] 25. Lotte F, Congedo M, Lécuyer A, Lamarche F, Arnaldi B, et al. A review of classification algorithms for EEG-based brain-computer interfaces. Journal of Neural Engineering. 2007;4. Available from: http://iopscience.iop.org/1741-2552/4/2/R01. pmid:17409472
View Article
PubMed/NCBI
Google Scholar

[88] View Article

[89] PubMed/NCBI

[90] Google Scholar

[ref26] 26. Bashashati A, Fatourechi M, Ward RK, Birch GE. A survey of signal processing algorithms in brain-computer interfaces based on electrical brain signals. Journal of Neural Engineering. 2007;4(2):R32–R57. Available from: http://iopscience.iop.org/1741-2560/4/2/R03. pmid:17409474
View Article
PubMed/NCBI
Google Scholar

[92] View Article

[93] PubMed/NCBI

[94] Google Scholar

[ref27] 27. Fatourechi M, Bashashati A, Ward RK, Birch GE. EMG and EOG artifacts in brain computer interface systems: A survey. Clinical Neurophysiology. 2007;118(3):480–494. Available from: http://www.sciencedirect.com/science/article/pii/S1388245706015124. pmid:17169606
View Article
PubMed/NCBI
Google Scholar

[96] View Article

[97] PubMed/NCBI

[98] Google Scholar

[ref28] 28. Vidaurre C, Blankertz B. Towards a cure for BCI illiteracy. Brain Topography. 2010 Jun;23(2):194–198. Available from: http://dx.doi.org/10.1007/s10548-009-0121-6. pmid:19946737
View Article
PubMed/NCBI
Google Scholar

[100] View Article

[101] PubMed/NCBI

[102] Google Scholar

[ref29] 29. Faller J, Vidaurre C, Solis-Escalante T, Neuper C, Scherer R. Autocalibration and recurrent adaptation: towards a plug and play online ERD-BCI. Neural Systems and Rehabilitation Engineering, IEEE Transactions on. 2012;20(3):313–319. Available from: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6177271.
View Article
Google Scholar

[104] View Article

[105] Google Scholar

[ref30] 30. Samek W, Meinecke FC, Müller KR. Transferring Subspaces Between Subjects in Brain-Computer Interfacing. Biomedical Engineering, IEEE Transactions on. 2013 Aug;60(8):2289–2298. Available from: http://dx.doi.org/10.1109/TBME.2013.2253608.
View Article
Google Scholar

[107] View Article

[108] Google Scholar

[ref31] 31. Faller J, Scherer R, Costa U, Opisso E, Medina J, Müller-Putz GR. A co-adaptive brain-computer interface for end users with severe motor impairment. PLoS One. 2014;9(7):e101168. Available from: http://dx.doi.org/10.1371/journal.pone.0101168. pmid:25014055
View Article
PubMed/NCBI
Google Scholar

[110] View Article

[111] PubMed/NCBI

[112] Google Scholar

[ref32] 32. Neuper C, Scherer R, Reiner M, Pfurtscheller G. Imagery of motor actions: Differential effects of kinesthetic and visual–motor mode of imagery in single-trial EEG. Cognitive Brain Research. 2005;25(3):668–677. Available from: http://www.sciencedirect.com/science/article/pii/S0926641005002533. pmid:16236487
View Article
PubMed/NCBI
Google Scholar

[114] View Article

[115] PubMed/NCBI

[116] Google Scholar

[ref33] 33. Scherer R. Towards practical Brain-Computer Interfaces: Self-paced operation and reduction of the number of EEG sensors. Ph.D. Thesis, Graz University of Technology; 2008.

[ref34] 34. Müller-Putz G, Scherer R, Pfurtscheller G, Neuper C. Temporal coding of brain patterns for direct limb control in humans. Frontiers in Neuroprosthetics. 2010;4:34. Available from: http://dx.doi.org/10.3389/fnins.2010.00034.
View Article
Google Scholar

[119] View Article

[120] Google Scholar

[ref35] 35. Obermaier B, Neuper C, Guger C, Pfurtscheller G. Information transfer rate in a five-classes brain-computer interface. Neural Systems and Rehabilitation Engineering, IEEE Transactions on. 2001 Sep;9(3):283–288. Available from: http://dx.doi.org/10.1109/7333.948456.
View Article
Google Scholar

[122] View Article

[123] Google Scholar

[ref36] 36. Curran E, Sykacek P, Stokes M, Roberts SJ, Penny W, Johnsrude I, et al. Cognitive tasks for driving a brain-computer interfacing system: a pilot study. Neural Systems and Rehabilitation Engineering, IEEE Transactions on. 2004 Mar;12(1):48–54. Available from: http://dx.doi.org/10.1109/TNSRE.2003.821372.
View Article
Google Scholar

[125] View Article

[126] Google Scholar

[ref37] 37. Friedrich EVC, Neuper C, Scherer R. Whatever works: a systematic user-centered training protocol to optimize brain-computer interfacing individually. PLoS One. 2013;8(9):e76214. Available from: http://dx.doi.org/10.1371/journal.pone.0076214. pmid:24086710
View Article
PubMed/NCBI
Google Scholar

[128] View Article

[129] PubMed/NCBI

[130] Google Scholar

[ref38] 38. Friedrich EVC, Scherer R, Neuper C. The effect of distinct mental strategies on classification performance for brain-computer interfaces. International Journal of Psychophysiology. 2012 Apr;84(1):86–94. Available from: http://dx.doi.org/10.1016/j.ijpsycho.2012.01.014. pmid:22289414
View Article
PubMed/NCBI
Google Scholar

[132] View Article

[133] PubMed/NCBI

[134] Google Scholar

[ref39] 39. Scherer R, Friedrich EC, Allison B, Pröll M, Chung M, Cheung W, et al. Non-invasive brain-computer interfaces: Enhanced gaming and robotic control. In: Advances in Computational Intelligence. Springer; 2011. p. 362–369. Available from: http://dx.doi.org/10.1007/978-3-642-21501-8_45.

[ref40] 40. Scherer R, Faller J, Balderas D, Friedrich EV, Pröll M, Allison B, et al. Brain-computer interfacing: more than the sum of its parts. Soft Computing. 2013;17(2):317–331. Available from: http://dx.doi.org/10.1007/s00500-012-0895-4.
View Article
Google Scholar

[137] View Article

[138] Google Scholar

[ref41] 41. Friedrich EVC, Scherer R, Neuper C. Long-term evaluation of a 4-class imagery-based brain-computer interface. Clinical Neurophysiology. 2013 May;124(5):916–927. Available from: http://dx.doi.org/10.1016/j.clinph.2012.11.010. pmid:23290926
View Article
PubMed/NCBI
Google Scholar

[140] View Article

[141] PubMed/NCBI

[142] Google Scholar

[ref42] 42. Neuper C, Müller G, Kübler A, Birbaumer N, Pfurtscheller G. Clinical application of an EEG-based brain-computer interface: a case study in a patient with severe motor impairment. Clinical Neurophysiology. 2003;114(3):399–409. Available from: http://www.sciencedirect.com/science/article/pii/S1388245702003875. pmid:12705420
View Article
PubMed/NCBI
Google Scholar

[144] View Article

[145] PubMed/NCBI

[146] Google Scholar

[ref43] 43. Müller-Putz GR, Scherer R, Pfurtscheller G, Rupp R. EEG-based neuroprosthesis control: a step towards clinical practice. Neuroscience Letters. 2005;382(1):169–174. Available from: http://www.sciencedirect.com/science/article/pii/S0304394005003009. pmid:15911143
View Article
PubMed/NCBI
Google Scholar

[148] View Article

[149] PubMed/NCBI

[150] Google Scholar

[ref44] 44. Horki P, Bauernfeind G, Klobassa DS, Pokorny C, Pichler G, Schippinger W, et al. Detection of mental imagery and attempted movements in patients with disorders of consciousness using EEG. Frontiers in Human Neuroscience. 2014;8:1009. Available from: http://dx.doi.org/10.3389/fnhum.2014.01009. pmid:25566029
View Article
PubMed/NCBI
Google Scholar

[152] View Article

[153] PubMed/NCBI

[154] Google Scholar

[ref45] 45. Scherer R, Billinger M, Wagner J, Schwarz A, Hettich DT, Bolinger E, et al. Thought-based row-column scanning communication board for individuals with cerebral palsy. Annals of Physical and Rehabilitation Medicine. 2015;58(1):14–22. Available from: http://dx.doi.org/10.1016/j.rehab.2014.11.005. pmid:25661447
View Article
PubMed/NCBI
Google Scholar

[156] View Article

[157] PubMed/NCBI

[158] Google Scholar

[ref46] 46. Pfurtscheller G, Linortner P, Winkler R, Korisek G, Müller-Putz G. Discrimination of motor imagery-induced EEG patterns in patients with complete spinal cord injury. Computational Intelligence and Neuroscience. 2009; Available from: http://dx.doi.org/10.1155/2009/104180.
View Article
Google Scholar

[160] View Article

[161] Google Scholar

[ref47] 47. Shenoy P, Krauledat M, Blankertz B, Rao RP, Müller KR. Towards adaptive classification for BCI. Journal of Neural Engineering. 2006;3(1):R13–R23. Available from: http://iopscience.iop.org/1741-2552/3/1/R02. pmid:16510936
View Article
PubMed/NCBI
Google Scholar

[163] View Article

[164] PubMed/NCBI

[165] Google Scholar

[ref48] 48. Friedrich E, Scherer R, Faller J, Neuper C. Do user-related factors of motor impaired and able-bodied participants correlate with classification accuracy. In: Proceedings of the 5th International Brain-Computer Interface Conference 2011. Verlag der Technischen Universität Graz, Austria; 2011. p. 156–159. Available from: https://bci.tugraz.at/ProcBCIConf2011.pdf.

[ref49] 49. Alimardani M, Nishio S, Ishiguro H. Humanlike robot hands controlled by brain activity arouse illusion of ownership in operators. Scientific Reports. 2013;3:2396. Available from: http://dx.doi.org/10.1038/srep02396. pmid:23928891
View Article
PubMed/NCBI
Google Scholar

[168] View Article

[169] PubMed/NCBI

[170] Google Scholar

[ref50] 50. Alimardani M, Nishio S, Ishiguro H. Effect of biased feedback on motor imagery learning in BCI-teleoperation system. Frontiers in Systems Neuroscience. 2014;8:52. Available from: http://dx.doi.org/10.3389/fnsys.2014.00052. pmid:24782721
View Article
PubMed/NCBI
Google Scholar

[172] View Article

[173] PubMed/NCBI

[174] Google Scholar

[ref51] 51. Pichiorri F, De Vico Fallani F, Cincotti F, Babiloni F, Molinari M, Kleih SC, et al. Sensorimotor rhythm-based brain-computer interface training: the impact on motor cortical responsiveness. Journal of Neural Engineering. 2011 Apr;8(2):025020. Available from: http://dx.doi.org/10.1088/1741-2560/8/2/025020. pmid:21436514
View Article
PubMed/NCBI
Google Scholar

[176] View Article

[177] PubMed/NCBI

[178] Google Scholar

[ref52] 52. Cincotti F, Pichiorri F, Aricò P, Aloise F, Leotta F, de Vico Fallani F, et al. EEG-based Brain-Computer Interface to support post-stroke motor rehabilitation of the upper limb. In: Proceedings of the Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE. 2012; p. 4112–4115. Available from: http://dx.doi.org/10.1109/EMBC.2012.6346871.

[ref53] 53. Ang KK, Guan C, Phua KS, Wang C, Zhou L, Tang KY, et al. Brain-computer interface-based robotic end effector system for wrist and hand rehabilitation: results of a three-armed randomized controlled trial for chronic stroke. Frontiers in Neuroengineering. 2014;7:30. Available from: http://dx.doi.org/10.3389/fneng.2014.00030. pmid:25120465
View Article
PubMed/NCBI
Google Scholar

[181] View Article

[182] PubMed/NCBI

[183] Google Scholar

[ref54] 54. Ramoser H, Müller-Gerking J, Pfurtscheller G. Optimal spatial filtering of single trial EEG during imagined hand movement. Rehabilitation Engineering, IEEE Transactions on. 2000 Dec;8(4):441–446. Available from: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=895946.
View Article
Google Scholar

[185] View Article

[186] Google Scholar

[ref55] 55. Müller-Gerking J, Pfurtscheller G, Flyvbjerg H. Designing optimal spatial filters for single-trial EEG classification in a movement task. Clinical Neurophysiology. 1999;110(5):787–798. Available from: http://www.sciencedirect.com/science/article/pii/S1388245798000388. pmid:10400191
View Article
PubMed/NCBI
Google Scholar

[188] View Article

[189] PubMed/NCBI

[190] Google Scholar

[ref56] 56. Blankertz B, Tomioka R, Lemm S, Kawanabe M, Müller KR. Optimizing spatial filters for robust EEG single-trial analysis. Signal Processing Magazine, IEEE. 2008;25(1):41–56. Available from: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4408441.
View Article
Google Scholar

[192] View Article

[193] Google Scholar

[ref57] 57. Duda RO, Hart PE, Stork DG. Pattern classification. John Wiley & Sons; 2000.

[ref58] 58. Scherer R, Pfurtscheller G, Neuper C. Motor imagery induced changes in oscillatory EEG components: Speed vs. accuracy. In: Proceedings of the 4th International Brain-Computer Interface Workshop and Training Course 2008. Verlag der Technischen Universität Graz, Austria; 2008. p. 186–190. Available from: https://bci.tugraz.at/ProcBCIConf2008.pdf.

Figures

Abstract

Introduction

Results

Discussion

Motor imagery tasks

“Brain-teasers” vs. “dynamic imagery” mental tasks

Between-day model transfer

Conclusion

Methods

Participants

Recordings

Experimental paradigm

Data Analysis.

Within-day variability analysis.

Between-day variability Analysis.

Acknowledgments

Author Contributions

References