Everything that produced the scores below — cohort, split, electrodes, window, what each method was allowed to learn, and what guessing would score — as the released protocol file states it. Compare scores within this protocol only.
Balanced accuracy (primary) · Macro F1 (secondary)
Results
Every method run under this protocol, with the score the released results file holds. Compare down this table only: other protocols differ in cohort, electrodes, window or chance level.
Spectral ridge
51.0% (49.6%–52.4%)
Temporal ridge
53.8% (51.9%–55.6%)
LaBraM
49.4% (47.7%–51.2%)
CBraMod
55.0% (53.3%–56.7%)
EEGNet
53.3% (51.7%–54.9%)
0%25%50%75%100%
Balanced accuracy, every method under this protocol. Dot: the estimate; line: descriptive 95% interval; dashed line: chance level.
Scoring time includes fitting and prediction, may include accelerator waiting, and excludes data preparation. It is configuration-specific, not a hardware benchmark.
Balanced target/nontarget sample changes the source 1:9 prevalence. One-second windows include later flashes at 0.3-second intervals; this is not an online speller estimate.
The protocol, step by step
5 participant-disjoint folds. All recordings from a person stay together. Each person contributes to the held-out predictions once.
One fixed seed (20260919); no early stopping or test-based tuning. EEGNet trains for 20 epochs per fold. Frozen encoders use training-only standardized ridge heads (alpha 100).
Research subset with fixed deterministic sampling capped at 60 epochs per participant/class.
The cap balances target and nontarget and therefore changes the original approximately 1:9 class prevalence.
Stimuli were presented about every 0.3 s, so each 1 s epoch contains responses to later stimuli; this is intrinsic next-stimulus contamination.
Stability
One fixed seed and training budget; multi-seed sensitivity pending.
Pretraining exposure
Unknown unless explicitly documented; no unseen-pretraining claim.
Notes on the methods
One fixed configuration. Foundation encoders remain frozen; small networks train from scratch. These scores do not establish optimal fine-tuned performance. No individual predictions or participant-level results are distributed.
Model terms
Spectral ridge: Trained from scratch / deterministic reference; no third-party pretrained weights. Braindecode BSD-3-Clause; MNE/scikit-learn BSD where used.
Temporal ridge: Trained from scratch / deterministic reference; no third-party pretrained weights. Braindecode BSD-3-Clause; MNE/scikit-learn BSD where used.
LaBraM: Code/repository: MIT · Checkpoint: committed in that repository; no separate weight terms
CBraMod: Code: MIT · Weights: Apache-2.0 (official model card)
EEGNet: Trained from scratch / deterministic reference; no third-party pretrained weights. Braindecode BSD-3-Clause; MNE/scikit-learn BSD where used.
Source and licence
ds006593
CreditOpenNeuro ds006593 contributors · version 1.0.0, doi:10.18112/openneuro.ds006593.v1.0.0; original author credits retained at the linked source.
BCI Report does not redistribute any recording. These are aggregate measurements computed by BCI Report under the licence above; the data belong to the people credited.
Permitted scopePersonal noncommercial research; aggregate results only