71.0%65.0%–76.3%Single seed — the highest of the seeds run (see Stability)
0.680Mean across held-out participants
15
10
55.5 s
TS+LRClassical method · OAS · 4–40 Hz · primary row · Local Ubuntu / CPU
Supervised fit
58.9%54.9%–63.9%
0.534Mean across held-out participants
15
10
—
MDMClassical method · OAS · 4–40 Hz · secondary row · Local Ubuntu / CPU
Supervised fit
53.8%50.8%–57.9%
0.420Mean across held-out participants
15
10
—
ShallowFBCSPNetCompact model · matrix recipe · AdamW · Apple M5 / MPS
Scratch · 20 epochs
68.8%63.4%–73.9%
0.672Mean across held-out participants
15
10
—
Deep4NetCompact model · matrix recipe · AdamW · Apple M5 / MPS
Scratch · 20 epochs
68.6%63.3%–74.0%
0.659Mean across held-out participants
15
10
—
Scoring time covers fitting and prediction in this configuration, may include accelerator waiting, and excludes data preparation. Scoring time is not recorded for the rows of core-matrix-update-20261106.
Not applicable under this protocol:Standard CCA, FBCCA (they need the stimulation frequencies, and this protocol has none); Temporal ridge, XDAWNCov+TS+LR, xDAWN+LDA (they model the waveform of a stimulus-locked transient potential, and this protocol's classes are not defined by one).
Inspect point estimates and 95% intervals side by side on a shared axis. Paired differences appear only where a paired interval is published. Dropdowns are grouped by family alphabetically — never ordered by score.
One fixed configuration per method: library or MOABB-reference settings with the stated deviations. The 4–40 Hz band-pass (or demeaning plus 50 Hz decimation on the ERP protocols) is part of the recipe and is applied to each window on its own.
TS+LR: Primary row · one fixed configuration (MOABB-reference settings)
MDM: Secondary row · one fixed configuration (MOABB-reference settings)
ShallowFBCSPNet, Deep4Net and CSP+LDA under the matrix recipe
Each difference is the mean over people of each person’s difference in balanced accuracy, in percentage points (pp), on the same windows and people.
Riemannian and xDAWN baselines
Difference
Mean (pp)
98.75% interval, Bonferroni-adjusted for four contrasts
95% interval, unadjusted
Reading
TS+LR − Spectral ridgeTS+LR · OAS · 4–40 Hz
+4.0 pp
−1.1 to 11.5
−0.3 to 9.7
unresolved
Paired participant bootstrap (10,000 draws). The four contrasts against the Spectral ridge cells carry 98.75 % intervals (Bonferroni over four); the other contrasts carry nominal 95 % intervals with no familywise claim. 'Higher' or 'lower' means the interval lies wholly above or below zero; 'unresolved' means it includes zero.
Ten people: a percentile bootstrap over ten people tends to give intervals narrower than their nominal level.
ShallowFBCSPNet, Deep4Net and CSP+LDA under the matrix recipe
against the matrix's one-seed EEGNet cell; training variance not included
Difference
Mean (pp)
95% interval, unadjusted
Bonferroni interval over 18 contrasts
Reading
Deep4Net − EEGNet
−2.4 pp
−6.8 to 2.3
−8.6 to 5.2
unresolved
ShallowFBCSPNet − EEGNet
−2.2 pp
−8.0 to 3.4
−10.8 to 5.7
unresolved
The paired 95 % interval governs the wording; the Bonferroni interval beside it covers all 18 contrasts. Read at 95 % without correction, about one in 20 contrasts with no true difference may show one by chance.
Beside the core matrix
Log band-power ridge (5 bands, visible channels)
Five log band powers (1–4, 4–8, 8–13, 13–30 and 30–45 Hz) per channel on all recorded channels of the protocol, from one Hann periodogram of each published window after removing each channel's window mean and a per-window robust amplitude scaling, read by the core ridge head (alpha 100) on the published windows and participant-held-out folds. It uses the same windows, people, folds and ridge head as the Spectral ridge row, repeated from the table above.
Each difference is this row minus the named row on the same people, with a paired participant bootstrap (10,000 draws): an interval wholly above zero reads above, wholly below reads below, and one that includes zero reads not separated, which does not show the two are equivalent. The intervals are descriptive, conditional on these folds, with no multiplicity correction.
Minus the Spectral ridge row: +2.42 pp (−1.17 to +5.83): not separated. The two rows differ in bands, normalisation, estimator, frequency range and sampling rate at once, so the difference measures the whole recipe.
Minus SingLEM, the highest of the 14 frozen-encoder rows this comparison was specified against, chosen on these same test folds: −14.67 pp (−19.33 to −9.75): below. Choosing it on the test folds leans the comparison against this row.
Notes on this comparator
The band-power rows in the pilot studies panels on this cohort come from their own input chains and are read on their own.
Each encoder replaces LaBraM or CBraMod in the frozen recipe above; the windows, people, folds, ridge head and scoring stay the same. Rows are grouped by model family; a row is above or below another only where their 95% intervals do not overlap. Each interval is a descriptive participant bootstrap with no multiplicity correction, and with 126 frozen cells an occasional non-overlap is expected by chance. Every encoder sees this protocol’s published windows, usually shorter than its pretraining context.
Spectral ridge
54.9% (53.2%–56.7%)
CSP+LDA
47.1% (43.8%–50.2%)
LaBraM
53.5% (51.4%–55.4%)
CBraMod
62.9% (59.6%–66.5%)
EEGNet
71.0% (65.0%–76.3%)
REVE Base
66.2% (61.8%–70.6%)
REVE Large
70.2% (64.0%–76.1%)
LUNA Base
52.6% (50.2%–54.9%)
LUNA Large
49.9% (46.6%–53.5%)
BrainOmni Base
58.8% (57.0%–60.8%)
CodeBrain
58.8% (54.5%–62.6%)
EEGMamba
67.3% (63.6%–70.6%)
ST-EEGFormer Base
58.1% (53.7%–63.3%)
ST-EEGFormer Large
62.4% (57.4%–67.8%)
eeg-fm-masking MAE (r=9 cm, L=2)
68.1% (64.3%–72.3%)
ERP-FM Base
54.8% (51.8%–57.8%)
SingLEM
72.0% (66.6%–76.6%)
ZUNA 1.1
50.7% (49.2%–52.1%)
0%25%50%75%100%
Balanced accuracy under this protocol. Grey: the released rows above; rust: the further encoders, in family order. Dot: the estimate; line: 95% interval; dashed line: chance level.
not in the authors' published pretraining list (checked 2026-10-04)source ↗
ZUNA 1.113Foundation modelModel card: research use only, not for diagnosis or clinical use.
Frozen encoder + ridge head
50.7%49.2%–52.1%Interval reaches chance level
0.499
15
10
Exposure unknownunknown: the authors do not list their pretraining data closely enough to decidesource ↗
Pretraining exposure is what each model’s authors publish as their pretraining list, checked on 2026-10-04: a dataset absent from it is “not in the authors’ published pretraining list”, which is not proof that its recordings were never seen. ST-EEGFormer lists BETA and SingLEM lists TMNRED; ZUNA 1.1 publishes no list, so every one of its cells is unknown; EEGMamba’s list is read from its official code (its paper was not read), with medium confidence.
Row footnotes
Input removes the per-segment per-channel mean before the published /100 scaling (declared before scoring); a no-mean-removal sensitivity run scores P300 0.71 percentage points higher and sleep 1.40 lower.
Input removes the per-segment per-channel mean (declared before scoring); the no-mean-removal sensitivity run scores P300 2.06 percentage points lower and sleep 0.93 lower.
Resampled to 256 Hz and truncated to whole 40-sample patches; 1-2 s windows and 4-8 channel montages are outside the authors' tested regime.
As LUNA Base. Frozen probes only.
p300-target and semantic-target not run: the 2 s tokenizer window cannot be met by 1 s segments without zero padding. Upstream common average reference kept on 4-8 channel montages.
Published CBraMod pooling (patch mean, channels kept); LoRA effectively adapts only the V projection (1-token attention window upstream).
Published CBraMod pooling; LoRA on Mamba2 in_proj and out_proj (24 targets).
BETA cells are pretraining-exposed (BETA is in the ST-EEGFormer corpus).
BETA cells are pretraining-exposed. The authors' downstream class (1-based temporal index) was used; Large may have been pretrained with a 0-based index. Frozen probes only.
Paper-recommended masking geometry; channel-retained pooling (C x 512). Three sibling checkpoints appear in the masking ablation panel.
In design: p300-target and semantic-target. The other six protocols are negative controls outside the model's design. ERP windows have no pre-stimulus baseline.
semantic-target is pretraining-exposed (TMNRED is in the SingLEM corpus). Each channel is encoded independently; the last 0.25 s of each 2 s segment is not seen by the tokenizer.
Pretraining exposure unknown for every core dataset (no published source list). Encoder only; no channel upsampling or reconstruction.
A sibling of the paper-recommended checkpoint in the masking ablation: the same architecture, corpus and recipe, another masking framework or geometry.
Masking ablation: three sibling checkpoints of eeg-fm-masking
Intervals are marginal: the same people under two checkpoints are not tested as a pair.
not in the authors' published pretraining list (checked 2026-10-04)source ↗
Weights licences and terms
REVE Base · REVE Large: REVE Responsible Use License v1.0 (owner-approved 2026-10-04)REVE Responsible Use License v1.0: aggregate scientific results only; no re-identification, model inversion, membership inference or non-consensual profiling; cite the REVE paper and name the model version; no adapted weights shared.Model versions: REVE Base @ dc2a075c · REVE Large @ 317531c7.paper ↗
LUNA Base · LUNA Large: CC BY-ND 4.0 (owner-approved: internal adaptation, aggregate scores only, no adapted weights or LoRA deltas shared)CC BY-ND 4.0 weights: scores from internal probing/adaptation only; no modified weights, LoRA or adapter deltas are shared; no implied endorsement by the LUNA authors; the LUNA name is not used to suggest an official release.paper ↗
ST-EEGFormer Base · ST-EEGFormer Large: MIT (repo LICENSE; README reserves the paper, diagrams and the name)MIT (repository LICENSE; the README reserves the paper, diagrams and the ST-EEGFormer name).paper ↗
eeg-fm-masking MAE (r=9 cm, L=2) · eeg-fm-masking JEPA (r=9 cm, L=2) · eeg-fm-masking MAE (r=one channel, L=1) · eeg-fm-masking JEPA (r=one channel, L=1): CC-BY-4.0 (cite arXiv:2609.33487)CC-BY-4.0 weights: attribution required (cite arXiv:2609.33487).paper ↗
SingLEM: MIT (checkpoint committed in the MIT repository)MIT.paper ↗
ZUNA 1.1: Apache-2.0; model card: research use only, not for diagnosis or clinical useApache-2.0 weights; model card states research use only, not for diagnosis or clinical use.paper ↗
No model’s authors endorse these results, and no adapted weights or LoRA deltas were kept or shared.
Notes on these rows
REVE Base: REVE input removes the per-segment per-channel mean (declared before scoring; the published LaBraM/CBraMod rows did not); a no-mean-removal sensitivity run is stated in the row footnote.
REVE Large: REVE input removes the per-segment per-channel mean (declared before scoring); a no-mean-removal sensitivity run is stated in the row footnote.
LUNA Base: LUNA resamples to 256 Hz and keeps whole 40-sample patches: 1 s keeps 240/256 samples, 2 s keeps 480/512.
LUNA Large: LUNA resamples to 256 Hz and keeps whole 40-sample patches: 1 s keeps 240/256 samples, 2 s keeps 480/512. Point estimate at chance; reported as is.
ST-EEGFormer Large: ST-EEGFormer Large uses the authors' downstream class (1-based temporal index); a label-free reconstruction check suggests Large was pretrained with a 0-based index, so its temporal sinusoid may be shifted by one position.
ERP-FM Base: Outside the ERP-FM design: negative control.
SingLEM: SingLEM tokenizer (128-sample tokens, stride 96 at 128 Hz) leaves the last 0.25 s of every 2 s segment unseen.
ZUNA 1.1: ZUNA pretraining sources are not published: exposure unknown on every core dataset. 0-4 electrode coordinates per protocol are clamped to the edge of the +-0.12 m position grid as upstream does.
EEGPT ran in the same runs as the published LaBraM and CBraMod rows above, with only the encoder swapped: the same windows, people, folds, ridge head and scoring.
Spectral ridge
54.9% (53.2%–56.7%)
CSP+LDA
47.1% (43.8%–50.2%)
LaBraM
53.5% (51.4%–55.4%)
CBraMod
62.9% (59.6%–66.5%)
EEGNet
71.0% (65.0%–76.3%)
EEGPT
58.3% (54.9%–61.8%)
0%25%50%75%100%
Balanced accuracy under this protocol. Grey: the released rows above; rust: EEGPT. Dot: the estimate; line: 95% interval; dashed line: chance level.
not in the authors' published pretraining list (checked 2026-10-12)source ↗
Footnotes to this row
ds003810 is recorded at 125 Hz; its windows reach the encoder upsampled to 256 Hz, so they carry nothing above 62.5 Hz.
Every core window is shorter than EEGPT’s 4-second pretraining window: 1 or 2 seconds, and sleep as fifteen 2-second segments. The encoder computes each 0.25-second patch the same way at any length; a shorter window gives fewer patches to average.
The readout is the site’s fixed probe on the frozen summary tokens, as for the published LaBraM and CBraMod rows: ridge (alpha 100) on 2,048 pooled values, and on idle a per-person logistic head. It is not the authors’ downstream probe, a learnable spatial filter with a linear head, and the windows are fed without the average reference EEGPT was pretrained with.
Against the published rows
Each row of the table above that experiments.json holds, by whether its 95% interval and EEGPT’s overlap (no multiplicity correction):
Spectral ridge: the intervals overlap
CSP+LDA: EEGPT above, the intervals 4.67 pp apart
LaBraM: the intervals overlap
CBraMod: the intervals overlap
EEGNet: EEGPT below, the intervals 3.25 pp apart
EEGPT’s exposure is read from its authors’ published pretraining list, checked on 2026-10-12, as for the further encoders. Its pretraining corpus: Five public datasets, as the paper’s Table 1 lists them: PhysioMI (PhysioNet motor imagery and execution), HGD, TSU (the Tsinghua 40-target SSVEP benchmark), SEED and M3CV; 58 electrodes, 256 Hz, millivolts, average reference, 4-second windows.
Licence and terms
Code licence: Apache-2.0 (the repository’s source code only)
Weights licence: unresolved: the checkpoint’s own licence and terms could not be read from its hosting record, and the repository’s code licence is not evidence that it covers the weights
Weights: no original or converted weights are distributed; the hashes identify the checkpoint used and grant nothing
Rights review: Published by the owner’s decision, aggregate results only, as the pilot comparison is. The checkpoint’s licence could not be read; no publisher prohibition on independently computed aggregate results was found; no original or converted weights are distributed.
Six LaBraM at Scale encoders and REVE Small’s encoder in the same frozen recipe as the rows above: the same windows, people, folds, head and scoring, with no random-initialization control.
Balanced accuracy with its 95% interval, and macro F1, frozen encoders.
its pretraining corpus includes this protocol's dataset
Molecule-LLocal Ubuntu / CPU
59.6%57.2%–61.4%
0.577
its pretraining corpus includes this protocol's dataset
REVE Small · early checkpoint (epoch 15 of 200)
REVE SmallLocal Ubuntu / CPU
61.5%58.3%–64.8%
0.590
—
† Quark-G: Run on Local Ubuntu / CUDA; its step is read against a GPU re-run of Quark-H and includes the probe's input width doubling from 800 to 1600 under one fixed penalty (see the topic page).
Unless a cell is flagged, its dataset is not in that collection’s published pretraining list (the LaBraM at Scale pretraining manifest at faa387d9, checked 2026-11-05); REVE Small’s is read from the REVE corpus list (checked 2026-10-04).
Terms: LaBraM at Scale’s code and weights under MIT (Pan-Junyu/LaBraM-at-Scale @ a0b0ce27); REVE Small under the REVE Responsible Use License v1.0 (reve-small @ 3565bdcb), aggregate scientific results only. No weights are distributed.
Two more models · this protocol’s people and folds
Signal-JEPA and EEGSimpleConv
Signal-JEPA as a frozen encoder with a ridge head fitted on the training people, and EEGSimpleConv trained from scratch for 20 epochs, both on this protocol’s windows, people and 5 folds. Each is compared with EEGNet on the same people.
Model
Training mode
Input
Balanced accuracy
Macro F1
Difference from EEGNet
Signal-JEPAFoundation model · 3,456,852 parameters
Frozen encoder + ridge head
0.5–40 Hz band-pass, 128 Hz
67.25%63.42%–70.50%
0.669
−3.75 pp(−7.58 to −0.17)vs this page’s EEGNet cell: 71.0%against the matrix's one-seed EEGNet cell; training variance not included
EEGSimpleConvCompact model · 185,022 parameters
Trained from scratch, 20 epochs
the matrix’s 250 Hz windows
59.33%mean of three seeds
0.530
−10.14 ppvs EEGNet’s three-seed mean · no interval
Each difference is a paired comparison with EEGNet on the same people.
Notes on Signal-JEPA and EEGSimpleConv
Signal-JEPA’s input: each window band-passed 0.5–40 Hz and resampled to 128 Hz, the format it was pretrained on, in microvolts, recorded channels only. The further-encoder panel follows its own input contract, so this row sits apart from it.
Signal-JEPA’s difference is paired, on the same people, against this page’s EEGNet cell: 10,000 participant bootstrap draws, no multiplicity correction. EEGNet’s mean over its three seeds here is 69.47%.
EEGSimpleConv: the mean of three seeds, at width 64 and the matrix’s 20-epoch budget, fixed before scoring. Its difference is from EEGNet’s mean over the same three seeds and is printed without an interval.
Signal-JEPA’s model card names Lee2019 (OpenBMI) as its pretraining data.
Terms of Signal-JEPA and EEGSimpleConv
Signal-JEPA: weights MIT, as the model card at revision 51232ee0 states; code BSD-3-Clause (braindecode 1.5.1); the weights are not redistributed. paper ↗ · model card ↗
EEGSimpleConv: code BSD-3-Clause (braindecode 1.5.1); the separate author repository’s licence is unclear; trained from scratch, and no trained weights are shared. paper ↗
Ten-person laboratory task with prompted rest. This is not continuous-idle monitoring or a physical low-channel headset test.
The protocol, step by step
5 participant-disjoint folds. All recordings from a person stay together. Each person contributes to the held-out predictions once.
epoching: two seconds from the class annotation onset; amplitude: converted to microvolts according to source calibration, then per-channel epoch mean removed; resampling: none; native sampling rate retained; selection: natural file/event order; when over the cap, retain 60 evenly spaced event indices per participant/class; source_units: Microv declared by BIDS channels.tsv; EDF physical dimension is absent, so MNE returns the source numeric microvolt values without SI scaling
One fixed seed (20260919); no early stopping or test-based tuning. EEGNet trains for 20 epochs per fold. Frozen encoders use training-only standardized ridge heads (alpha 100).
run 0 is real dominant-hand movement and is excluded; only imagery runs 1-4 contribute
the source reports online 0.5-45 Hz filtering
controlled cue-locked laboratory windows; this does not measure continuous false activations
foundation-model pretraining overlap is unknown
EEGNet three-seed mean 69.47%; sample SD 1.43 percentage points; range 68.17–71.00%. Main table retains the original fixed seed; this is not a confidence interval.
Stability
EEGNet three-seed mean 69.47%; sample SD 1.43 percentage points; range 68.17–71.00%. Main table retains the original fixed seed; this is not a confidence interval.
Seeds run for EEGNet: 71.00% · 69.25% · 68.17%; mean 69.47%
Same participants, folds, preprocessing and 20-epoch budget. Three seeds measure initialization variability, not population uncertainty. Main table retains its preselected seed; no best-seed selection.
Pretraining exposure
Unknown unless explicitly documented; no unseen-pretraining claim.
One fixed configuration. Foundation encoders remain frozen; small networks train from scratch. These scores do not establish optimal fine-tuned performance. No individual predictions or participant-level results are distributed.
One fixed configuration. Foundation encoders remain frozen; small networks train from scratch. These scores do not establish optimal fine-tuned performance. No individual predictions or participant-level results are distributed. EEGNet three-seed mean 69.47%; sample SD 1.43 percentage points; range 68.17–71.00%. Main table retains the original fixed seed; this is not a confidence interval.
Model terms
Spectral ridge: Trained from scratch / deterministic reference; no third-party pretrained weights. Braindecode BSD-3-Clause; MNE/scikit-learn BSD where used.
CSP+LDA: Trained from scratch / deterministic reference; no third-party pretrained weights. Braindecode BSD-3-Clause; MNE/scikit-learn BSD where used.
LaBraM: Code/repository: MIT · Checkpoint: committed in that repository; no separate weight terms
CBraMod: Code: MIT · Weights: Apache-2.0 (official model card)
EEGNet: Trained from scratch / deterministic reference; no third-party pretrained weights. Braindecode BSD-3-Clause; MNE/scikit-learn BSD where used.
TS+LR: Deterministic; no weights. pyRiemann 0.12 and scikit-learn, BSD-3-Clause.
MDM: Deterministic; no weights. pyRiemann 0.12 and scikit-learn, BSD-3-Clause.
ShallowFBCSPNet: Trained from scratch / deterministic reference; no third-party pretrained weights. Braindecode BSD-3-Clause; MNE/scikit-learn BSD where used.
Deep4Net: Trained from scratch / deterministic reference; no third-party pretrained weights. Braindecode BSD-3-Clause; MNE/scikit-learn BSD where used.
Source and licence
ds003810
CreditPeterson et al. · OpenNeuro ds003810, version 2.0.2. Study: https://pmc.ncbi.nlm.nih.gov/articles/PMC9114495/
The dataset authors ask you to cite:Peterson V, Galván C, Hernández H, Spies R. A feasibility study of a complete low-cost consumer-grade brain-computer interface system. Heliyon 6(3):e03425 (2020).doi ↗ · as their record asks ↗
Correction on record · : The ds003810 credit links only the 2022 Data in Brief description. The OpenNeuro record asks users to cite Peterson, Galván, Hernández and Spies, Heliyon 6(3):e03425 (2020); the dataset page now gives both. Corrections register →
One training run per cell with the matrix seed and the matrix recipe: AdamW, 20 epochs (sleep 10), no schedule, no early stopping. This is the recipe of the EEGNet cells; it is not tuned for any network and it is not the original papers' training. Intervals describe variation across people, not across training runs.