# Sleep staging on EESM19 scalp subset

Core-matrix protocol · Transfer to a new person

Everything that produced the scores below — cohort, split, electrodes, window, what each method was allowed to learn, and what guessing would score — as the released protocol file states it. Compare scores within this protocol only.

## The protocol at a glance

- Task: Five stages · balanced scalp-EEG sample
- Evaluation: Transfer to a new person
- Dataset: [EESM19 scalp subset](https://bci.report/datasets/eesm19/)
- People: 20
- Data: 3,000 epochs · 5 participant-disjoint folds
- Input: 6 channels · 30-second windows
- Chance level: 20.0%
- Metrics: Balanced accuracy (primary) · Macro F1 (secondary)

## Results

Every method run under this protocol, with the score the released results file holds. Compare down this table only: other protocols differ in cohort, electrodes, window or chance level.

**Balanced accuracy, every method under this protocol.** Dot: the estimate; line: descriptive 95% interval; dashed line: chance level.

- Spectral ridge: 72.2% (70.7%–73.8%)
- LaBraM: 71.1% (69.0%–73.2%)
- CBraMod: 71.3% (68.7%–73.7%)
- EEGNet: 56.5% (54.9%–58.3%)

| Method | Training mode | Balanced accuracy | Macro F1 | Channels | People | Scoring time |
| --- | --- | --- | --- | --- | --- | --- |
| Spectral ridge — Classical method | Supervised fit | 72.2% (70.7%–73.8%) | 0.705 — Mean across held-out participants | 6 | 20 | 2.6 s |
| [LaBraM](https://bci.report/methods/labram/) — Foundation model | Frozen encoder + ridge head | 71.1% (69.0%–73.2%) | 0.697 — Mean across held-out participants | 6 | 20 | 11.5 s |
| [CBraMod](https://bci.report/methods/cbramod/) — Foundation model | Frozen encoder + ridge head | 71.3% (68.7%–73.7%) | 0.702 — Mean across held-out participants | 6 | 20 | 10.2 s |
| [EEGNet](https://bci.report/methods/eegnet/) — Compact model | Scratch · 10 epochs | 56.5% (54.9%–58.3%) | 0.545 — Mean across held-out participants | 6 | 20 | 90.4 s |

Scoring time includes fitting and prediction, may include accelerator waiting, and excludes data preparation. It is configuration-specific, not a hardware benchmark.

**Not run under this protocol:** [CSP+LDA](https://bci.report/methods/csp-lda/), [ShallowFBCSPNet](https://bci.report/methods/shallowfbcspnet/), [Deep4Net](https://bci.report/methods/deep4net/), [Standard CCA](https://bci.report/methods/cca/), Temporal ridge. A method missing here was not run on this protocol — that is not a failure.

## Read with care

Balanced quality-screened scalp subset, not whole-night deployment prevalence and not ear-EEG. Frozen encoders average fifteen 2-second representations; EEGNet receives 10 epochs.

### The protocol, step by step

- 5 participant-disjoint folds. All recordings from a person stay together. Each person contributes to the held-out predictions once.
- Retain six named scalp electrodes; exclude mastoids. Drop any epoch with source per-channel missing-value flag in those six electrodes, actual nonfinite values, any channel std<0.01uV, or peak-to-peak>1000uV. Use full30s at200Hz, no further filtering/reference/amplitude transformation. Select up to30 evenly spaced eligible epochs per participant/class across available nights.
- One fixed seed (20260919); no early stopping or test-based tuning. EEGNet trains for 10 epochs per fold. Frozen encoders use training-only standardized ridge heads (alpha 100).
- Labels: Wake, N1, N2, N3, REM.
- Uniform-guessing reference: 20.00%. Scores weight participants equally. Intervals describe participant variation; cross-validation training sets overlap.
- Lightweight balanced quality-screened subset; scores do not describe natural sleep-stage prevalence or the entire73780epoch release.
- Two original corrupt sessions and boundary epochs were excluded by the uploader.
- 200Hz data may have finite replacements despite original missing-value flags; source flags are therefore enforced instead of relying on finite checks alone.
- One prediction per30s epoch. Frozen encoders pool15nonoverlapping2s segments; no sequence context across epochs.
- All nights from a participant remain together; pretraining overlap unknown.
- Quality thresholds fixed before any scores; source artifacts may remain.

### Stability

One fixed seed and training budget; multi-seed sensitivity pending.

### Pretraining exposure

Unknown unless explicitly documented; no unseen-pretraining claim.

### Notes on the methods

- One fixed configuration. Foundation encoders remain frozen; small networks train from scratch. These scores do not establish optimal fine-tuned performance. No individual predictions or participant-level results are distributed.

### Model terms

- **Spectral ridge**: Trained from scratch / deterministic reference; no third-party pretrained weights. Braindecode BSD-3-Clause; MNE/scikit-learn BSD where used.
- **LaBraM**: Code/repository: MIT · Checkpoint: committed in that repository; no separate weight terms
- **CBraMod**: Code: MIT · Weights: Apache-2.0 (official model card)
- **EEGNet**: Trained from scratch / deterministic reference; no third-party pretrained weights. Braindecode BSD-3-Clause; MNE/scikit-learn BSD where used.

## Source and licence

### EESM19 scalp subset

**Credit** Kaare B. Mikkelsen et al. · Accurate whole-night sleep monitoring with dry-contact ear-EEG (2019), doi:10.1038/s41598-019-53115-3; OpenNeuro ds005185 v1.0.2. Processed mirror: Zachary1150/EESM19-Processed.

**Licence** [CC0-1.0 declared by upstream and mirror ↗](https://creativecommons.org/publicdomain/zero/1.0/)

[Dataset record ↗](https://doi.org/10.18112/openneuro.ds005185.v1.0.2) · [Every result on this dataset →](https://bci.report/datasets/eesm19/)

BCI Report does not redistribute any recording. These are aggregate measurements computed by BCI Report under the licence above; the data belong to the people credited.

**Permitted scope** Personal noncommercial research; aggregate results only

**Privacy** Only cohort aggregates are published here: no recording, no participant identifier, no per-person score. According to the 2025 data descriptor, the informed consent form did not mention publication, and before release the GDPR office of Region Midt judged the data fully anonymised: consent covered the study, and the public release rests on that anonymisation judgement. [The full review note is in the protocol JSON ↓](https://bci.report/data/sleep-scalp-protocol.json)

**Public-data register note** Clear upstream CC0 and study ethics evidence; use only the pinned scalp-signal derivative and publish aggregates, with provenance disclosed. Consent covered the study, not publication; the public release rests on a GDPR anonymization assessment (amended 2026-09-22).

**Rights reviewed** 2026-09-20 · against [doi.org ↗](https://doi.org/10.18112/openneuro.ds005185.v1.0.2) · [www.nature.com ↗](https://www.nature.com/articles/s41598-019-53115-3) · [doi.org ↗](https://doi.org/10.1038/s41597-025-04579-8)

## Reproducibility record

- Protocol id: `parallel-fixed-subject-folds-v1/eesm19-scalp-sleep`
- Dataset release: Hugging Face processed mirror of OpenNeuro ds005185 1.0.2 · mirror fb045012b58a0b755f9fedf5931dff9b64a9797f · upstream 0857858f7a2ba1582930f23eca3ec56f90a96da9
- Hardware: Local Ubuntu / CUDA
- Scoring stage sum: 114.7 s · may include accelerator waiting
- Audit record SHA-256: `e6cbf1b199bf2902b9c46e4575ebfa8aff47952625df3d71a1d720b11cc27291`
- Summary SHA-256: `b7c784c17d6b33c16ffca5df42d3fd8f3d7bf14960675a7278089c4903886567`
- Protocol SHA-256: `dace8a98e480ae7ee890dd6f498d5753a90e1573813b6e174f3c14bcbae8a8ff`

## Downloads

- [Results · CSV ↓](https://bci.report/data/sleep-scalp-results.csv)
- [Protocol · JSON ↓](https://bci.report/data/sleep-scalp-protocol.json)
- [Core matrix · JSON ↓](https://bci.report/data/experiments.json)

### Other protocols

- [Motor imagery & rest on ds003810](https://bci.report/protocols/mi-rest/)
- [Idle & command on ds005342](https://bci.report/protocols/idle/)
- [SSVEP · 8 channels on BETA](https://bci.report/protocols/beta-8ch/)
- [SSVEP · 4 channels on BETA](https://bci.report/protocols/beta-4ch/)
- [Arithmetic & rest on EEGMAT](https://bci.report/protocols/arithmetic-rest/)
- [P300 target ERP on ds006593](https://bci.report/protocols/p300-target/)
- [Semantic target ERP on TMNRED / ds005383](https://bci.report/protocols/semantic-target/)

[All protocols →](https://bci.report/protocols/) · [The core matrix on the home page →](https://bci.report/#overview) · [All datasets →](https://bci.report/datasets/) · [All methods →](https://bci.report/methods/)

---
Markdown copy of https://bci.report/protocols/sleep-scalp/, generated from the published page. Figures are aggregate results; terms of use: https://bci.report/data-use/