NSRR staff
Boston, MA
0000-0002-0506-8368
Top Topics
Recent Topics
Today I removed the MAYO PSG data from the site at the behest of the STAGES team; please do so on your end as well. The data contributor recognizes these issues in the EDFs/annotations and hopes to reprocess/fix the MAYO files at a later date.
Thanks again for raising the issue here.
Thanks for clarifying. You are correct - the original collection dates were all scrubbed from the EDFs as part of our normal de-identification process. We set all the calendar dates to 01/01/1985 - the first allowable date per the EDF specification.
My question to the STAGES team focused on the time mismatch. I opened 1-2 files from all the other sites and did not see similar mismatches. Looking back through old emails, I did see a couple mentions of the MAYO files being particularly difficult to process/harmonize, so perhaps some sort of inadvertent time shift occurred.
Thanks for raising the issue. I see what you mean in those (and other) MAYO files. I'll inquire with the STAGES data contributor.
nuMoM did not have EEG signals, so traditional sleep staging was not possible. The Stage 2 indicators you see in the annotation files represent the estimated sleep period. There is some description in the Flacco 2015 paper:
Level 3 sleep monitoring devices, as used in this study, do not record sleep directly (i.e. with EEG and electromyography signals). Therefore, sleep onset and offset and periods of prolonged wakefulness are identified by certified polysomnologists using information from both participant completed questionnaires on bed and wake times and the visualized patterns of heart rate, breathing pattern, movement and artifact. The sleep period is defined as the period between sleep onset and offset. Sleep onset is identified based on self-reported bedtime plus visualization of reduced signal artifact, decreased heart rate, regularization of breathing pattern, and stability of the position sensor (indicating a supine or lateral position). Conversely, sleep offset is identified by evidence of sustained movement artifact, changing position, increase in heart rate, and participant reported wake time. Following the initiation of sleep, segments of the study were excluded from analysis if significant movement or artifact occurred for a period of ≥ 20 minutes.
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4410772/
Thanks for using the site!
Thanks for using the site. Your choice for SHHS2 makes sense.
I also see this in MrOS (older adults): https://sleepdata.org/datasets/mros/variables/poxusual
Maybe also CFS (mostly adults; some adolescents): https://sleepdata.org/datasets/cfs/variables/desslp
There are also a couple blog posts about NSRR's harmonization efforts:
The STAGES contributor got back to me about the first question.
This question came up from another user as well which I tried to answer here: https://github.com/Stanford-STAGES/stanford-stages/issues/31 Essentially the cohorts_deid Excel file lists the studies used for the narcolepsy classification portion and not the sleep staging, however we still wanted to provide these additional EDF studies despite them not being used as controls or narcoleptics.
This question came up from another user as well which I tried to answer here: https://github.com/Stanford-STAGES/stanford-stages/issues/31
Essentially the cohorts_deid Excel file lists the studies used for the narcolepsy classification portion and not the sleep staging, however we still wanted to provide these additional EDF studies despite them not being used as controls or narcoleptics.
Unfortunately, the MESA (Exam 5) sleep journals were never entered electronically. ☹️
They were filled out on paper and scanned to PDF at the field sites. The actigraphy scorer kept the PDF open for review while scoring.
I received confirmation of the following from the STAGES data contributor:
I think the references in that supplemental documentation were discussing the possibility of using automated algorithms to further analyze the STAGES PSG data.
Hey CC - thanks for checking out the site. I agree this could be made clearer in the STAGES documentation.
Another user asked about this on the Forum last year; I provided the details I could find about the manual sleep scoring: https://sleepdata.org/forum/stages-ground-truth-hypnogram/
In short: Yes, the STAGES PSG data were scored by sleep experts.