I have questions related to the sleep staging process of the SHHS dataset.
How many technicians participated in the process of annotating (or labeling) the sleep stages (Wake, REM, etc.)?
Did they do the majority voting for all the sleep stages, or did they work separately?
Thank you for your time.
The technicians worked separately - each sleep recording was staged by a single technician. The group of technicians had routine meetings and quality exercises to ensure consistency over time across scorers.
You can read a bit more about the reliability/quality/consistency procedures used here: https://sleepdata.org/datasets/shhs/pages/07-reliability-shhs2.md
Thanks for being an NSRR user and for asking this question!