remomueller

Hi Robert,

We provide an official download tool called nsrr which is a Ruby gem.

Installation instructions for the gem are here: https://github.com/nsrr/nsrr-gem

In short, once you have Ruby installed, you can do the following two steps:

Install nsrr Ruby Gem

gem install nsrr --no-document

Finally, to download only the EDFs for chat, you can type:

nsrr download chat/polysomnography/edfs

The downloader supports pause and resume, so that it will pick up where it last left off.

The above is a screenshot of the app running through the CHAT folder

Additionally, each page in a dataset's download folder contains the specific nsrr command needed to download that particular folder once you have signed in and filled out a Data Access and Use Agreement for that particular dataset.

Hi Edward, I'm not sure if this is quite what you meant, but I went ahead and generated a treemap of the files hosted on the NSRR website. While the large sections of each dataset are primarily taken up by EDFs, they also include EDF annotations (XML), covariate datasets (CSVs), and Code Book CRFs (PDFs).

Also interesting to note is that the CHAT EDFs are much larger than other EDFs, since they contain many more signal channels for each EDF.

We may make a web version of this in the future, as it's a great way of exploring the datasets. I haven't found a good web-based treemap tool yet, although Google Charts appears to have a rudimentary one available.

Special thanks to @mcailler, @kevgleas, and @michellereid on a great job curating and finalizing the CFS dataset and data dictionary! Over 200 issues closed in the creation of this first release!

The NSRR now lets you preview EDFs in your browser using the new Altamira EDF viewer.

Once you have submitted an agreement for a dataset, you will be able to see a link to preview the EDFs in your browser as seen in the screenshot below.

We released a new update to the NSRR website yesterday that includes two features we are very excited about:

(1) Auto-Subscribe To Forum Posts

A new setting "Auto-subscribe to new posts" is now available. When enabled, this setting will notify users of new posts, such as this one, in the NSRR daily forum digest. This setting is enabled by default, and can be disabled in your settings if you wish to only receive notifications to posts that you subscribe to manually.

(2) New Data Access and Use Agreement Process

We have simplified our DAUA process to better encourage users to get access to data on the NSRR website. If you have been asked to resubmit, you can now do so through the new online process available at: https://sleepdata.org/submissions.

For students and others who had trouble attaining evidence of IRB review, the process now provides an option to allow the NSRR IRB to do the review of your proposed research. Please note that choosing this option can delay access to the data, and we only recommend this for users who do not have access to their own IRB.

We look forward to hearing from each of you so feel free to post replies and questions in the forum, as we continue to grow this resource for our sleep researcher community!

If you know anyone who may be interested in conducting research, please refer them to https://sleepdata.org, or have them contact us directly at support@sleepdata.org. Thanks!

For Ruby Enthusiasts, we also have a Ruby Gem that loads and tests EDFs called edfize.

Here's an example how to validate a folder of EDFs from command line:

$ cd EDF-DIRECTORY
$ edfize test

Here's an example of how to load an EDF in Ruby using edfize:

# Tutorial 01 - Load EDF and Signals
#
#   gem install edfize
#
#   ruby tutorial_01_load_edf_and_signals.rb
#
# The EDF exists at:
#
#    https://sleepdata.org/datasets/shhs/files/edfs/shhs1?f=shhs1-200001.edf
#

require 'rubygems'
require 'edfize'

# Loads the file and reads the EDF Header
edf = Edfize::Edf.new('shhs1-200001.edf')

# Loads the data section of the EDF into Signal objects
edf.load_signals

# Print out information on the signals
puts "EDF #{edf.filename} contains the following #{edf.signals.count} signal#{'s' unless edf.signals.count == 1}:\n\n"

edf.signals.each do |signal|
  puts "Signal"
  puts "  Label                    : #{signal.label}"
  puts "  Samples Per Data Record  : #{signal.samples_per_data_record}"
  puts "  First 10 Physical Values : #{(signal.physical_values[0..10] + ['...']).inspect}\n\n"
end

Hi Korey and welcome to the site! I'm going to forward this to our resident sleep tools expert, Dennis Dean, and hopefully he can get you started in the right direction.

Also, we do have staging files in a fairly simple format for the SHHS dataset. Here's a README.txt to get you started, and you can find the staging files here: https://sleepdata.org/datasets/shhs/files/annotations-staging

Michael Rueschman will also be preparing staging files for the CHAT dataset soon, so keep an eye out for those. Thanks!

That is correct, we released a newer version (v0.3.0) on September 4, after this post was initially made. Here are some of the changes for the v0.3.0 dataset:

• Removed extraneous variables (e.g. child_age, and eligibility criteria variables)
• Add "Treatment Arm" to standard set of Spout graphs

We have released the HeartBEAT dataset and it is now available for download!

You can request access to get your hands on the data now! @mrueschman and the rest of the Sleep Arch team will be posting the corresponding EDFs within the coming weeks.

If you have any questions regarding this dataset, feel free to post here, or email us at support@sleepdata.org.

In light of the scheduled September 1, 2014 release of the HeartBEAT dataset, @mcailler, has finalized v0.1.0 of the data dictionary. You may now view the HeartBEAT variables to get a taste of the type of data that will be made available.

Remember, you can Request Access to HeartBEAT now and be one of the first to get your hands on this data come September.