https://docs.google.com/spreadsheets/d/12-__RqTqQxuxHNOln3H5ciVztsDMJcZ2SVs1BrfqYCc/edit#gid=0
Name of Set | Priority | Org. | Web URL (Description) | Download Site (FTP/HTTP) | File Types | Est. Size (GB) | Notes | Contact (Regarding dataset) | Status? Currently being archived? By whom? | Archive Link | Archive Notes |
Carbon Dioxide Information Analysis Center | DOE/ORNL | http://cdiac.ornl.gov | ftp://ftp.ncdc.noaa.gov/pub/data/paleo/ | 2.2 GB (8.2ka – contributions) | The FTP and archive entry here is for NOAA Paleoclimate, not CDIAC; correct FTP site is cdiac.ornl.gov/pub | Done | https://climate.daknob.net/ftp.ncdc.noaa.gov/ | 8.2ka-contributions | |||
GISTEMP | NASA | http://data.giss.nasa.gov/gistemp/ | http://data.giss.nasa.gov/pub/gistemp/ | .netcdf | 1 | Done | https://climate.daknob.net/data.giss.nasa.gov/pub/gistemp/ | ||||
DOE/BNL | http://www.archive.arm.gov | ||||||||||
CarbonTracker | NOAA | http://www.esrl.noaa.gov/psd/data/gridded/data.carbontracker.html | ftp://ftp.cdc.noaa.gov/Datasets.private2/.NARRsaved/xxx/CT2007B.molefrac.nc | .nc | other_gauss ~ 22 | Done | https://climate.daknob.net/ftp.cdc.noaa.gov/Datasets/ncep.reanalysis/other_gauss/ | Only /other_gauss | |||
NCEP/NCAR Reanalysis | NOAA | http://www.esrl.noaa.gov/psd/data/gridded/data.ncep.reanalysis.html | ftp://ftp.cdc.noaa.gov/Datasets/ncep.reanalysis/ | In process as of 2016-12-13 | https://drwho.virtadpt.net/files/ftp.cdc.noaa.gov | ||||||
Planetary Data System | NASA | https://pds.nasa.gov/ | |||||||||
Sea Level Trends | NOAA | https://tidesandcurrents.noaa.gov/sltrends/sltrends.html | most or all data is already duplicated in the Permanent Service for Mean Sea Level (psmsl.org) | ||||||||
Billion-Dollar Weather and Climate Disasters | NOAA | https://www.ncdc.noaa.gov/billions/ | |||||||||
NOAA NCDC Climate Data Online | NOAA | https://www.ncdc.noaa.gov/cdo-web/ | ftp://ftp.ncdc.noaa.gov/pub/data/ | ||||||||
NCEI Land-Based Station Datasets | NOAA | https://www.ncdc.noaa.gov/data-access/land-based-station-data/land-based-datasets | |||||||||
Paleoclimatology Datasets | NOAA | https://www.ncdc.noaa.gov/data-access/paleoclimatology-data/datasets | ftp://ftp.ncdc.noaa.gov/pub/data/paleo/ | multiple | 120 (FTP Site) | In progress – by @nickrsan | ftp://paleo.climatemirror.org, https://goo.gl/5Korvf | ||||
NCEI Satellite Datasets | NOAA | https://www.ncdc.noaa.gov/data-access/satellite-data/satellite-data-access-datasets | |||||||||
Climate Extremes Index | NOAA | https://www.ncdc.noaa.gov/extremes/cei/graph/us/1/01-12 | https://www.ncdc.noaa.gov/extremes/cei/us/1/01-12/data.csv | .csv | 0 | Done | https://climate.daknob.net/www.ncdc.noaa.gov/extremes/cei/us/1/01-12/ | ||||
Global Historical Climate Network – Daily | NOAA | https://www.ncdc.noaa.gov/oa/climate/ghcn-daily/ | ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/daily/ | .txt, mostly csv | In progress – by @nickrsan | ||||||
Storm Events Database | NOAA | https://www.ncdc.noaa.gov/stormevents/details.jsp | ftp://ftp.ncdc.noaa.gov/pub/data/swdi/stormevents/csvfiles/ | .csv | In process as of 2016-12-14 | https://datarefuge.mirrors.weitnahbei.de | |||||
Climatological Rankings wer | NOAA | https://www.ncdc.noaa.gov/temp-and-precip/climatological-rankings/ | https://www.ncdc.noaa.gov/temp-and-precip/climatological-rankings/download.csv?parameter=tavg&state=110&div=0&month=11&periods[]=1&year=2013 | ||||||||
National Interagency Fire Center | NIFC | https://www.nifc.gov/fireInfo/fireInfo_statistics.html | Depends on Crawl, < 1 GB | Done | https://climate.daknob.net/www.nifc.gov/fireInfo/ | ||||||
National Snow and Ice Data Center | NSIDC | https://nsidc.org/data | this is government-funded by run autonomously by CU-Boulder; probably doesn’t need to be highest priority | ||||||||
Ocean Acidification Data Portal | NOAA | https://www.nodc.noaa.gov/oceanacidification/stewardship/data_assets.html | |||||||||
NASA Earth Science Satellites | NASA | http://daac.gsfc.nasa.gov | |||||||||
NASA Climate Consensus | NASA | http://climate.nasa.gov/scientific-consensus/ | |||||||||
EPA Facility Level GHG emissions | EPA | https://www.epa.gov/ghgreporting/ghg-reporting-program-data-sets | |||||||||
NOAA Global Monitoring Division | NOAA | http://www.esrl.noaa.gov/gmd/dv/ftpdata.html | ftp://aftp.cmdl.noaa.gov/ | ||||||||
USGS National Water Information System | USGS | http://waterdata.usgs.gov/nwis | Txt | Long-term hydrological and water-quality data sets. Free, public access. Used by managers to monitor drought and flooding and show nonstationarity in hydrological response to changing climate, including water temperatures in streams. | |||||||
Water Quality Portal | NWQMC | https://www.waterqualitydata.us/ | USGS, EPA, and many other state and municipal agencies store water quality data here. Water quality data includes temperature, sediment, and nutrient data in long term datasets that show hydrological response to climate change. Free, public access. | ||||||||
Science Base | USGS | https://www.sciencebase.gov/catalog/ | Data released with public access USGS reports on various topics including climate change | ||||||||
California Data Exchange Center | California State Gov | http://cdec.water.ca.gov/ | Real time precipitation and hydrological data for California | ||||||||
Goddard Earth Sciences Data and Information Services Center | NASA | http://daac.gsfc.nasa.gov/ | |||||||||
Climate Change Atlas | US Forest Service | http://www.fs.fed.us/nrs/atlas/ | Shows current and future species distributions on birds and trees int the eastern US | ||||||||
NorWEST Stream Temperature Database | US Forest Service | http://www.fs.fed.us/rm/boise/AWAE/projects/NorWeST.html | |||||||||
NOAA National Data Buoy Center | NOAA | http://www.ndbc.noaa.gov/ | |||||||||
USGS National Landcover Database | USGS | http://www.mrlc.gov/ | Although it doesn’t seem like it could be threatened, the NLCD is used with a lot of watershed and climate modeling | CLAIMED 2016-12-14 | |||||||
NASS Cropland Data Layer | USDA-NASS | https://nassgeodata.gmu.edu/CropScape/ | Also used with climate and watershed/landuse modeling. Used frequently with nutrient loading models | ||||||||
NASA Sea Level Change Portal Data | NASA | https://sealevel.nasa.gov/data/data-search/ | |||||||||
National Water and Climate Center | USDA-NRCS | http://www.wcc.nrcs.usda.gov | |||||||||
Oak Ridge National Laboratory DAAC | NASA-ESDIS | https://daac.ornl.gov/ | https://daac.ornl.gov/get_data.shtml | ||||||||
National Air Toxics Assessment | EPA | https://www.epa.gov/national-air-toxics-assessment | https://www.epa.gov/national-air-toxics-assessment/2011-nata-assessment-results#nationwide | ||||||||
Biological and Chemical Oceanography Data Management Office | NSF OCE & PLR | http://www.bco-dmo.org/ | http://www.bco-dmo.org/data | txt, csv, tsv, Matlab, netcdf | data from all NSF biological and chemical oceanography and some PLR awards are available from BCO-DMO; also US JGOFS and US GLOBEC program data | info@bco-dmo.org | |||||
TOGA_TAO via PMEL | NOAA | http://www.pmel.noaa.gov/tao/ | http://www.pmel.noaa.gov/tao/data_deliv/frames/main.html | ||||||||
OceanColor Web, Ocean Biology Processing Group | NASA | http://oceancolor.gsfc.nasa.gov/cms/ | http://oceandata.sci.gsfc.nasa.gov/ | NetCDF4, HDF4 | |||||||
NOAA’s National Centers for Environmental Information (NCEI) | NOAA | https://www.ncdc.noaa.gov | ftp://eclipse.ncdc.noaa.gov/pub | NetCDF | |||||||
IOOS Ocean Acidification Portal | http://www.ipacoa.org/ | ||||||||||
West Coast Ocean Data Portal (regional, not federal) | http://portal.westcoastoceans.org/about/ | ||||||||||
MACA Downscaled Climate Data for CONUS | NKN | http://climate.nkn.uidaho.edu/MACA/ | http://climate.nkn.uidaho.edu/MACA/ | NetCDF, CSV, OPeNDAP | ~10K GB | Multivariate Adaptive Constructed Analogs (MACA) for CONUS at 4km res | jabatzoglou@uidaho.edu, khegewisch@uidaho.edu | ||||
Jason SAT data | http://sealevel.jpl.nasa.gov/missions/jason3/ | ||||||||||
Historical METDATA/gridMET | NKN | http://climate.nkn.uidaho.edu/METDATA/ | http://climate.nkn.uidaho.edu/METDATA/ | NetCDF, CSV, OPeNDAP | ~5K GB | Gridded surface meteorological data for CONUS | jabatzoglou@uidaho.edu, khegewisch@uidaho.edu | ||||
Global Change Information System | USGCRP | http://data.globalchange.gov | JSON | Metadata database linking information in climate assessments to source data | rsherman@usgcrp.gov | ||||||
ORNL Daymet | ORNL | https://daymet.ornl.gov/ | https://daac.ornl.gov/cgi-bin/dataset_lister.pl?p=32 | ||||||||
Climate.gov (data catalog) | NOAA | https://www.climate.gov/ | NetCDF, CSV, shp, kml,json | ||||||||
STORET | EPA | https://www.epa.gov/waterdata/storage-and-retrieval-and-water-quality-exchange | Intended as an archive for many enviromental databases, it has a mix of water quality data including temparature and contaminants. | ||||||||
National Environmental Health Tracking Portal | CDC | https://ephtracking.cdc.gov/showHome.action | https://ephtracking.cdc.gov/DataExplorer | excel | small | The “climate change” content area has some data that only exists on this portal, including temperature, precipitation, and flood data that has been formatted to the county level. The data is from NOAA, the National Climate Assessment, and FEMA, but CDC scientists transformed the data from grids to counties (using weighted centroids). | dvq3@cdc.gov | ||||
Dataset Gallery | NOAA | https://www.climate.gov/maps-data/datasets | |||||||||
LANDSAT Archive Gallery | USGS | https://earthexplorer.usgs.gov/ | GeoTIFF | Large (hundreds TB) | Satellite imagery dating back to the mid 1980s | https://pages.awscloud.com/public-data-sets-landsat.html | LANDSAT 8 only | ||||
NOAA Land Based Datasets | NOAA/NWS | https://www.ncdc.noaa.gov/data-access/land-based-station-data/land-based-datasets | |||||||||
Precipitation-Frequency Data Server | NOAA | http://hdsc.nws.noaa.gov/hdsc/pfds/ | pdf, .csv, | Precipitation-Frequency data that Water Resources Engineers use to appropriately design dams, bridges, storm sewer, and basically any drainage feature. | |||||||
NOAA Severe Weather Data | NOAA/NWS | https://www.ncdc.noaa.gov/data-access/severe-weather | |||||||||
NOAA Marine/Ocean Data | NOAA/NWS | https://www.ncdc.noaa.gov/data-access/marineocean-data | |||||||||
NSF Arctic Data Center | NSF | https://arcticdata.io/ | https://arcticdata.io/catalog/ | NetCDF, CSV, shp, TIFF, JPEG, wav, Excel, and many others | 5TB, soon to be 10TB | NSF-funded central data management system for projects funded under the Arctic Sciences Program at NSF Polar Programs (likely a backup from early 2016 at NSIDC, as well). Inlcudes terrestrial and oceanographic observations going back decades. | jones@nceas.ucsb.edu | The service is operated at UC Santa Barbara and data are all stored on non-governmental servers there, so at this point should be secure from federal policy changes. Replication of data to NCEI is in the plans. A copy of all data are also on Amazon’s S3 service in a private bucket for the time being. | |||
NOAA Hurricane Data | NOAA | http://www.aoml.noaa.gov/hrd/data_sub/ | |||||||||
NOAA | https://catalog.data.gov/dataset/u-s-hourly-precipitation-data | ftp://ftp.ncdc.noaa.gov/pub/data/hourly_precip-3240/ | tar.Z | unknown | ncei.orders@noaa.gov | ||||||
Pesticide National Synthesis Project | USGS NAWQA: Pesticide National Synthesis Project | https://water.usgs.gov/nawqa/pnsp/usage/maps/county-level/ | txt | 1 | |||||||
LP DAAC | NASA & USGS | https://lpdaac.usgs.gov/dataset_discovery | unsure | .hdf | 1000+ | These include MODIS, ASTER, and Measures remote-sensing vegetation data | |||||
NASA | https://modis.gsfc.nasa.gov/data/dataprod/ | https://modis.gsfc.nasa.gov/data/dataprod/ | This page is the index for all MODIS data products | ||||||||
NSF | http://www.rvdata.us | http://www.rvdata.us/catalog | Varies | Unknown | Rolling Deck to Repository (R2R) archive of research vessel data | arko@ldeo.columbia.edu | |||||
Low | FSU (Florida State University) | http://samos.coaps.fsu.edu | http://samos.coaps.fsu.edu/html/nav.php?s=2 | *.nc, *.asc | Unknown | Shipboard Automated Meteorological and Oceanographic System (SAMOS) initiative archive of meteorological and near-surface oceanographic observations collected in-situ on research vessels and volunteer observing ships | samos@coaps.fsu.edu |