Looking for U.S. Federal Data?

Provides key insights for curating data and the types of questions that need to be asked.

Checklist to assist with curating data rescue efforts.

gitcellar downloads and archives all repos, issues, and PRs from a GitHub organization in one shot: docs.ropensci.org/gitcellar/

According to an email: has archived 8TB+ of government sites, some from the End-of-Term-Archive seed list, some from EDGI Slack requests, and many sites independently

Has archived government datasets from data.gov, CIBP, USCIS, NOAA, NASA, NSIDC, and more

Provides a list of tools for web harvesting, etc.

Another curated list of web archiving tools

This is the workflow from the original data rescue/DataRefuge project in 2017.
Many of the tools are no longer working, but the workflow is still useful. UW used this to create their workflow above.
The challenge with the original project was where to store and how to make discoverable the large amounts of data captured.
There is a CKAN instance with some of the 2017 data.

Tool created by Jerome Paulos to show side-by-side changes in government websites.

You can get help with preparing research data management plans, through file management best practices & metadata creation, to data sharing & data archiving.

This service is for active faculty and research groups (including graduate students) who require data management plans, data curation, publication or storage of primary research data. The RDM Program offers consulting, training, and online guidance to address new requirements from funding agencies, publishers, and data providers, and to help researchers manage and steward their data effectively and efficiently.

A series of 50-minute workshops for faculty and graduate students addressing one or more components of the National Science Foundation's requirement for data management plans (DMPs).