Home » Posts tagged 'Lostdocs'
Tag Archives: Lostdocs
Sunsetting FGI Lostdocs project
File this under “all good things must come to an end.” Since 2009, we here at FGI have been posting “fugitive” federal government publications (now called “unreported” documents or those documents that should be part of the Federal Depository Library Program (FDLP) but have slipped through the cracks and remain uncatalogued and unpreserved) and advocating for the community to hunt for and report those documents to GPO. Through these efforts, thousands of unreported documents were sent in to GPO and made available for the long-term through FDLP libraries and GPO. We couldn’t have done it without the help of the many volunteers throughout the FDLP that have sent us their receipts of when they reported those documents to GPO. And we also couldn’t have done it without the dedication of folks like Daniel Cornwall, Jeffrey Hartsell-Gundy, and Meredith Johnston who helped by checking the Lostdocs email acct and posting new publications to the blog. I just archived the site in the Internet Archive’s Wayback machine for posterity. Thanks again everyone for the work that you do in making sure federal publications are curated, described, preserved, and made available long-term! Please keep reporting those documents to GPO. It’s critically important!!
That is all.
Trump Administration Buries Dozens Of Clean Energy Studies
“Documents obtained by InvestigateWest identify at least 46 reports from almost every program within the U.S. Energy Department’s energy efficiency and renewables office and seven national labs that have been stalled, downgraded or spiked.”
Blog posts scrubbed from U.S. Department of Labor Blog. Why?!
Here’s an oddity. On the Department of Labor’s blog, there was a post on september 6, 2016 titled “What is the ‘Real’ Unemployment Rate?” that described the “huge array of measures, which together provide a comprehensive picture of the state of job opportunities” in the US. As you’ll see if you click on that link, the post is now “404 page not found.” You’ll not find the post in the blog’s archive for September 2016 either. However, the post was archived by the Internet Archive on October 17, 2016, the last time that IA crawled the blog. So sometime between October, 2016 and today (February 16, 2017) that post was scrubbed from the Department of Labor’s blog.
What’s more strange is that the archived site showed 26 posts in September, 2016, but the live site’s blog’s archive for September 2016 shows only 10 posts. Unfortunately, IA didn’t crawl the monthly archive urls, so there’s no way to know what those missing 10 posts were about. There are also discrepancies for other months (eg, the archived site shows 30 posts in August 2016, while the live site shows 17 posts!).
There’s nothing that I can discern in this one found post that could be considered controversial. It’s not a CRS Report that found no correlation between the top tax rates and economic growth, thereby destroying a key tenet of conservative economic theory that was subsequently suppressed in 2012. It was written by Dr. Heidi Stierholz, the department’s chief economist.
So what gives? Why is the Department of Labor disappearing selective blog posts? We’ll let you know if we find out.
CIA IG office “mistakenly” deletes Senate report on CIA torture
This is why US government information needs to be preserved off of .gov servers by FDLP libraries and other non-governmental organizations. It’s not enough that each agency has an Inspector General. Each agency should have one or more libraries collecting, preserving and giving access to its information *regardless* of political embarrassment or any other excuse for government information being deleted and lost.
The CIA inspector general’s office — the spy agency’s internal watchdog — has acknowledged it “mistakenly” destroyed its only copy of a mammoth Senate torture report at the same time lawyers for the Justice Department were assuring a federal judge that copies of the document were being preserved, Yahoo News has learned.Although other copies of the report exist, the erasure of the controversial document by the CIA office charged with policing agency conduct has alarmed the U.S. senator who oversaw the torture investigation and reignited a behind-the-scenes battle over whether the full unabridged report should ever be released, according to multiple intelligence community sources familiar with the incident.The deletion of the document has been portrayed by agency officials to Senate investigators as an “inadvertent” foul-up by the inspector general. In what one intelligence community source described as a series of errors straight “out of the Keystone Cops,” CIA inspector general officials deleted an uploaded computer file with the report and then accidentally destroyed a disk that also contained the document, filled with thousands of secret files about the CIA’s use of “enhanced” interrogation methods.
via Senate report on CIA torture is one step closer to disappearing.
FGI’s guide to “unreported” FDLP publications
April 23, 2021 / Leave a comment
“Unreported” publications (which were, until recently, called “fugitive” publications) are those that are within scope of the Federal Depository Library Program (FDLP) but for various reasons have slipped through the cracks and not been collected and cataloged by the Government Publishing Office (GPO), distributed to FDLP libraries, or included in the “National Collection” (See a partial list of historically “unreported” publications below).
We here at FGI consider “unreported” publications as the paramount problem facing the FDLP today. FDLP librarians, with their critical information skills and expertise about the structure and publishing activities of the federal government, are a vital piece of the solution to this vexing problem. The National Collection is at the core of what FDLP libraries have done for the last 200+ years, so “unreported” publications erode that very foundation. During the spring 2021 virtual Depository Library Conference, I challenged every FDLP librarian to search for, find, and report to GPO five “unreported” documents every month. I’d like to reiterate that challenge here on FGI. If every one of the 1100+ FDLP librarians were to find and report 5 documents each month, through this iterative process we’d soon put a dent in this existential “unreported” documents problem.
Four easy steps to reporting “unreported” publications
To that end, we’d like to share some simple steps for how to find and report “unreported” documents to GPO:
Strategies for finding “unreported” documents (more tips and tricks!)
Historically “Unreported” materials of particular interest
History of the problem
Since 1813 when the FDLP started, there have always been “unreported” documents which slipped through the cracks and were lost to the sands of time (until very recently, these were termed “fugitive” documents) [Footnote 1]. This problem has grown exponentially as executive agencies’ publishing operations have exploded, now that they can easily and freely distribute content online, and very few if any of them follow Title 44 regulations and send their documents to GPO as they are required to by law. Only a minuscule fraction of born-digital executive branch information is cataloged in the Catalog of Government Publications (CGP) or makes it into the “National Collection.” This means that every year, thousands — if not hundreds of thousands! — of Federal documents, datasets, maps, and other born-digital materials [Footnote 2] — are never preserved and are lost to the fog of history as websites are updated and historical content removed [Footnote 3].
Depository librarians reporting found publications are a critical part of a holistic solution to the “unreported” documents problem. By identifying federal information resources that are important to their local constituents, librarians are making sure that these documents will be cataloged, captured, and made accessible to a wider audience. Reporting documents also adds to a National Collection pipeline for long-term access and helps to make sure that what is collected and preserved reflects the needs and interests of the wide-ranging communities and the public which libraries serve.
Many hands make light work. Won’t you join in the effort? Please contact us if you have questions or comments at freegovinfo AT gmail DOT com.
1. See “‘Issued for Gratuitous Distribution:’ The History of Fugitive Documents and the FDLP.” James R. Jacobs. Article in special issue of Against the Grain: “Ensuring Access to Government Information”, 29(6) December 2017/January 2018.
2. My back of the napkin estimate is that well over 1/2 of the “National Collection” is unreported! The executive branch is far and away the largest portion of the National Collection, and is almost completely “unreported.” See slide 5 of my 2018 Canadian Govinfo presentation for some context. Jim Jacobs’ chart cites the 2008 End of Term crawl for context on how many born-digital government publications are on the Web. The 2016 End of Term crawl nearly doubled the 2008 crawl and went from 160 million URLs to 310 million URLs harvested. I expect the 2020 End of Term crawl happening at the time of this post’s publication to far surpass 310 million!
3. FGI has written about “link rot,” “content drift,” and other issues which make it difficult to collect and preserve born-digital information.
Appendix: how to fill out the askGPO form
The AskGPO form can be used for single documents or for reporting multiple documents, for example, those listed on an agency’s publications index page. See below for the steps to filling out the askGPO form. If a site is extremely large and/or complex (eg., the Office of the Director of National Intelligence (ODNI) reports site) send the URL and description of the site to the GPO Web archiving team at FDLPwebarchiving AT gpo DOT gov.