March 3, 2010 / Leave a comment
According to Aliya Sternstein at NextGov there's a proposal in the draft federal broadband plan to create a .gov video archive called video.gov. It'll be similar to the government's data.gov initiative. Wonder when they'll create a documents.gov? Oh yeah, they already have that! It's called the FDLP and it's been around for almost 200 years!!
A proposal in the draft of the government's imminent broadband plan would create a YouTube-like online archive called Video.gov to preserve agencies' Web content and possibly information provided by the media, an official with the Federal Communications Commission said on Monday.
The planned national digital archives for the 21st century would expand upon the government's Data.gov Web site, a warehouse of downloadable federal statistics, and be maintained by the National Archives and Records Administration, the Library of Congress and other agencies, said Eugene Huang, FCC's director of government performance and civic engagement for the national broadband plan.
[Thanks for the tweet
Michael Riedyk at DotGov]
Continue reading →Continue Reading →
February 28, 2010 / Leave a comment
3/1/2010 - Updated to add criteria of non-distribution of tangible product to FDLP.
Thanks to some documents reported to FGI's Lost Docs Blog last month, the Lost Docs blog has a new category that needs explaining. The category is called "Explanation Needed."
GPO lost docs receipts submitted to lostdocs.freegovinfo.info will be assigned this category if:
1) Cataloging records exist for both tangible (Paper and/or microfiche) and online versions of the item submitted that were added to the Catalog of Government Publications (CGP) earlier than the datestamp on the lost docs receipt.
2) The catalog record for the tangible version indicates that GPO cataloged the tangible version within five years of the publishing date of the item.
3) There is clear evidence from the bib record or depository librarian testimony that the tangible item was NOT offered to Federal Depository Libraries.
We have a five year limit because GPO Acquisitions staff have indicated they rarely have success in finding depository copies of tangible items more than five years old.
We at FGI don't insist that GPO distribute a tangible item when that item is solely available in an online format, but when a tangible item is available and fits the program, it should be distributed. GPO's policy on dissemination, SOD 301, states (emphasis mine), "When the product is available both online and in a tangible format, GPO will disseminate the online version to depository libraries. Tangible versions will be offered as well, budget permitting." Hopefully this means that most of the time the budget will permit this. If an item wasn't distributed for budget reasons, GPO should note this in the print record.
Until the non-distribution of these tangible items is explained and obviously noted in the cataloging record for a given item, it will keep the "Explanation Needed" tag. However, we will also continue to tag such items as "false positive" since we believe the primary focus of "lost docs" is documenting government publications that have escaped the National Bibliography GPO is required to maintain and because people do have access (at least for now) to the online version.
We encourage depositories to report non-distribution of CGP-Cataloged documents through GPO help and not through the Lost Docs form. Continue reading →
Continue Reading →
February 24, 2010 / 1 Comment on opensource.gov blocking access to libraries
[w:Open source intelligence] -- not to be confused with [w:Open-source software] -- is "a form of intelligence collection management that involves finding, selecting, and acquiring information from publicly available sources (my emphasis) and analyzing it to produce actionable intelligence." Libraries in the [w:Federal Depository Library Program] have since the early 1940s received output from this process in the form of [w:Foreign Broadcast Information Service] (FBIS) materials *for free*. FBIS materials offered translation of foreign news sources, and via the Joint Publications Research Service (JPRS) foreign language books, newspapers, journals, unclassified foreign documents and research reports. FBIS became the World News Connection in 1996, but it is a severely limited version (about half) of what's available for internal government use.
The Federal of American Scientists has more on FBIS. Check out FBIS and JPRS materials in library collections near you!
All that background as context to a very troublesome turn of events as described by a recent post on the govdoc-l list (see the email below stripped of personal information). This important piece of the govt information universe is now only available via a very expensive commercial database (World News Connection), depriving the academic and larger research communities of full access to all that is done by FBIS at taxpayer expense. Please help us by contacting the Open Source Center (OSCinfo@rccb.osis.gov 202-338-6735, or 1-800-205-8615) and Robert Tapella (PublicPrinter@gpo.gov) at the Government Printing Office and request that the Open Source Center offer free access of opensource.gov to depository libraries. Thanks!
>>>>>>>>>>>>>>>>>>>>>>>>
Date: Wed, 24 Feb 2010 10:25:58 -0600
Subject: OpenSource.gov access
Has any library successfully gained access to OpenSource.gov?
For those who are unfamiliar with this resource, here is the what their web page says about them:
"OpenSource.gov provides timely and tailored translations, reporting and analysis on foreign policy and national security issues from the OpenSourceCenter and its partners. Featured are reports and translations from thousands of publications, television and radio stations, and Internet sources around the world. Also among the site's holdings are a foreign video archive and fee-based commercial databases for which OSC has negotiated licenses. OSC's reach extends from hard-to-find local publications and video to some of the most renowned thinkers on national security issues inside and outside the US Government. Accounts are available to US Government employees and contractors. Register today to see what OpenSource.gov has to offer."
When we tried to register, they informed that we would have to justify why we needed access to the information and that we could get the information through World News Connection (via Dialog) OR, and I quote:
"In addition to the World News Connection, individuals may be able to access OSC products through university libraries, or the Federal Depository Library Program. Many Depository Libraries received CDs from the US Government Printing Office that contain select Open Source Center products." [The CDs that they are referring to are the FBIS materials (PREX 7.10/3:)]
In our response, we informed them that WNC was an expensive database they we could not afford and that their information regarding OSC being distributed through the FDLP was sorely out of date since the CDs have NOT been distributed for over 5 years.
In their response, they say they are considering adding additional agencies such as the Federal Depository Library (FDL) as part of the approved list of agencies in OpenSource.gov., but such a review would take a considerable amount of time to do. (I took this to mean, when 'ell freezes over.) Now here is the strange part--they think the FDLP is under the Dept of Interior and we could sign up that way--but our email address would need to have .gov or .mil in it. I am not sure, but I think they are actually referring to the Natural Resource Library in the U.S. Dept of Interior, which is a federal depository library, with which we are not associated, so this is NOT an option.
At this point I am stymied as to how we can have access to information that was formerly available FOR FREE through depository but is now only available through commercial ($$$) means. I know that GPO is aware that the CDs are no longer being distributed because of the creation of the OpenSource database. The only message I could find about this situation via the GOVDOC-L archives was from 2007 when they said "FDLP is still working with the agency OSC to get an agreement with how we are going to access their database." It is now 3 years later and we still do not have access to this information.
In the meantime, we have a professor on campus doing research in Middle East affairs and would like to have access to more recent information than what we have in our library via microfiche and CDs. We can not afford WNC, so I don't know what else we can do--except get access to OpenSource.gov. If anyone has been successful, I would be happy to hear how you did it.
Continue reading →Continue Reading →
February 10, 2010 / Leave a comment
The Government Printing Office (GPO) has posted their recent session on reporting fugitive documents at their OPAL archive:
Helping GPO Identify Fugitive Publications presented in January 2010 by Joe McClane, Manager of Content Acquisitions, and Linda Nainis, Acquisitions Librarian, U.S. Government Printing Office.
If you have any interest in the fugitive document problem -- agencies publishing information that slips between the cracks -- I highly recommend this session. This is an informative and frank discussion about GPO's efforts to address this problem and how librarians and other interested govinfo types can help contribute to the solution. Or at least one solution among many.
Continue reading →Continue Reading →
February 5, 2010 / Leave a comment
[UPDATE: I added the slides for Tom Bruce's talk]
Shinjoung and I submitted a panel on the future of govt information for iConference 2010 in Champaign, IL. We had a good far-reaching discussion with Tom Bruce (Cornell Legal Information Institute), Daniel Schuman (Sunlight Foundation) and Cindy Etkin (GPO). Below are my slides and notes. I've also attached the notes and abstract as PDFs. As Tom tweeted, "World's problems: solved."
If the other panelists agree, I'll post their notes/slides as well. This is of course an ongoing conversation so please feel free to leave comments, questions, rants etc.
--that is all!
3:45 - 5:15 pm Thursday, February 4, 2010
Roundtable 4 : : Technology Room
"Gone today, Here tomorrow: assuring access to government information in the digital age." ShinJoung Yeo, University of Illinois; and James R. Jacobs, Stanford University
Panelists:
- Shinjoung Yeo, Moderator
- James Jacobs, Stanford University Library
- Thomas Bruce (Legal Information Institute, Cornell University)
- Daniel Schuman (Sunlight Foundation policy director)
- Cindy Etkin (Govt Printing Office)
[SLIDE 1: govt documents]
Right up front, I'm a librarian and a collaborator in the LOCKSS distributed digital preservation project (Lots of Copies Keep Stuff Safe). I've been in academia/education my whole life as a student, teacher, librarian and technologist. I've been a government information/FDLP librarian since 2002 and currently am serving a 3 year term on the Depository Library Council, the body which informs and advises the Govt Printing Office regarding issues of the Federal Depository Library Program (which Cindy talked about). So my mindset/perspective/bias is from one who assists in the scholarly communication process, one who believes that libraries have a place in the digital information landscape, and one who believes strongly in the idea that access to govt information is a fundamental right. As Ralph Nader has said, “There can be no daily democracy without daily citizenship.” And there can be no citizenship without access to government information.
[SLIDE 2: mmm documents]
With that in mind, I'd like to talk about the underlying historical ideals of the FDLP, discuss how those ideals have been under fire from both within and without the library community and argue that those ideals applied to today's information landscape give us the best chance at access to and long-term preservation and assurance of govt information.
[SLIDE 3: FDLP logo]
The federal depository library program (FDLP) has been around since 1813 in one form or another. The basis underlying the need for an FDLP is to give the public free access to government information. Depository libraries have long safeguarded the public's right to know by cooperating with and receiving for free the govt publications published by the Govt Printing Office (GPO), organizing, maintaining, and preserving those publications, assisting users in accessing said information in a geographically dispersed system and most importantly, assured that govt information is freely available and tamper-proof -- think Napster for govt information. Taken together, the collections of the 1238 depository libraries make up the historic corpus of govt information available for free to every citizen. Jessamyn West of librarian.net, recently called the FDLP the longest running open source project. I would add that it's the longest government-run public-centric open-source project to support the democratic ideal.
[SLIDE CHUCK QUOTE]
Over the last 20-30 years, developments in publishing and Internet technologies have affected the way government information is produced, disseminated, controlled, and preserved. These changes have affected the policies and procedures of the GPO and, in turn, have affected the depository library program. Despite the often-heard promises that Web technologies will bring more information to more people more quickly and easily, the actual effects have been decidedly mixed. The highly visible, short-term successes of rapid dissemination of single titles directly to citizens (e.g., the large number of downloads of the 9/11 report) mask the loss of a secure infrastructure (GPO's Federal Digital System (FDsys) notwithstanding) for long-term preservation of and access to government information as more and more agencies publish content on their own Web sites rather than using the GPO conduit (which librarians call "fugitive documents") and very few agencies publish to any standards or have policies in place that deal with archiving and preservation. As Chuck Humphrey, a data librarian friend of mine, once said, “there seems to be an inverse relationship between convenience of dissemination and preservation standards.”
In addition to this lack of a secure infrastructure, the growing din of the call for digitization of historic govt publications (most recently the Ithaka/ARL report "Documents for a Digital Democracy: A Model for the Federal Depository Library Program in the 21st Century"), while no doubt a boon for access today, is somewhat of a red herring that makes library administrators believe that they will soon be able to dispose of their physical collections and use that space for today or tomorrow's buzz word. This call for digitization may instead have the deleterious affect of damaging the long-term preservation of govt publications.
Lastly, the growing trend toward privatization of govt information has actually caused a decrease in public access despite it's digital nature. This is not a new trend. Herbert Schiller noted this in 1986 in his book "Information and the Crisis Economy." Speaking of machine readable formats, he wrote that, "Library information capability is greatly enhanced. Yet this benefit is accompanied by the abandonment of libraries' historical free access policy. User charges are introduced. The public character of the library is weakening as its commercial connection deepens. No less important, the composition and character of its holdings change as the clientele shifts from general public to the ability-to-pay user."
[SLIDE: GAO contract]
We've seen over the last 30 years a disturbing rise in Federal Agencies entering into contracts with private companies whereby public domain govt documents are digitized and then taken out of the commons via licensing agreements. See for example, the Government Accountability Office (GAO)'s deal with Thomson-West whereby Thomson-West digitized the GAO's 20,597 legislative histories of most public laws from 1915-1995 and in return received exclusive license to sell access to the content. GAO received nothing in return but an account on Thomson's service while the public received nothing at all.
Rapid technological change and the misplaced assumption that "it's all in google" have caused some in the FDLP community to question the need for the FDLP and some others to drop out of the program altogether. I believe that the inherent nature of digital information actually increases the need for a distributed network of dedicated, legislatively authorized libraries. It would be prudent to draw upon the existing infrastructure of FDLP libraries and the almost 200 years of cumulative experience of these institutions in assuring preservation of and access to government information. We must reinforce FDLP’s traditional mission of selection, collection, free access, and preservation of government information in the digital era in order to assure free access to this information into the foreseeable future. Some in the depository community, like my library, are doing just that by participating in the LOCKSS-USDOCS network, harvesting digital govt information -- for example, harvesting openCRS that Daniel mentioned along with other sites that post CRS reports -- and yes digitizing parts of their collections. But we need more libraries not less.
[SLIDE: FDLP ecosystem]
Nobody knows for sure how to preserve digital content for the long-term. This means to me that a loosely coupled, independently administered, distributed ecosystem is the best way to assure long-term preservation -- many organizations with many funding models and a distributed technical infrastructure(s) have a better shot at preservation than 1 or 2 organizations -- especially if one of those organizations has a tenuous budget, or is a private corporation etc.
Imagine if you will 2 future govt information systems: on the one hand, the system where there are one or two digital collections (say for example GPO's Federal Digital System (fdsys) and Portico, the dark archive currently housing digital journals); and on the other hand, one with many digital collections in fdlp libraries. How would each of these deal with or react to different stress situations or threat models (e.g., reduced budgets, increased demand for privatization, increased demand for censorship or control or removal of information, media/hardware/software/network failure, natural disaster, organizational failure etc.)? It's easy to see that a highly replicated, distributed FDLP model of preservation would deal with these situations much better than a centralized model. A web is much stronger than a silo.
[SLIDE: Federal Register XML]
law.gov, Carl Malamud’s proposal for a registry and repository of all legal information -- from what I've seen and heard and read, is a compelling proposal for a significant piece of the federal (and state) legal information ecosystem. What we ought to be doing is a) figuring out how to make law.gov a reality; b) figuring out how to expand it beyond legal materials to include ALL federal information -- information from all 3 branches of government, federal agencies as well as the regional and local offices of those agencies, data and statistics, the entire Congressional/legislative process including the funding that goes into that process to grease the skids so to speak, and making sure public information stays in public control; and c) MOST IMPORTANTLY from my perspective as a librarian, figure out how to preserve that ecosystem for the long term so that the public can inform itself not just today or tomorrow but 100 years from now. Now the 4 of us on this panel are just 4 players with dogs in this fight. But if we agree on the goals, then we ought to work together to proceed toward them and mobilize our communities and the public to support this endeavor.
It's going to take the government (and not just GPO) being serious about transparency and funding the necessary changes in its own federal information distribution system to include open format standards with no DRM, bulk data channels, indexing, description, collection and authentication of information resources, multiple digital preservation strategies to not only assure preservation but also to insure against tampering and deletion of vital information (which, as I've stated earlier, the FDLP historically has done very well!). It's also going to take libraries being serious about and applying the ideals of the FDLP to build a distributed digital infrastructure that takes into account access to as well as preservation of digital govt information.
I agree with Tom and am absolutely convinced that the changes in the information ecosystem that are needed should not be left to the market because the information market leans heavily toward monopoly, proprietary standards, licensing restrictions, lack of access, "rights management" and the like.
If an evolving ecosystem that is free, open, standards-based, authenticated, and privacy-protecting is built and sustained correctly then citizens, libraries, non-profit watchdogs, hackers, activists, AND government will thrive.
[SLIDE 7: THANKS! lockss, archive-it]
digital changes a lot of things about information, but it doesn't change the need to fund it, collect it, share it, preserve it, and give access to it. As my friend and colleague Jim Jacobs recently stated, "lots of collections keep stuff safe!"
Continue reading →Continue Reading →
Latest Comments