GAO/Thomson-West Contract Raises Questions
Thanks to an alert from a dedicated but shy reader, our attention has been focused on a story on boing-boing titled Did the US gov't sell exclusive access to its legislative history to Thomson West? This story has links to documents relating to this deal requested by the redoubtable Carl Malamud. I took the time to read/skim through the contract documents and found this interesting section:
Taken from "Attachment A, Statement of Work" from the contract between Thomson West and GAO, posted at http://www.scribd.com/doc/2299358/Contract-Between-Thomson-West-and-GAO Background: Since its inception in 1921, the US Government Accountability Office has compiled 20,597 legislative histories of most public laws from 1915-1995. These histories, spanning the 64th-104th Congresses, are currently being used onsite in the GAO headquarters Law Library in paper or microfiche format by GAO staff. On rare occasions other federal government employees are allowed onsite access to the paper or microfiche copies of these histories. Because of its historical and research value the legislative history collection shall be digitized to preserve the integrity of the files and improve the searchability of this valuable information resource. Two years ago, GAO began a pilot project to convert a small number of GAO legislative histories from paper and microfiche formats to digital format. Since then 243 histories have been digitized using in-house resources and will be made accessible to GAO staff only through a web-based database on the GAO Intranet. The 243 histories consisting of 1,214,438 pages were randomly selected and include some of the largest histories in the collection. These histories shall also be re-scanned as part of this digitization contract.This sounds like a major goldmine of information that really hasn't been shared with other parts of the government, let alone the public. It also sounds like GAO tried to do some of this work on its own but found it unviable. So left to itself, the information wouldn't contained in the paper files wouldn't be available to anybody. So I'm not surprised it went looking for a partner. But I am surprised and concerned that they went with a commercial partner when the GAO office is within driving distance of a number of major universities and when public-spirited organizations like the Internet Archive and Public Resource might have been happy to come up with a solution to provide this taxpayer-funded information at zero cost to the taxpayers and either zero or minimal costs to GAO. Conceivably there might have been some way for the Government Printing Office to incorporate this into GPO Access, although that certainly would have been at some cost to GAO unless Congress was willing to make an appropriation for this purpose. But any Congress that claims to be committed to strong public access should be willing. Were alternatives to in-house digitization or wholesale privatization pursued? If not, why not? Long time readers of FGI know that most government information is considered public domain and also subject to Freedom of Information Act requests. So what's to stop Carl, Internet Archive, or some other public minded group from exposing this rich trove of legislative histories to the public which were taxpayer funded to begin with? According to the GAO, plenty:
Taken from "Attachment A, Statement of Work" from the contract between Thomson West and GAO, posted at http://www.scribd.com/doc/2299358/Contract-Between-Thomson-West-and-GAO FOIA Requirements: While GAO is not subject to the Freedom of Information Act (FOIA), GAO has regulations (4 CFR Part 81) that follow the spirit of FOIA. The paper or microfiche copies of the legislative histories (and possibly the PDF copies of the "GAO Materials" section) would be available for public inspection and copying. However, under GAO's public disclosure regulations, GAO charges a per page copy fee. Accordingly, any extensive copying would be expensive and the quality of the copies, for many of the histories would be poor.I assume this was put into the contract to assure Thomson-West their investment would be secure from public-access zealots who have the idea that the American people should only be charged once instead of twice for government information. But the paragraph raises two important questions that I hope someone in Congress will ask GAO: 1) On what rational basis would you charge a per-page fee on the 1,214,438 pages that have already been digitized? Running a backup tape isn't the same as hand copying files. GAO should be directed to immediately release that database at zero cost unless they can carefully and believably document actual copying expenses including staff time. But a per page copy for PDF files isn't credible. 2) When GAO says "quality of the copies, for many of the histories would be poor", are they saying that the quality of copies would be poor just for the public or for Thomson-West as well? The first reading suggests a deliberate effort to sabotage no-fee public access, while the second reading suggests that Thomson-West customers will be paying a high price for lousy duplication. Neither option seems particularly fair. I think I speak for all of us at FGI when I say that while digitization for greater access is a laudable goal, wholesale privatization without a careful, public examination of other, more citizen-friendly, alternatives is not acceptable. If you agree, please ask your Members of Congress to direct GAO to take a second look at this contract and facilitate no-fee access to this valuable set of legal materials. Continue reading
New Best. Title. Ever.
We hadn't added much to our Best. Titles. Ever. humor page lately. I'm happy to end that dry spell with a document that is both humorously titled and useful: Hills Bros. coffee can chronology : field guide, published by U.S. Dept. of the Interior, Bureau of Land Management in 2006. Why does the Bureau of Land Management care about what coffee cans looked like in the 1910s? For a very good reason. According to the document's introduction, Hill's Brothers Coffee cans are a great way to date digs dating back to the late 1800s because of the tendency of Hills Brothers to change their can designs every so often. I'd love to copy and paste their explanation into this post, but I can't. The BLM authors chose to lock their PDF into a form that cannot be copied from. You can make copies of the entire file and you can print pages from it, but you can't copy and paste the text nor can you extract the pictures from it. Yet as a public domain government document, there is no legal reason to impose these kind of restrictions. This is part of the future we fear, one of crippled electronic documents that aren't as reusable as they could be. Today BLM has decided we can't copy and paste from a public domain document. Maybe another agency will decide tomorrow that we shouldn't be able to print their document. That's what faces us unless the federal government has a consistent policy that renounces Digital Rights Management (DRM). **Addition by James: I've attached a PDF of the document from which I was able to copy and paste. Please download this copy and leave a comment if you're *not* able to copy and paste. **Addition by Daniel: Thanks for the demonstrating the power of a polite request. It's nice to see responsive and helpful gov't agencies. **Further addition by James: While I believe in the power of a polite request, this one was Jim working his magic to subvert the copy-blocking. He saved the original pdf, printed/saved as pdf (macs let you convert to pdf from the print menu!), jiggered a few things and then the DRM was foiled. That's the PDF doc that is attached to this discussion :-) Continue reading
Six pages and serendipity
Today I was searching the shelves of my depository for a report related to the Catalog of Federal Domestic Assistance and instead my eyes fell on this publication from the CIA: Donovan and the CIA : a history of the establishment of the Central Intelligence Agency by Thomas F Troy Publisher: [Langley, Va.?] : Central Intelligence Agency, Center for the Study of Intelligence, 1981. SuDoc: PREX 3.10:D71 This is the official story of how the CIA came to be. According to the preface, it was written in 1975 as an account of the agency's origin for new employees. It was promptly stamped SECRET. In 1981, the agency released a declassified edition which the preface hails as being "released for leisurely reading outside the office, and printed in one volume, this history should better serve it's original purpose." What made the CIA decide it could let its secret origin story out of the shadows? According to the preface, it was the excision of no more than six typewritten pages. Obviously, I haven't seen the missing six pages, but doesn't this case make it seem like the classification process is a little whimsical? The book is divided into three sections: "The COI (Coordinator of Information) Story" which covers from about 1929 to World War II, Wartime--The OSS Story and Postwar--The CIA Story, which ends with the establishment of the CIA. If anyone's read this volume, let us know what you think. As far as I can tell, the book has no electronic version. Google Books has a commercial version with no preview. Perhaps one day the government document version, which is in the public domain, will be posted. Might be interesting to run a tag cloud on the text. The electronic world has given us many gifts, but I'm not sure it could deliver an experience of serendipity like the printed shelf did for me today. From welfare to spies.
On a personal note, thanks to everyone who has sent words of appreciation to me regarding my being named as a Library Journal 2008 Mover and Shaker. I really think this is an award that in a real sense belongs to the entire documents community and especially to my co-volunteers here at FGI and the dozens of folks working on State Agency Databases Across the Fifty States. Thanks to each and every one of you who contributes to finding, describing, and making government information available to people in a way that respects their privacy. Without you I'd just be a mouth on legs. Continue reading
Limits of Full Text Searching: Finding FOIA Docs
The federal government posts a fair amount of material requested by citizens under the Freedom of Information Act (FOIA) online. They do this in part so they don't have to respond to multiple requests for the same material. An of example of this that I love to use to document the feds' disturbing tendency to surveil harmless people when looking for national security risks is the FBI electronic FOIA reading room. But if you don't know whether an agency has an electronic FOIA reading room, it can be confusing searching for FOIA related materials. One way that I started looking for this type of material was to toss the term "foia" into a usa.gov search along with my search term. In this way I was easily able to locate the CIA's 5,000 pages on the US involvement in overthrowing the elected government of Guatemala in 1954. But try this technique with other countries, like say Cameroon and while you get a lot of results, nothing seems quite on point. Why is this? Mostly because many federal pages quite rightly have a link to their FOIA information page. This page usually has information on how to contact the agency to make a FOIA request and sometimes has a link to an electronic FOIA reading room. In some cases, like that for the State department, the reading room is a little bare, consisting mostly of annual reports. If we had a government web with good metadata or could otherwise catalog FOIA related materials, then finding FOIA related documents would be a lot easier. But as it is, people are left with many results to sift through for a few nuggets of information. And if you're reading this and are thinking "Why doesn't he know about ______, which provides gov't wide access to documents released under FOIA?", then by all means let me know about in comments. Continue reading
CDC Employees Gather Round a Blog
While browsing ThinkProgress, I came across a reference to CDC Chatter, which says it is for:
ABOUT CDCChatter.net Welcome to CDCChatter.net, an unofficial blog for employees of the Centers for Disease Control and Prevention (CDC), external partners and others who are interested in CDC. This blog was established for CDC employees and others to post information, express opinions, make comments and otherwise communicate about decisions, changes, events and other issues that are occurring at CDC. This blog is intended to provide a forum for people to express their views. It is not intended as a forum for disclosing classified or confidential information nor is it intended in any way to compromise the mission and efficacy of CDC.The site statistics they post on their front page suggests they get good traffic:
Site Statistics Thru January 2008 561 - Stories 6,373 - Comments For the month of January: 16 - New stories 250 - New comments 6,477 - Unique visitors 1215 - Average visits per day 14,175 - Average hits per daySome of the most recent news/discussion topics included:
- A reader has written expressing concern that in times of tightened resources, NCCDPHP leadership is not marshalling its energies to continue to address the threats of chronic diseases.
- With the impending budget cuts what are some ways CDC can cut its budget and still provide the public with the healthcare knowledge and service they deserve?
- CDC CAREER DAY - Setting People up for Failure?
- Congress to probe CDC for withholding report
Latest Comments