Home » Articles posted by James A Jacobs (Page 201)
Author Archives: James A Jacobs
Statistical reality check
As noted here earlier, Sunlight Labs has announced the three finalists in its "Apps for America 2" competition. One of those is DataMasher which enables users to "have a little fun" with government data "by creating mashups to visualize them in different ways and see how states compare on important issues. Users can combine different data sets in interesting ways and create their own custom rankings of the states." A post about this on slashdot prompted a reply, Lies, Damned Lies, and DataMasher that worries that "in practice DataMasher would end up mostly generating a lot of bad information." The reply continues:
The site as it exists now seems to encourage you to think about issues in a really simplistic way (with a simple arithmetic combination of two numbers on a state by state basis) that's going to mislead more often than inform. The devil is always in the spurious correlations, and DataMasher just doesn't give you ability to get at that sort of thing (nor do most people have the understanding of statistics anyway). ...Statistics are extremely useful in determining public policy, but only if used carefully. There's already so much bad use of statistics in our public policy debates, and DataMasher seems perfectly designed (unintentionally, I'm sure) to exacerbate the problem.I am very sympathetic to this argument but would add an additional caveat to it. Any tool can be misused or used badly. Decades ago, some statisticians were upset when commercial software like SAS and SPSS were being introduced because it allowed anyone to run a regression without knowing what it was or how to do the math or whether they were regressing variables that made sense. While it is certainly true that the design of tools can encourage misuse or bad use, it is also true, I think, that even well-designed tools can be used badly and even bad tools may be better than no tools because they can encourage imagination and exploration and curiosity. Those can lead to better, more informed questions and analysis. For libraries and service providers there is another side to this story. As tools like DataMasher become more available and easier to use, it actually creates new challenges for information service providers. Rather than making our jobs easier, the availability of these kinds of tools actually makes our jobs more complex. Rather than pointing at a reliable book of statistics, created by government statisticians and published by the government, we now have 'raw' sources and sources that require more understanding and skill to use and interpret accurately and responsibly. Where once we tried to make sure that the people we helped looked at footnotes and table headers so they understood statistics, now we are faced with helping people use raw data and helping them produce their own statistics. Every library will have to decide on what level of service to provide in situations like this. No library should avoid addressing the service implications of the availability of new sources of information -- no matter how good or bad they are. Continue reading
Tracking Congress 2.0
Peggy Garvin has an excellent overview of new tools and sources for following Congress.
- The Government Domain: Tracking Congress 2.0, by Peggy Garvin, LLRX (August 31, 2009).
The costs of PACER
The results of a survey designed to learn more about actual library expenses for PACER. Respondents included law firm libraries and law school libraries who reported how much they spent on using PACER (Public Access to Court Electronic Records).
- PACER Spending Survey, by Erika Wayne, Legal Research Plus (August 28, 2009).
The unknown/potential costs of using PACER hold back most law school libraries from letting their patrons fully utilize PACER.Continue reading
PACER and Crowdsourcing Court Records
Here is a first hand account by a user of court documents about why we need better access to court records than the 21 year old PACER system.
- Crowdsourcing Court Records, by Gautham Nagesh NextGov "Tech Insider" (08/31/09).
Last week I made a visit to the District of Columbia's federal courthouse to look up some documents for a story I've been working on. Since I don't have an account for the federal court records database known as PACER, heading down to the courthouse was the only way I could download and print the records I needed at a cost of eight cents per page. I sat down and dutifully printed out the first lengthy set of documents, only to find that somehow all of the text printed out backwards on the page. The second computer printed correctly, but proved slow and unresponsive. What I thought would be a a relatively straightforward task ended up consuming much of my afternoon. I was told users with accounts can access the records online, but even then the records are not searchable, making navigation time consuming and difficult.See also: Federal Courts Wary of Document-Sharing Plugin Recap Firefox Extension: "turning PACER around" Continue reading
Comment on article: Depository Library Program in 2023
A recent article reports on a survey of ARL library directors and their vision of their libraries' roles in the depository library program:
- The Federal Depository Library Program in 2023: One Perspective on the Transition to the Future. Peter Hernon and Laura Saunders. College and Research Libraries, July 2009, Vol. 70, No. 4). [In the interest of academic discussion and openness, we've posted a copy of the article on FGI.]
The survey asked directors to choose among several future scenarios for the FDLP and their role of provision of government information. The authors are explicit about their intentions saying that "the study neither directly addresses whether the depository program itself will exist fifteen years hence nor offers a vision of what future will emerge after 2023." They also note that the survey explicitly focused on the question "how many libraries want to remain in the depository library program and what role do they intend to play?" This focus predetermines the outcome of the survey somewhat. It doesn't tell us what FDLP should be or how libraries could have a role in ensuring the long term, free access to government information. Instead we get a lot of information about what directors worry most about: money and resources.
The authors point out that no other study has systematically surveyed library directors for their perspective on the FDLP. This is particularly interesting given the rumors, gossip, and scuttlebutt going around about how many university librarians want to get rid of their depository collections, don't trust their depository librarians, and see depository status as costing more than it is worth.
The study reinforces some of those stereotypes and provides some evidence that some ARL library directors do indeed think that way. Sample quotes: "Several directors look forward to a time when they can 'dump the print.'" "Although some directors believe they have 'forward-thinking' documents librarians, others feel the opposite. As the director of a regional depository explains, 'the more that directors know about the program and a library's responsibilities, the less likely documents librarians can bluff about the legal obligations and seek to maintain the status quo.'" "The burden of participation in the program, including that of cost, is a recurring theme." "The directors I talk to all want to get rid of the [depository] collection and drop out of the program as soon as possible."
Not surprisingly, the directors who think that way are apparently part of the minority (13% that chose "scenario 1") who believe that libraries should withdraw from the depository program or that the program will simply wither away.
What the survey documents for the first time, however, is how much value ARL directors put in government information and digital collections. Many of the directors see government information as essential to their academic communities and have serious concerns about how to ensure its availability. Fully half the respondents envision (scenarios 3 and 4) some sort of digital collections as part of their responsibility -- either in partnership with GPO or separate from GPO if GPO does not provide adequate leadership.
While this survey is very interesting and provides much food for thought, it is far from the final word on the future of the FDLP, GPO, or government information. It leaves many questions unanswered and raises other questions. For example:
- The survey's use of the term "digital depository" is confusing at best and misleading at worst. One of the "scenarios" presented to directors in the survey describes "digital deposit" as the library providing "a digital feed of government information resources to its Web site, thereby becoming a portal for access to e-government information resources. The library receives, but does not create, digital content." We wonder how directors interpreted this? Did they think that "receiving" digital content meant getting copies of digital files that they would keep in a digital collection? Or did they think that "providing a feed" and "becoming a portal" was a passive job of pointing to content at GPO or elsewhere? The article does not make this clear and we would have to guess that directors may not have provided responses that we can interpret consistently. (And, we would have to ask the authors, whose work we respect, why they chose the outdated word, indeed the outdated concept, "portal"? Does anyone really believe that users want or will use "portals" anymore?)
- Another term that is used in a confusing way in the article (at least I was confused by it) is the term "dark archive." We normally associate this with digital archives such as Portico (which archives digital copies of journal articles but is "dark" because no one can see the articles unless a particular kind of event -- such as a publisher going out of business -- allows the archive to make articles available). In this article, the authors use "dark archive" in that sense but they also use it to refer to print collections that have copies of last resort. Was this confusing to the surveyed directors? Did different interpretations skew their answers?
- Some of this confusion is evidently apparent to the authors. When they analyzed the directors' comments, they discovered that there was some "imprecision" by directors in choosing a scenario. Some were unable to place their institution fully in one of the provided scenarios. There were many reasons for this, but it makes it harder for us to interpret and understand the results.
- The survey did not specifically present a scenario of real digital deposit in which GPO sends (i.e., deposits) authentic digital files to depository libraries. As noted above, the survey focused on two different but related questions: who wants to remain in the FDLP and what role do they intend to play. Combining those two questions may have further muddied the responses and left out options (e.g., true digital deposit).
- One theme mentioned several times in the article is the need for a shared digital archive of digitized materials similar to the JSTOR model. To me, this seems to be an indication that the directors value digital information, see a need for a trusted repository in addition to GPO, and would support shared responsibilities for such an archive. This should spark some good discussions at the next DLC meeting.
- The survey seems to perpetuate and even reinforce misleading concepts about the permanent availability of digital government information. Although the authors acknowledge that "government entities often do not retain all resources permanently on their homepages, and content can be difficult to find and can be subject to removal, redacting, or alteration", they also passively quote directors who say they will rely on search engines and other libraries and government web sites to provide government information for them. There are certainly some libraries (even among ARL libraries) that will not have large digital collections of government information, but the survey does an injustice by passing along these comments without follow up questions to those directors about who will ensure access.
- Another questionable idea that came out of the survey was about staffing. Several directors said "they would cease to employ separate, dedicated government documents librarians. They assume the specialized knowledge will be passed to reference librarians." Shouldn't ARL directors be thinking about the need for new skills to manage digital deposit and digital preservation and digital access to locally held files? Shouldn't they be concerned about the special skills that will be needed to locate government information and provide reference service for it if they do not have a collection that they control?
In summary, the article provides much to discuss and good opportunities for further research. It also provides some clear evidence that the rumors that ARL directors want to dump their depository collections and drop their depository status are well founded, but that these directors are in the minority. Most ARL directors highly value government information and are looking for smart, efficient ways to ensure long term access to digital collections.
Continue reading
Latest Comments