CTWatch Special Issue: Scholarly Communications & Cyberinfrastructure
The Coming Revolution in Scholarly Communications & Cyberinfrastructure
CTWatch Quarterly Volume 3 Number 3 August 2007
Introduction
Lee Dirks, Microsoft Corporation
Tony Hey, Microsoft Corporation
The Shape of the Scientific Article in The Developing Cyberinfrastructure
Clifford Lynch, Coalition for Networked Information (CNI)
Next-Generation Implications of Open Access
Paul Ginsparg, Cornell University
Web 2.0 in Science
Timo Hannay, Nature Publishing
Reinventing Scholarly Communication for the Electronic Age
J. Lynn Fink, University of California, San Diego
Philip E. Bourne, University of California, San Diego
Interoperability for the Discovery, Use, and Re-Use of Units of Scholarly Communication
Herbert Van de Sompel, Los Alamos National Laboratory
Carl Lagoze, Cornell University
Incentivizing the Open Access Research Web
Publication-Archiving, Data-Archiving and Scientometrics
Tim Brody, University of Southampton, UK
Les Carr, University of Southampton, UK
Yves Gingras, Université du Québec à Montréal (UQAM)
Chawki Hajjem, Université du Québec à Montréal (UQAM)
Stevan Harnad, University of Southampton, UK; Université du Québec à Montréal (UQAM)
Alma Swan, University of Southampton, UK; Key Perspectives
The Law as Cyberinfrastructure
Brian Fitzgerald, Queensland University of Technology, Australia
Kylie Pappalardo, Queensland University of Technology, Australia
Cyberinfrastructure For Knowledge Sharing
John Wilbanks, Scientific Commons
Trends Favoring Open Access
Peter Suber, Earlham College
Google Books/Fed Docs: Google Books Statistics–The Bigger Picture
Now that I had some statistics it dawned on me I had no idea whether or not this was a lot documents. So I was off to the FDLP desktop and the Catalog of U.S. Government Publications.
I looked around the desktop to see if GPO listed any statistics. On the "about" page for the CGP, GPO says merely that there are more than 500,000 records in the database. So I gave some thought to how I might get a better figure, and off I went to OCLC and the GPO database in FirstSearch. On the database info page, OCLC lists 507,000+ as the number of records and that the database had its last monthly update on August 8, 2007.
So I went back to the CGP and its advance search page. Searching for GPO in the publisher field is not terribly effective. Of course, in this database everything is a government document so that is not a problem.
But how to get a real number out of the database? I tried using the most common of words--a and the-- but to no great effect. A brings up 359,875 records and the brings up 411,493. Neither result comes close enough to the supposed 507,000.
I had another realization that the CGP now includes records for electronic titles--titles that would not be fodder for the Google Book Project. Using the New Electronic Titles page is not really an option to count them as it only goes back to April of 2005 and since early 2006 the monthly lists are not numbered (leaving me to do a lot of counting).
So back to the advanced searching page in the CGP. Happily here you can search for terms in the URL/PURL. I proceeded to search for every record that listed .gov, .mil, .us, .org, and .com. I came up with a total of 64,504 records. So approximately 13% of the records in the CGP are electronic titles or are titles with an electronic counterpart.
Unfortunately I had another realization that these figures really only represent documents published from 1976 on. This is a really big problem in that most of the documents I found in Google Books dated to before 1923. My only hope to get good numbers was to askGPO. So late on August 8th I shot off a query to GPO asking for statistics on the number of documents GPO has distributed both before and after 1976.
Surprisingly enough, GPO called me first thing the next morning. askGPO is notoriously slow in providing answers to queries so I was very surprised! I spoke with Nancy Faget at GPO and she was very pleasant though not exactly forthcoming with numbers. It struck me that I got the quick call back as GPO viewed my query as the first step in getting out of the program. As far as I know my director has no real intentions of doing that, but I don't think I convinced her on that point. But aside from that she told me that GPO really didn't know how many documents went to depositories since the beginning. Alas!!
I honestly don't know if would be fair to take the view that probably as much was distributed from 1813 to 1976 as was published after 1976. But if you did, that would lead to believe that over one million documents have been produced.
So the bigger picture suggests that the 167,878 titles in Google Books is only about 17% of all the documents that could be digitized. At a guess...
So I put a call out to everyone in GovDoc Land. If you are a full depository and have been one since 1813 and have kept really good records, could you please send me the statistics? Thank you very kindly in advance!
Continue reading
Google Books/Fed Docs: Google Statistics from Scratch
Having found no published statistics for numbers of digitized books in Google Books, and especially nothing about digitized government publications, I was left with coming up with them on my own.
So I went to the Advanced Book Search screen for Google Books. Looking at the search options provided there I decided that the only way I could get reasonably useful statistics was to search for books published by GPO. As you are all aware not all government documents are actually published by GPO. Many are merely distributed by them. So I knew that my numbers would not be exact. Another problem was that over the years GPO listed themselves as publishers using a variety of abbreviations and phrases.
My first try was to use GPO in publisher and on August 8th I retrieved 141,600 hits. However just now when I ran it again, I only got 117,600. Hmmm.
Next search was for Government Printing Office, which retrieved both today and on the 8th, 43,600 hits. This was followed by gov't, which on the 8th retrieved 2,322 titles but today only retrieved 2,258.
The grand total for using these three searches on August 8th was 187,522.
Today as I was double checking my results, I also tried gov. print. off. and got 4,420 hits. So as of this morning the grand total is 167,878. I find it rather disconcerting that the number as dropped so much in nine days!
Continue reading
Google Books/Fed Docs: Google Books and Documents Coverage–From the Beginning
I have a hard time trying to figure out where to begin this blog, so I have decided to start at the beginning even though I have written a bit about this in a message posted to GOVDOC-L on August 8th. So here goes...
I was asked to find out how much government information is available in the various Googles. Over the past few months I had saved posts from GOVDOC-L that had Google in the subject line; so I thought this would be an easy assignment. Turns out that the messages did not give statistics, instead they were questions about Google's practice of making the full text of all books published after 1923 unavailable.
Well I was a bit disappointed but I still thought that I would find the information on Google's website. I figured that Google would be tooting its own horn about the growth of this infamous project. Not so. There are no statistics anywhere, and there was very little that described the scope of the project.
Next I went into research mode. I checked for articles in EBSCO's Academic Search Premier and Lexis-Nexis. I found some interesting news articles on the project but again no statistics. I then tried to search the web pages of a few library partners I looked at the University I had a little luck on Stanford's web site on Robotic Book Scanning. There was a page a few statistics listed there but alas they dated from June2004.
I even Googled such keywords that I hoped would bring up statistics. But considering how many different way one might refer to statistical information, it was frustrating to do. I didn't find any statistics this way but I did find some intersting Blog entries about the full-text copyright issue.
So I was on my own.
Continue reading
What really happened with Google Premium Video — Part one: DRM killed the files
August 18, 2007 / 1 Comment on What really happened with Google Premium Video — Part one: DRM killed the files
As Daniel pointed out on Tuesday (Another Example of Access Bad, Ownership Good), when Google shut down its premium video service on August 15, it was able to prevent customers who had bought and paid for videos from Google from ever watching those videos again. But there is a bit more to the story -- and it has implications for how government information is distributed.
In this, Part One of a two part look at the issues, we examine how Digital Rights Management (DRM) technologies and proprietary software allowed Google to make it impossible for users to watch videos that they had bought from Google even though they had downloaded the video files onto their own computers. In Part Two we examine why this story is important for government information specialists and Federal Depository Library Program (FDLP) librarians.
While it wasn't obvious from the initial news stories about this, Google used DRM and proprietary software to deny access to files users had paid for and downloaded. Although the Government Printing Office (GPO) has not used identical techniques, it has experimented with similar ones and has never explicitly rejected use of techniques that could provide government a way to deny access to information even if users have copies of files on their own computers. More on that below.
Google's premium video-purchase-and-download service overlapped with with Google's YouTube-like service, Google Video, which offers streaming video without charge and some free downloads. But in early 2006, Google announced a service as part of Google Video that would allow users to pay to rent or buy certain videos (such as NBA basketball games and TV shows such as CSI) and it is that service that changed this week and those videos that people purchased that they no longer can watch.
YouTube and Google Video use "streaming" video technology so that you watch the stream of video as it comes to you. It is also possible to download videos in some cases. But the Google premium video service allowed users to pay for videos, download them, keep the video files, and watch them without streaming or re-streaming the content. Customers had the files on their own computers and could copy them and put them on different machines as if they really did "own" them. But there was a catch.
Actually, there were three catches. First, users of this service had to download and install the proprietary "Google Player" software. (The software was originally downloadable from http://video.google.com/playerdownload but even the Google cache of that page disappeared this week.) It served a similar function to Windows Media Player or Quicktime or other media players, but it used its own proprietary format (".gvi"). Only the Google Player could play Google Videos.
Second, you could watch the proprietary format using the proprietary player only if you were connected to the internet and authenticated yourself as the purchaser.
Since the Google Player was the only player that could read the files one purchased, users were locked-in to the DRM of authentication-over-the-internet (sometimes called the "phone home" feature). So, even if you paid for a video and "owned" the file you downloaded, you couldn't watch it unless Google allowed you to do so -- every time you watched it. This week Google simply turned off the ability for users to authenticate. Presumably, this is the way the Google rental service operated from the start: after 24 hours, you no longer had permission to view the file you downloaded. It turned out that the "purchase" program was just a temporary service as well.
This is why The Guardian described the situation this way:
And that brings us to the third catch: the Digital Millennium Copyright Act (DMCA). Although there are hacks, work-arounds, and other technical tricks that allow one to circumvent the Google phone-home DRM, they are against the law. Again, The Guardian saw the implication of this for libraries:
There is more about this story and its implications for FDLP libraries in Part Two.
More information:
- Google Video robs customers of the videos they "own", BoingBoing August 10, 2007
- Google Video service to go black by Dawn C. Chmielewski and Alex Pham Los Angeles Times, August 11, 2007
- Google's permanent video sales less-than-permanent by Cade Metz, The Register, August 11, 2007
- Google Video DRM: Why is Hollywood more important than users? by Cory Doctorow, BoingBoing, February 14, 2006
- More On Google Copy Protection by Mike Masnick, TechDirt, Mon, Jan 9th 2006
- Google's Copy Protection: Supplying The Tools For Others To Be Evil by Mike Masnick, TechDirt, Fri, Jan 6th 2006
- Google Video (beta) by Troy Dreier, CNet, 2/7/06
- Google Video Player Terms and Conditions Google Video
- Good Uses for DRM Jimmy Palmer, DRM Blog (September 2. 2005) [good description of "phone home" DRM]
Continue reading →Continue Reading →