Google seeks better access to government information By Daniel Pulliam, GovExec (October 25, 2006).
As much as 40 percent of the content on agency Web sites is invisible to Google’s crawlers, [J.L.] Needham [a strategic partner development manager at Google] said, which means that for a majority of Internet users who do not know how to look beyond a search engine site, that information is effectively invisible.
Needham said he is meeting with a variety of undisclosed agencies to discuss how the information housed in their databases can be made available in the search results from engines such as Google, Yahoo or MSN. One method would be to use Google Sitemaps..
Perhaps of even greater interest is this:
A Dec. 16, 2005, memorandum from Clay Johnson, deputy director for management at the Office of Management and Budget, states that all agencies must set up their public information so that it is searchable by Sept. 1, 2006. It states that “increasingly sophisticated Internet search functions” can “greatly assist agencies in this area.”
Agencies also were required to provide all public data in an open format that allows the public to aggregate “or otherwise manipulate and analyze the data to meet their needs” by Dec. 31, 2005, according to a separate OMB memorandum signed by Johnson on Dec. 17, 2004.