Home » post » Google to index government deep web?

Our mission

Free Government Information (FGI) is a place for initiating dialogue and building consensus among the various players (libraries, government agencies, non-profit organizations, researchers, journalists, etc.) who have a stake in the preservation of and perpetual free access to government information. FGI promotes free government information through collaboration, education, advocacy and research.

Google to index government deep web?

Google seeks better access to government information By Daniel Pulliam, GovExec (October 25, 2006).

As much as 40 percent of the content on agency Web sites is invisible to Google’s crawlers, [J.L.] Needham [a strategic partner development manager at Google] said, which means that for a majority of Internet users who do not know how to look beyond a search engine site, that information is effectively invisible.

Needham said he is meeting with a variety of undisclosed agencies to discuss how the information housed in their databases can be made available in the search results from engines such as Google, Yahoo or MSN. One method would be to use Google Sitemaps..

Perhaps of even greater interest is this:

A Dec. 16, 2005, memorandum from Clay Johnson, deputy director for management at the Office of Management and Budget, states that all agencies must set up their public information so that it is searchable by Sept. 1, 2006. It states that “increasingly sophisticated Internet search functions” can “greatly assist agencies in this area.”

Agencies also were required to provide all public data in an open format that allows the public to aggregate “or otherwise manipulate and analyze the data to meet their needs” by Dec. 31, 2005, according to a separate OMB memorandum signed by Johnson on Dec. 17, 2004.

CC BY-NC-SA 4.0 This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.


Leave a comment

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Archives