April 13, 2008 4:22 AM
Search strategies to explore the invisible web
Google has announced a new search strategy to explore the invisible web. Invisible web comprises web documents that have not been indexed yet. Google's new search strategy is to retrieve invisible information from the web sites that use HTML forms by providing input data to HTML input controls. As mentioned in the post that announces this search strategy they shall honor the privacy policy of a web site by processing robots.txt file and META tag 'ROBOTS' and avoid HTTP requests that require user information processing.
» Continue reading Search strategies to explore the invisible web.
