This is the name of the Inktomi spider. The Slurp spider will crawl web site pages and index them for inclusion in search engine results. Currently Slurp is indexing pages from the Yahoo! seach engine. It will follow any hyperlink on the World Wide Web except those disallowed to be crawled by a robots.txt. Until recently it used the software platform Unix, and was designed using the software language C/C++.