The first Web search engine was developed by Matthew Gray at MIT in 1993 including robot, the Perl-based World Wide Web Wanderer, and used it to generate an index called 'Wandex'.
Archi is considered to be the first Search Engine in the world.From Wikipedia:http://en.wikipedia.org/wiki/Archie_search_engine"Archie is a tool for indexing FTP archives, allowing people to find specific files. It is considered to be the first Internet search engine.[1] The original implementation was written in 1990 by Alan Emtage, Bill Heelan, and J. Peter Deutsch, then students at McGill University in Montreal."If it is the first Web-search engine (with websites instead of FTP's) then the answer is Wandex.From Wikipedia:http://en.wikipedia.org/wiki/Web_search_engine"The first Web search engine was Wandex, a now-defunct index collected by the World Wide Web Wanderer, a web crawler developed by Matthew Gray at MIT in 1993. Another very early search engine, Aliweb, also appeared in 1993. JumpStation (released in early 1994) used a crawler to find web pages for searching, but search was limited to the title of web pages only. One of the first "full text" crawler-based search engines was WebCrawler, which came out in 1994. Unlike its predecessors, it let users search for any word in any webpage, which became the standard for all major search engines since. It was also the first one to be widely known by the public. Also in 1994 Lycos (which started at Carnegie Mellon University) was launched, and became a major commercial endeavor."