How search engines work, including the difference between crawler-based search engines and human-powered directories. Explanation of what a spider is and how it crawls web pages.
Recently, Cuil, a new search engine, has received a lot of press. But another UK-based search engine True Knowledge is quietly entering the fray as well.