One thing that's so fundamental that it often still has to solved is the principle that a engine and a search directory (article directory) are not exactly the same thing. The traditional search engines add Web site pages for their databases automatically and then rank them in popularity within th