Free Database of the Entire Web May Spawn the Next Google - 0 views
-
kevin smith on 24 Jan 13A nonprofit called Common Crawl is now using its own web crawler and making a giant copy of the web that it makes accessible to anyone. The organization offers up more than 5 billion web pages, available for free so that researchers and entrepreneurs can try things otherwise possible only for those with access to resources on the scale of Google's.