Skip to main content

Home/ Search Engine Marketers/ Group items tagged crawling

Rss Feed Group items tagged

Filter: All | Bookmarks | Topics Simple Middle
John Britsios

Get the Google out of there! - 0 views

blog.webnauts.net/get-the-google-out-of-there

googlebot crawling google robots.txt

shared by John Britsios on 10 Feb 10 - Cached
  • John Britsios on 10 Feb 10
     
    There are times when you just don't want Google to crawl certain pages such as login pages, development pages that aren't ready to be seen or used by web surfers, temporary areas, and other web content like that. But, how can you stop Googlebot from crawling those pages anyway?
1 - 1 of 1
Showing 20▼ items per page