South Gippsland Website Design » Remove Pages From Google http://south-gippsland.net ~ stylish, functional, affordable, successful ~ Wed, 25 Aug 2010 01:51:05 +0000 en hourly 1 http://wordpress.org/?v=3.0.1 Stop Google From Crawling Web Pages http://south-gippsland.net/stop-google-from-crawling-web-pages/ http://south-gippsland.net/stop-google-from-crawling-web-pages/#comments Thu, 20 Nov 2008 23:21:55 +0000 Elizabeth Richardson http://south-gippsland.net/?p=1120 WHY WOULD YOU WANT TO STOP GOOGLE FROM INDEXING YOUR PAGES?

Well, in some cases, you might want something to be private, like personal information, sensitive details like member numbers, or you’ve started getting spam because you left your details on a forum somewhere. The best way to stop these problems from occurring in the first place or to fix any problems you may have inadvertently created, is to remove your urls from google.

HOW TO FIND OUT WHAT PAGES HAVE BEEN INDEXED BY GOOGLE

You can do a google search of the indexed pages of your website by putting site:yoursite.com into a search box. On occassions I have seen some of the worpdress plugins or themes showing up in search results. Indexing these are of no benefit at all as most lead to a blank page. It’s good to prevent the search engines from indexing our login page too.

HOW TO STOP SEARCH ENGINES FROM CRAWLING CERTAIN PAGES OR AREAS OF YOUR WEBSITE

There are various way to stop google or other search bots from indexing pages on your site and these are listed below…

  • .htaccess file
  • robots.txt file
  • noindex
  • nofollow
  • url removal tool


    • …and this following video recorded by Matt Cutts from google, talks about how to use the google webmaster tools and shows how each of these methods of url removal really work and describes in detail the effectiveness of each method.



    Similar Articles

    ]]>     http://south-gippsland.net/stop-google-from-crawling-web-pages/feed/ 0