Comments on: Disable Search Engine Indexing http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/ every Pixel has a meaning! Tue, 03 Mar 2009 08:30:18 +0000 http://wordpress.com/ hourly 1 By: azimyasin http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-651 azimyasin Fri, 16 May 2008 13:43:12 +0000 http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-651 There are certain senarios when some one wont want his/her site to get crawled by any crawler b/c crawlers do consume bandwidth suppose you have a site which is indexed on google and it gets updated regularly! Crawlers would regularly visit your website consume your webserver bandwidth and update the content over there search engine however you might not want them to visit again and again ! in that case it would be of particular importance to not to allow them to access the web again and again ! Regards Azeem There are certain senarios when some one wont want his/her site to get crawled by any crawler b/c crawlers do consume bandwidth suppose you have a site which is indexed on google and it gets updated regularly! Crawlers would regularly visit your website consume your webserver bandwidth and update the content over there search engine however you might not want them to visit again and again ! in that case it would be of particular importance to not to allow them to access the web again and again !

Regards
Azeem

]]> By: SPAZ http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-650 SPAZ Sat, 03 May 2008 14:19:19 +0000 http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-650 can you use it to stop certain keywords being searched and how? can you use it to stop certain keywords being searched and how?

]]> By: Abdul Basit http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-649 Abdul Basit Mon, 26 Nov 2007 17:51:48 +0000 http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-649 you guys get a room :p you guys get a room :p

]]> By: Ammar http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-648 Ammar Mon, 26 Nov 2007 16:12:28 +0000 http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-648 ahaan, but wudnt NU prefer to be on google? ahaan, but wudnt NU prefer to be on google?

]]> By: Em http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-647 Em Mon, 26 Nov 2007 14:56:23 +0000 http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-647 Apart from that, there are certain Govt. and Security sites which do not wish to be listed on Google. And many other small corporate wish the same for their internal sites. Apart from that, there are certain Govt. and Security sites which do not wish to be listed on Google. And many other small corporate wish the same for their internal sites.

]]> By: Em http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-646 Em Mon, 26 Nov 2007 13:28:29 +0000 http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-646 There are sites like www.nu.edu.pk ;) and many more! There are sites like http://www.nu.edu.pk ;) and many more!

]]> By: Ammar http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-645 Ammar Mon, 26 Nov 2007 11:11:36 +0000 http://axdimensions.wordpress.com/2007/11/26/disable-search-engine-indexing/#comment-645 Why would anyone want NOT to be listed? Anyway, nice tip mooosooo!!! Why would anyone want NOT to be listed? Anyway, nice tip mooosooo!!!

]]>