StatCounter User Forum  
StatCounter Free web tracker and counter

Go Back   StatCounter User Forum > Webmaster > Lounge (non-StatCounter related topics here!)

Closed Thread
 
Thread Tools Display Modes
  #1  
Old 02-07-2006, 04:50 AM
donecweb donecweb is offline
Senior Member
 
Join Date: Mar 2005
Location: Texas
Posts: 1,026
Default robots.txt file

I read recently that if you have a robots.txt file and use robot meta tag on your page and there is a conflict between them that the meta tag will be the rule to follow. Does anyone know if this is true?
  #2  
Old 02-07-2006, 05:40 AM
webado's Avatar
webado webado is offline
Moderator
 
Join Date: Apr 2004
Location: Montreal, Quebec, Canada
Posts: 28,172
Default

Well, if the robots.txt disallowed access to the page, then the meta tag on the page is irellevant, as the (well behaved) robot would not have gone there in the first place.

If the page is visited by a robot coming from a link, then the robots.txt file is not involved, so the meta tag in the file should prevail.

This is just what makes sense to me, not necessarily what happens.
__________________
Christina
>>Forum Moderator<<

Please do not PM me for support. The forum is here for that.
Closed Thread

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 06:50 AM.


Powered by vBulletin® Version 3.8.5
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.