I don't know much about how 'robots' (when i say robots i mean the robots that index your site...) but i was wondering, will i have to make a robots.txt file that excludes files that are not linked at all in my webpages, like i have seperate .php files that are included, (using the include(''); ) and i dont know, but would the google robot, index the php files that are included, or do i need to put all of them in a robots.txt file?
2007-07-11 12:25:01 · 2 answers · asked by willy 5 in Computers & Internet ➔ Internet ➔ Google
Have a look at this site, it may have the answer to your questions.
http://www.robotstxt.org/wc/faq.html
Regards, Zyfert
http://webhosting.cybersprout.com
2007-07-11 13:22:20 · answer #1 · answered by Zyfert 7 · 0⤊ 0⤋
Why don't you visit http://www.praveenkodur.com/blog/ a great place for SEO, SEM, Online Marketing.
You will find answers to all questions... If don't, then please comment on my blog, you will get answers...or you can email me...
2007-07-12 15:53:15 · answer #2 · answered by Anonymous · 0⤊ 0⤋