|
Thanks to: 
|
iTools
[Off Topic] robots.txt
| To: | itools@xxxxxxxxxxxxxxx |
|---|---|
| Subject: | [Off Topic] robots.txt |
| From: | Dan Tappin <dan_itools001@xxxxxxxxxxxx> |
| Date: | Tue, 29 Jul 2003 08:46:02 -0600 |
|
Can some one point me to a good robots.txt FAQ and / or post an example file? I am looking for a simple one to limit the robots to my home page and try to prevent the crawling through my whole site. Thanks, Dan --------- Tenon Intersystems' iTools Mailing List To unsubscribe: send mail to itools-request@xxxxxxxxxxxxxxx with the body only containing: unsubscribe Find the searchable mailing list archives at: http://itools.blackpepper.co.nz/ |
| <Prev in Thread] | Current Thread | [Next in Thread> |
|---|---|---|
| ||
| Previous by Date: | Re: Apache version, Mike Schienle |
|---|---|
| Next by Date: | Re: iTools 7.1 on VersionTracker, Eric Yang |
| Previous by Thread: | virtual host problems, Val Heritage |
| Next by Thread: | Re: [Off Topic] robots.txt, Joe Savelberg |
| Indexes: | [Date] [Thread] [Top] [All Lists] |
| Tenon Home | Products | Order | Contact Us | About Tenon | Register | Tech Support | Resources | Press Room | Mailing Lists |
|
Copyright©2003 Tenon Intersystems, 232 Anacapa Street, Suite 2A, Santa Barbara,
CA 93101. All rights reserved. |