Main :: My Favorite Tools :: Search :: Contact :: Feedback :: Your Privacy :: Link to Us :: Terms of Service
add us to your favorites | google | yahoo | stumbleupon | delicious
Free online web tools and free code generators!Free online web tools and free code generators!
Free online web tools and free code generators!
Free online web tools and free code generators!Free online web tools and free code generators!
Support & FAQ's :: Login :: Sign-UpLegend Quick Nav:
...providing web tools since 2001!

WebPage-Tools.comWebPage-Tools.comWebPage-Tools.comWebPage-Tools.comWebPage-Tools.com
WebPage-Tools.com 
 
Terms of Service - please read!

Mail List: Enter your e-mail to be notified when we update our site!
more info
Add Remove
       


E-mail Discussion List:
HTML-on-the-WEB
Ask and respond to HTML
& web design related questions!
[ subscribe | info | rules ]



 

WebPage-Tools.comWebPage-Tools.com
Tool Infotool: Robots.txt CreatorFAQ's faq's  
saving: copy/paste
instructions: Robots are programs used by search engines to index web pages on the internet. If you have any files or folders that you do not want indexed, you should create a robots.txt file.
generated code works with: not all robots will obey these instructions, although most major search engines and directories will.

This is a member's only tool. Not a member? Join now for $4.95!

Instructions: Enter each file and/or folder you want to include in your robots.txt file. Only use one space per file/folder and only use as many as required. See the examples below first. Do not use full Url's when adding files and/or folders.

Examples:
/test.asp   (block test.asp)
/sample/test.asp   (block test.asp but not sample directory)
/private   (block private directory)
/private/myfiles   (block myfiles directory but not private directory)
/private/myfiles/test.asp   (block test.asp but not myfiles or private directory)















Login or Sign-Up

WebPage-Tools.comWebPage-Tools.comWebPage-Tools.comWebPage-Tools.comWebPage-Tools.com


[ Main Page | Updates Mailing List | Link To Us | Search]
[ Contact Us | Privacy | Feedback | Page/Site Problem Report | TOS ]

Problem with this page? Please let us know!


All rights reserved. All material contained within this web site is protected by Canada, US and International copyright laws.
Please view the Terms of Service before using any of the tools, resources, generated code, or scripts offered on this site.