Robots.txt Generator

Use this tool to generate a simple robots.txt file for your website, allowing you to hide files or directories that you don’t wish to be spidered. This generator tool is designed to create the text for the file for you and for you to then make changes should you feel necessary to afterwards.

Generating a robot file with this little number is ideal if you wish to block certain directories or files from search engines.

To use the generator tool, enter the required information below and click the button. You will then be shown the text for the file. Copy this to a file called robots.txt and place on the root of your website (same place as your home page).

Robots.txt Generator Tool © SEO Chat™ Allowed User Agent Select user agent or use default for all agents All AgentsAlexa AgentAltaVista AgentAOL Netfind/Excite AgentGoogle AgentHotBot AgentInfoSeek AgentLycos AgentMSN Search CrawlerNorthern Lights AgentWebcrawler Agent Enable All Webpages Yes No Exclude These URL's Enter URLs you wish to exclude /cgi-bin/ /images/