ToolNova

Robots.txt Generator

Generate a properly formatted robots.txt file to control how search engines crawl your site.

How It Works

  1. 1Set your user-agent and add allow/disallow rules.
  2. 2Optionally add your sitemap URL.
  3. 3Copy or download the file.

Features

  • Multiple allow/disallow rules
  • Optional sitemap directive

Privacy

This tool runs entirely in your browser. Nothing you enter is sent anywhere.

Related Tools

Meta Tag Generator

Generate title, description, Open Graph and Twitter meta tags.

Web Tools

User Agent Viewer

View your browser's user agent string and parsed device details.

Web Tools

IP Information

See your current public IP address and basic browser details.

Web Tools

Sitemap Generator

Generate a sitemap.xml file from a list of page URLs.

Web Tools