TOOLS / 13 / WEB LAUNCH / LIVE

Robots Studio

Compose a clean robots.txt file, manage allow and disallow paths, include the sitemap location and preview which rule matches a route.

ROBOTS STUDIO / TEXT GENERATORVALID DRAFT

SITE ORIGINUSER AGENT

CRAWL RULES

ROBOTS.TXT116 BYTES

User-agent: *
Disallow: /admin/
Disallow: /private/
Allow: /admin/public/

Sitemap: https://example.com/sitemap.xml

PATH TEST / HEURISTIC

PREVIEW RESULTBLOCKEDDisallow: /admin/

This preview uses longest matching path logic. Search engines can interpret advanced wildcard and end-anchor rules differently.

OUTPUT / REALrobots.txt

Copy or download a plain-text file ready to review and place at the site root.

PREVIEW / HONESTHeuristic match

The local path tester uses longest-match logic and does not claim to emulate every crawler implementation.

LOCAL / PRIVATENo upload

Origins, paths and generated rules stay in the browser.