# EcoAzarin — robots User-agent: * Allow: / # Private / non-indexable areas (both pretty URLs and .html variants) Disallow: /admin Disallow: /admin.html Disallow: /auth Disallow: /auth.html Disallow: /profile Disallow: /profile.html Disallow: /notifications Disallow: /notifications.html Disallow: /search-results Disallow: /search-results.html Disallow: /hero Disallow: /hero.html Disallow: /api/ # Honeypot traps (Phase 2) — real crawlers must never hit these Disallow: /wp-login.php Disallow: /wp-admin Disallow: /xmlrpc.php Disallow: /.env Disallow: /api/internal/debug Disallow: /admin-secret-login Disallow: /honeypot-trap Disallow: /fake-sitemap-trap.xml # Block tracking / campaign URL parameters from crawling Disallow: /*?utm_ Disallow: /*&utm_ Disallow: /*?ref= Disallow: /*?fbclid= # AI / generative engine crawlers explicitly welcomed for public content User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / Sitemap: https://ecoazarin.com/sitemap.xml # Discovery feeds (allowed under User-agent: * Allow: /) # - https://ecoazarin.com/rss.xml # - https://ecoazarin.com/llms.txt