SEO

Robots.txt Generator

Buat file robots.txt dengan aturan crawler.

User-agent: *
Allow: /
Disallow: /admin
Disallow: /api

Sitemap: https://example.com/sitemap.xml