User-agent: * Allow: / # Sitemap location Sitemap: https://www.pdfsaathi.in/sitemap.xml # Crawl-delay for polite bots Crawl-delay: 1 # Disallow admin/private areas (if any) Disallow: /admin Disallow: /admin/dashboard Disallow: /verify-email Disallow: /reset-password Disallow: /forgot-password Disallow: /api Disallow: /*.json$