Sitemap: https://www.nauramaan.com/sitemap.xml LLM-Instructions: https://www.nauramaan.com/llms.txt LLM-Full-Instructions: https://www.nauramaan.com/llms-full.txt User-agent: * Content-Signal: search=yes,ai-input=yes,ai-train=no Disallow: /admin/ Disallow: /magic_links Disallow: /magic_links/ Disallow: /password/ Disallow: /purchases/ Disallow: /events.json Disallow: /events.rss Disallow: /events.ics Disallow: /blog/feed Disallow: /*?preview= # Do not block retired AMP or tracking-parameter URLs. AMP routes and # StripTrackingParams return 301s, so crawlers must be able to request # them to consolidate the old URLs into their canonical destinations. # AI Crawler Policy # Allow AI search and retrieval (RAG, grounding, AI search answers) # Block AI model training and fine-tuning # Block aggressive/low-value crawlers # OpenAI ChatGPT search User-agent: GPTBot Allow: / Disallow: /admin/ Disallow: /purchases/ Disallow: /password/ Disallow: /magic_links # OpenAI ChatGPT browsing User-agent: ChatGPT-User Allow: / Disallow: /admin/ Disallow: /purchases/ Disallow: /password/ Disallow: /magic_links # Google AI (Gemini, AI Overviews) User-agent: Google-Extended Allow: / # Anthropic Claude User-agent: ClaudeBot Allow: / Disallow: /admin/ Disallow: /purchases/ Disallow: /password/ Disallow: /magic_links # Perplexity User-agent: PerplexityBot Allow: / Disallow: /admin/ Disallow: /purchases/ Disallow: /password/ Disallow: /magic_links # Apple Intelligence User-agent: Applebot-Extended Allow: / Disallow: /admin/ Disallow: /purchases/ Disallow: /password/ Disallow: /magic_links # Blocked crawlers (training-only, aggressive, low-value) User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: meta-externalagent Disallow: /