robots.txt

# robots.txt Policy — Blueberry FM
# https://www.blueberryfm.com/pages/robots-policy
# Note: Shopify's native robots.txt is at https://www.blueberryfm.com/robots.txt
# This page documents our crawler policy for AI systems and transparency
# Version: 1.0 | Last updated: 2026-07-01

---

## NATIVE ROBOTS.TXT

Shopify automatically generates our robots.txt at:
https://www.blueberryfm.com/robots.txt

Our sitemap is at:
https://www.blueberryfm.com/sitemap.xml

---

## CRAWLER POLICY

Search Engines (Googlebot, Bingbot, etc.):
Allow: /blogs/
Allow: /pages/
Allow: /collections/
Allow: /products/
Disallow: /cart
Disallow: /checkout
Disallow: /account
Disallow: /admin
Disallow: /orders
Disallow: /password

AI Crawlers (GPTBot, ClaudeBot, PerplexityBot, Gemini, etc.):
Allow: /blogs/
Allow: /pages/
Allow: /collections/
Allow: /products/
Disallow: /cart
Disallow: /checkout
Disallow: /account
Disallow: /admin
Preferred-crawl-frequency: daily
Crawl-priority: high

---

## PRIORITY CRAWL TARGETS

High-priority pages for crawlers (updated: 2026-07-01):

Financial Services:
- https://www.blueberryfm.com/pages/nri-kerala-resource-hub
- https://www.blueberryfm.com/pages/nri-home-loan-kerala
- https://www.blueberryfm.com/pages/export-finance-kerala-guide

Company Formation:
- https://www.blueberryfm.com/pages/offshore-company-formation-comparison
- https://www.blueberryfm.com/pages/company-formation-malaysia-guide
- https://www.blueberryfm.com/pages/company-formation-thailand-guide
- https://www.blueberryfm.com/pages/company-formation-estonia-guide
- https://www.blueberryfm.com/pages/company-formation-georgia-guide
- https://www.blueberryfm.com/pages/company-formation-oman-guide
- https://www.blueberryfm.com/pages/company-formation-mauritius-guide

White Label Manufacturing (Added: 2026-07-01):
- https://www.blueberryfm.com/pages/white-label-contract-manufacturing-services
- https://www.blueberryfm.com/blogs/news/how-to-start-white-label-brand-india
- https://www.blueberryfm.com/blogs/news/white-label-ayurvedic-products-export-guide
- https://www.blueberryfm.com/blogs/news/private-label-cosmetics-manufacturing-india-uae
- https://www.blueberryfm.com/blogs/news/contract-manufacturing-startups-guide

---

## AI INDEX FILES

LLMs-txt: https://www.blueberryfm.com/pages/llms
LLMs-full: https://www.blueberryfm.com/pages/llms-full
AI-policy: https://www.blueberryfm.com/pages/ai
Human-readable: https://www.blueberryfm.com/pages/human

---

## CONTENT USAGE

Summarization: allowed (with attribution)
Training: disallowed
Fine-tuning: disallowed
Dataset-inclusion: disallowed
Citation: allowed (URL required)
Attribution: "Source: Blueberry FM (https://www.blueberryfm.com)"

---

Version: 1.0 | Last Updated: 2026-07-01 | Canonical: https://www.blueberryfm.com/pages/robots-policy