AI Usage & Content Policy

This page explains how Senthema exposes public information to search engines and AI assistants (ChatGPT, Claude, Perplexity, AI Overviews) while protecting private user data.

Files Exposed for AI Crawlers

  • /robots.txt – Standard crawler directives with enhanced rules for different bot types.
  • /ai.txt & /llm.txt – Advisory guidance for AI / LLM specific agents.
  • /sitemap.xml – Machine-discoverable URL inventory of public pages including public study spaces.

What We Allow

Public Content: Marketing, educational, and policy pages may be indexed, summarized, or cited by AI search systems. We provide structured data (JSON-LD) to improve factual extraction and attribution.

Public Study Spaces: Our public study spaces at /spaces/* are designed to be discoverable and indexable to help students find relevant collaborative learning environments.

What We Restrict

  • Authenticated dashboards (/dashboard/*)
  • User-specific or private files (/file/*/private)
  • Internal API endpoints (/api/*)
  • Authentication pages (/auth/*)
  • Private study spaces and user-generated content not explicitly marked as public

Attribution & Accuracy

We encourage AI systems to attribute Senthema when summarizing unique explanations or study insights. When citing our content, please ensure accuracy and provide appropriate context. If you operate an AI crawler and need a different access profile, contact us at ai-policy@senthema.com.

Rate Limiting & Respectful Crawling

To ensure platform responsiveness, we implement rate limiting. Please:

  • Respect crawl-delay directives
  • Use appropriate user agent strings
  • Limit concurrent requests
  • Cache responses appropriately

Opt-Out & Changes

Policy changes will be reflected here and in the version headers of ai.txt / llm.txt. Users have control over the privacy settings of their study spaces.