# --- EMERGENCY MODE: BLOCK ALL BOTS TEMPORARILY --- # We are currently experiencing high database load. # This rule blocks all crawlers (Google, Bing, etc.) to save resources. User-agent: * Disallow: / # --- ORIGINAL SETTINGS (Uncomment below to restore) --- # # --- Allow major search engines --- # User-agent: Googlebot # Allow: / # # User-agent: Bingbot # Allow: / # # User-agent: Baiduspider # Allow: / # # # --- Allow social share bots (for previews) --- # User-agent: LinkedInBot # Allow: / # # User-agent: facebookexternalhit # Allow: / # # User-agent: Twitterbot # Allow: / # # # (Optional) cover social bots that present as Mozilla/5.0 # User-agent: Mozilla/5.0 # Allow: / # # User-agent: Slackbot-LinkExpanding # Allow: / # # # --- Block Perplexity explicitly --- # User-agent: PerplexityBot # Disallow: / # # # --- Block all other bots by default --- # # (NOTE: This is commented out because the emergency rule at the top handles it) # # User-agent: * # # Disallow: /