# Robots.txt for Hanano Animals Welfare Organization (HAWO) # https://hanano.org User-agent: * Allow: / # Specific crawlers User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / User-agent: Baiduspider Allow: / User-agent: YandexBot Allow: / User-agent: facebookexternalhit Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / # Disallow admin areas (if any) Disallow: /admin/ Disallow: /api/ Disallow: /_next/ Disallow: /private/ # Allow important files Allow: /sitemap.xml Allow: /robots.txt Allow: /favicon.ico Allow: /images/ Allow: /videos/ # Crawl delay (optional - be respectful) Crawl-delay: 1 # Sitemap location Sitemap: https://hanano.org/sitemap.xml # Host directive (helps with canonicalization) Host: https://hanano.org