# Awi · Digitale Agentur — robots.txt # https://awi-website.com User-agent: * Allow: / Disallow: /Ersatz-Webseiten/kunden.html Disallow: /.claude/ Disallow: /#vip Disallow: /vip Disallow: /kunden/ # Block bad bots User-agent: PetalBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / # Sitemap Sitemap: https://awi-website.com/sitemap.xml # Crawl-friendly Crawl-delay: 1