# www.robotstxt.org/ # https://code.google.com/web/controlcrawlindex/ User-agent: * Disallow: /Update/ Disallow: /download_Kunden/ Disallow: /download_Lieferanten/ Disallow: /katalog/03/files/ Sitemap: https://team3-GmbH.de/google_sitemap.xml.gz