# http://www.goodart.de/robots.txt # MassenDownloader, E-Mail-Sammler fernhalten User-agent: wget User-agent: webzip User-agent: webmirror User-agent: webcopy User-agent: EmailCollector User-agent: GagaRobot Disallow: / # Verzeichnisse und Dat. ausschließen User-agent: * Disallow: /gast/ Disallow: /dirk-bewerbung/ Disallow: /rolandgeissel/siteimg Disallow: /logfiles/ Disallow: /links/ Disallow: /img/ Disallow: /flash/ Disallow: /cgi-bin/ Disallow: /adressen.txt Disallow: /website.css Disallow: /site.css