User-agent: crawl-it Disallow: /logs/ Disallow: /stichworte/ Disallow: /planetsearchplus/ Disallow: /lightbox/ Disallow: /altes_zeug/ User-agent: * Disallow: /logs/ Disallow: /stichworte/ Disallow: /planetsearchplus/ Disallow: /lightbox/ Disallow: /altes_zeug/