# Robots.txt file # For domain: http://www.jeugdengezin.nl/ # All robots will spider the domain User-agent: * Disallow: /bluedome/ Disallow: /data/ Disallow: /images/ Disallow: /includes/ Disallow: /Results/ Disallow: /verity/ Disallow: /errors/ Disallow: /en/includes/ Disallow: /nieuws/ Disallow: /rss/ Disallow: /nieuwsbrieven/html/