# robots.txt - some robots will look at this file to see what not to index User-agent: * Disallow: /robots.txt Disallow: /pics/ Disallow: /general/webalizer/