#Disalow dinamic content and things which will clutter the logs User-agent: * Disallow: /cgib-private/ Disallow: /cgib-public/ Disallow: /phpMyAdmin/ Disallow: /unused origianl html's/