# Disallow list for outside web crawlers User Agent: * Disallow: /boards/archive/ Disallow: /jobs/search.asp Disallow: /jobs/register.asp