User-agent: * Disallow: /files/ Disallow: /members/ Disallow: /reference/ Disallow: /pdf/ Disallow: /htadmin.pl/ User-agent: ia_archiver Disallow: /