User-agent: * Allow: / Disallow: /avail.ashx User-agent: ia_archiver Disallow: / User-agent: TurnitinBot Disallow: / User-agent: NaverBot Disallow: / User-agent: Googlebot-Image Disallow: /images/diagrams/cache/ Disallow: /avail.ashx User-Agent: Googlebot Disallow: /images/diagrams/cache/ Disallow: /avail.ashx User-agent: CCBot Disallow: / User-Agent: adidxbot Disallow: /images/diagrams/cache/ Disallow: /avail.ashx User-Agent: Adsbot-Google Disallow: /images/diagrams/cache/ Disallow: /avail.ashx