# All agents get same treatment ... User-agent: * Disallow: /*.gif$ # Direct to image Disallow: /*.jpg$ # Direct to image Disallow: /*.ttf$ # Direct to font Disallow: /*.exe$ # Direct to font Disallow: /1963/index.html # Limit traffic for OldEng font Disallow: /1963/det0500.html # Limit traffic for OldEng font Disallow: /1963/det0501.html # Limit traffic for OldEng font User-agent: psbot Disallow: / User-agent: ConveraCrawler # Too inefficient Disallow: / User-agent: ConveraMultiMediaCrawler Disallow: / User-agent: TurnitinBot Disallow: / # Enough, already!!