# All robots will spider the domain User-agent: * Disallow: /*/comments/feed/$ Disallow: /*/feed/$ Disallow: /*/feed/atom/$ Disallow: /*/feed/rss/$ Disallow: /*/rss/$ Disallow: /*/trackback/$