User-agent: * #direct all spiders Disallow: /extra Disallow: /images User-agent: Roverbot Disallow: /