User-agent: * Disallow: /index.php Disallow: /?* Disallow: /addurl.php User-agent: Slurp Disallow: /