User-agent: * Disallow: /cache/ Disallow: /footer.php Disallow: /header.php Disallow: /short.php