User-agent: * Disallow: /internal/ Disallow: /framework/ Disallow: /includes/ajax/ Disallow: /includes/functions/ Disallow: /includes/scripts/