User-agent: * Disallow: /ajax/ Disallow: /assets/ Disallow: /busy/ Disallow: /cms/ Disallow: /comingsoon/ Disallow: /landing/ Disallow: /oops/ Disallow: /site/