User-agent: * Disallow: /cron/ Disallow: /images/ Disallow: /Amazon/ Disallow: /Classes/ Disallow: /Common/ Disallow: /Data/ Disallow: /Script/ Disallow: /includes/