User-agent: Googlebot Disallow: /app/classes/ Disallow: /app/config/ Disallow: /app/core/ Disallow: /app/database/ Disallow: /app/functions/ Disallow: /app/models/ Disallow: /app/plugins/ Disallow: /myspace Disallow: /articles Disallow: /click Disallow: /ajax Disallow: /mobile Disallow: /uploads User-agent: Twitterbot Disallow: /app/classes/ Disallow: /app/config/ Disallow: /app/core/ Disallow: /app/database/ Disallow: /app/functions/ Disallow: /app/models/ Disallow: /app/plugins/ Disallow: /myspace Disallow: /articles Disallow: /click Disallow: /ajax Disallow: /mobile Disallow: /uploads User-agent: * Disallow: