User-Agent: *
Allow: 

User-agent: Twitterbot
 Disallow: