robots.txt & sitemap

Fetch robots.txt and list declared sitemaps.