User-Agent: *
Disallow: /404

User-Agent: *
Allow: /

Sitemap: https://www.webscrapingapi.com/sitemap-index.xml