User-agent: Scrapy Allow: / User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/fonts/ Disallow: /wp-includes/ID3/ Disallow: /wp-includes/images/ Disallow: /wp-includes/pomo/ Disallow: /wp-includes/SimplePie/ Disallow: /wp-includes/Text/ Disallow: /wp-includes/theme-compat/ Disallow: /wp-content/cache/ Sitemap: https://www.sgrr.es/sitemap.xml