# Sitemap declarations User-agent: * Sitemap: https://www.aspermont.com/sitemap_index.xml Sitemap: https://www.aspermont.com/news-sitemap.xml Sitemap: https://www.aspermont.com/videositemap.xml Crawl-delay: 120 Disallow: /search Disallow: /search_filter Disallow: /verify-site-login Disallow: /pdf/ # Fully exclude these robots from crawling User-agent: MJ12bot User-agent: search User-agent: BLEXBot User-agent: SemrushBot User-agent: SemrushBot-BM User-agent: dotbot User-agent: Barkrowler User-agent: Moreover User-agent: SeznamBot Disallow: /