# This robots.txt file controls crawling of URLs under https://www.britishcolumbia.ca User-agent: * Crawl-delay: 2 Disallow: /wp-admin/ Disallow: /refer/ Disallow: /persona/* Disallow: /test/* Disallow: /taxonomy/* Disallow: /resource/* Disallow: /tir/* Disallow: /office/* Disallow: /feed/* Disallow: /content/* Disallow: /?term=* Disallow: /search/ Disallow: /?taxonomy= Disallow: /?first_nations_category=* # BEGIN W3TC ROBOTS User-agent: * Disallow: /wp-content/cache/ # END W3TC ROBOTS Disallow: /wp-content/uploads/wpcf7_captcha/ Sitemap: https://www.britishcolumbia.ca/sitemap_index.xml