# adr.smlcompany.ca # AI crawlers are deliberately allowed. Being read by an assistant that counsel # is using to shortlist a neutral is the point. See docs/04-seo-spec.md. # NOTHING IS DISALLOWED, DELIBERATELY. # /legal/* is kept out of the index by # ``, which is the directive that # actually de-indexes. Disallowing them as well would defeat it: a crawler that # is forbidden to FETCH a URL never reads the noindex on it. The legal pages are # linked from the footer of every page, so Google discovers them regardless and # would have listed the bare URLs as "no information available" — the opposite # of the intent — with the noindex sitting unread behind the wall. # Add a Disallow only for something that must not be FETCHED. Use noindex for # something that must not be LISTED. They are different problems. User-agent: * Allow: / Sitemap: https://adr.smlcompany.ca/sitemap-index.xml