Did you know all Shopify stores start with the same robots.txt?
This works for most smaller start-up shops, but the company has moved on to make the robots.txt file editable.
Site owners can make the following edits to the robots.txt file:
- Allow or disallow specific URLs from being crawled
- Add crawl-delay rules for certain crawlers
- Add extra sitemap URLs
- Block certain crawlers
If you want to edit the robots.txt.liquid file, then you should work with a Shopify Expert (#TriangleDirectMedia) or have expertise in code edits and SEO.
If you want to edit the robots.txt.liquid file, then you should work with a Shopify Expert (#TriangleDirectMedia) or have expertise in code edits and SEO.
Shopify warns explicitly,
“editing the robots.txt.liquid file is an unsupported customization,” meaning their support team will not help with edits. “Incorrect use of the feature can result in loss of all traffic,”
Site owners and SEOs will be pretty happy with this announcement by #Shopify. Look for this option to able very soon if not already for your site.