<!-- wp:paragraph -->
<p>https://community.shopify.com/c/Technical-Q-A/Robots-txt-Editing-support-now-available/m-p/1214502#M58669</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p></p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>Search engines, such as Google, constantly crawl the internet in search of new data as a source for their search results. The robots.txt file tells search engine bots, known as crawlers, which pages to request to view from your online store.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>All Shopify stores have a default robots.txt file that's optimized for Search Engine Optimization (SEO). Previously editing this file wasn’t possible but now that’s changed!&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>With a recent update, it’s now possible to customize your robots.txt from the optimized version that is being used currently in your shop. A few of the edits you might consider include:&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:list -->
<ul><li>Allow, or disallow certain URLs from being crawled</li><li>Adding crawl-delay rules</li><li>Adding extra sitemap URLs</li><li>Blocking certain crawlers</li></ul>
<!-- /wp:list -->

<!-- wp:heading {"level":4} -->
<h4 id="toc-hId--685725163">Caution</h4>
<!-- /wp:heading -->

<!-- wp:paragraph -->
<p>Please be mindful that this is an&nbsp;<strong>unsupported customization</strong>, and incorrectly applied edits can have significant impacts on your traffic.&nbsp; If you are encountering issues after modifying robots.txt, restoring the default robots.txt configuration is possible. For guidance on how to do this please review:&nbsp;<a href="https://help.shopify.com/en/manual/promoting-marketing/seo/editing-robots-txt#delete-robots-txt-liquid-customizations" target="_blank" rel="noreferrer noopener">Delete robots.txt.liquid customizations</a>.&nbsp;</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p>If you would like assistance customizing your robots.txt file you will need to hire a&nbsp;<a href="https://experts.shopify.com/services/marketing-and-sales/seo-and-paid-search" target="_blank" rel="noreferrer noopener">Shopify Expert&nbsp;</a>as Shopify Support can not help with the edits you would like to make, nor provide feedback before implementing changes.<br><br>Check out the links below to learn more about this new feature, as well as reviewing some examples found in our developer documentation. If you have any questions about this feature leave a reply below!<br><br>If you are looking for community feedback on some edits you are looking into, consider posting a detailed message on our&nbsp;<a href="https://community.shopify.com/c/Technical-Q-A/bd-p/technical-qa" target="_blank" rel="noreferrer noopener">Technical Q&amp;A</a>&nbsp;discussion board.</p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p><strong>Supporting Content:</strong></p>
<!-- /wp:paragraph -->

<!-- wp:list -->
<ul><li><a href="https://help.shopify.com/en/manual/promoting-marketing/seo/editing-robots-txt" target="_blank" rel="noreferrer noopener">Shopify Help Center</a><ul><li><a href="https://help.shopify.com/en/manual/promoting-marketing/seo/editing-robots-txt" target="_blank" rel="noreferrer noopener">Editing robots.txt.liquid&nbsp;</a></li></ul></li><li><a href="https://shopify.dev/tutorials/customize-theme-customize-robots-txt-liquid" target="_blank" rel="noreferrer noopener">Shopify Developers</a><ul><li><a href="https://shopify.dev/tutorials/customize-theme-customize-robots-txt-liquid" target="_blank" rel="noreferrer noopener">Tutorial: Customize robots.txt.liquid&nbsp;</a></li><li><a href="https://shopify.dev/docs/themes/theme-templates/robots-txt-liquid" target="_blank" rel="noreferrer noopener">Reference: robots.txt.liquid</a></li><li><a href="https://shopify.dev/docs/themes/liquid/reference/objects/robots" target="_blank" rel="noreferrer noopener">The robots object</a></li><li><a href="https://shopify.dev/docs/themes/liquid/reference/objects/group" target="_blank" rel="noreferrer noopener">The group object</a></li><li><a href="https://shopify.dev/docs/themes/liquid/reference/objects/rule" target="_blank" rel="noreferrer noopener">The rule object</a></li><li><a href="https://shopify.dev/docs/themes/liquid/reference/objects/sitemap" target="_blank" rel="noreferrer noopener">The sitemap object</a></li><li><a href="https://shopify.dev/docs/themes/liquid/reference/objects/user-agent" target="_blank" rel="noreferrer noopener">The user_agent object</a></li></ul></li><li><a href="https://developers.google.com/search/docs/advanced/robots/intro" target="_blank" rel="noreferrer noopener">Google Search Central</a><ul><li><a href="https://developers.google.com/search/docs/advanced/robots/intro" target="_blank" rel="noreferrer noopener">Introduction to robots.txt</a></li></ul></li></ul>
<!-- /wp:list -->

<!-- wp:paragraph -->
<p><strong>Trevor | Community Moderator @ Shopify&nbsp;</strong><br>&nbsp;- Was my reply helpful? Click&nbsp;<strong>Like</strong>&nbsp;to let me know!&nbsp;<br>&nbsp;- Was your question answered? Mark it as an&nbsp;<strong>Accepted Solution<br></strong>&nbsp;- To learn more visit the&nbsp;<a href="https://bit.ly/3itITEC">Shopify Help Center</a>&nbsp;or the&nbsp;<a href="https://bit.ly/3izVw0T">Shopify Blog</a></p>
<!-- /wp:paragraph -->

<!-- wp:paragraph -->
<p><a href=""></a></p>
<!-- /wp:paragraph -->