Shopify Now Allows Store Owners to Edit Robots.txt

WebProNews
Shopify Now Allows Store Owners to Edit Robots.txt

Shopify has enabled a long-requested feature, giving shop owners the ability to edit their robots.txt file.

Robots.txt files are an important part of web development, telling search engines what pages to index, or crawl, which ones to ignore and how often to crawl the site. The file can be especially important in helping webmasters maximize attention to specific pages, and reduce load on their websites by managing how often the search engines index it.

Until now, Shopify has never allowed its shop owners to manage their robots.txt file, limiting their ability to use one of the most basic SEO tools. Shopify CEO Tobi Lutke made the announcement via Twitter.

User-agent: everyone
Allow: /
Starting today, you have complete control over how search engine bots see your store. #shopifyseohttps://t.co/Hz9Ijj5h1y

— Tobi Lutke (@tobi) June 18, 2021

The company has posted instructions to help shop owners maximize the value of their robots.txt file.

Shopify Now Allows Store Owners to Edit Robots.txt
Matt Milano

from WebProNews https://ift.tt/2UdH6LN