This is a simple Silverstripe module for managing the rules list that are rendered or displayed from the robots.txt
file. The robots.txt
file is typically used for informing search engines how to crawl your website, and which content or pages to exclude from their results.
Find below a snippet for installing this module with Composer.
composer require loveduckie/silverstripe-robots
TBD
TBD