CompetitorPriceMonitorBot

CompetitorPriceMonitorBot is the crawler of Rivalboard: Competitor Prices, a Shopify app. A merchant who uses the app has added your store as a competitor, and the app reads your store's public product feed to show that merchant price, stock and new-product changes.

What it requests

• /robots.txt, at most once a day per host.
• /products.json?limit=250&page=N, the public product feed Shopify serves for every store. Nothing else: no product pages, no cart, no checkout, no account pages.

How it behaves

• It identifies itself honestly with this User-Agent: CompetitorPriceMonitorBot/1.0 (+https://competitor-price-monitor-a5qj.onrender.com/bot)
• At most one request per second to your store, usually a few requests once a day or once a week.
• It backs off on HTTP 429 and 5xx answers and honours Retry-After.
• It honours Crawl-delay. If you ask for more than 10 seconds between requests, it stops reading your store.
• It does not use proxies, does not run JavaScript, keeps no cookies and never tries to get past a password page, a login or bot protection.
• Product descriptions and images are not stored, and nothing is copied into any other store.

How to opt out

Add this to your robots.txt. The app will stop reading your store at its next check and tell the merchant your store can't be monitored.

To block only the product feed, use Disallow: /products.json. Questions: jtpalms98@gmail.com.