About ShelfwinBot
ShelfwinBot is the crawler behind the free Shelfwin agent-readiness scan. When someone scans a store, it fetches a small number of public pages: the homepage, a few product pages, and standard files like robots.txt, sitemap.xml, llms.txt, and public policy pages.
- Scans run only when a person requests one. Nothing is crawled on a schedule.
- Around twenty requests per scan, paced, with timeouts and strict size caps.
- No login pages, no checkout flows, no personal data. Public pages only.
- Scan results are computed on the fly. We only save a report when we send it directly to that store's owner.
Questions or want your store excluded? Email ahmedtariqcs@gmail.com and we'll block scans of your domain.