ASGMatrixBot
Our crawler, what it does and how to control it.
ASGMatrixBot is the crawler that ASG Matrix uses to audit websites for AI search readiness.
User agent
Mozilla/5.0 (compatible; ASGMatrixBot/1.0; +https://asgmatrix.com/bot)
Why it visits
It visits a website only when someone adds that website to ASG Matrix (usually its owner), when a site owner runs the free AI visibility check, or when a website is tracked as a competitor. It reads public pages, robots.txt, sitemaps and llms.txt.
How it behaves
- It fetches at most a few pages at a time, with pauses in between.
- It does not submit forms, log in, or execute purchases.
- A full audit reads a limited number of pages per week.
Blocking it
Add this to your robots.txt:
User-agent: ASGMatrixBot
Disallow: /
Questions? hello@asgmatrix.com