VisibleTrustBot
VisibleTrustBot reads public company web pages so our customers can see what a business says about itself, with a link back to the page.
How it behaves
- User agent:
VisibleTrustBot/1.0 (+https://getvisibletrust.com/bot) - Obeys robots.txt (user-agent token
VisibleTrustBot), cached for up to 24 hours. - Fetches a handful of pages per site (home, about, team, contact, careers), no more than one request every half second per host.
- Doesn't log in, submit forms, or execute scripts.
Opting out
Add this to your robots.txt:
User-agent: VisibleTrustBot Disallow: /
To remove data we already hold, email privacy@getvisibletrust.com.