Crawler Information
PinBoostrBot
PinBoostrBot fetches sitemap files and page metadata for website owners who connect their own sites to PinBoostr.
Last updated: October 12, 2026
Bot Profile
- Bot name
- PinBoostrBot
- Purpose
- Fetch sitemap and page metadata for connected website owners
- User-Agent
- PinBoostrBot/1.0 (+https://pinboostr.com/bot)
- Respect robots.txt
- Yes
- Crawl rate
- Typically 1 request every 2-5 seconds per connected site
- Contact
- support@pinboostr.com
IP Ranges
- 95.111.234.0/32
- 2a02:c207:2290:4028::/64
Machine-readable list: https://pinboostr.com/bot/ips.json
Sitemaps First
The bot starts with declared sitemap URLs and common sitemap index locations before reading page metadata.
Robots Aware
PinBoostrBot checks robots.txt and skips URLs that disallow PinBoostrBot or all crawlers.
Rate Limited
Requests are throttled per site and cached so repeated checks avoid unnecessary crawling.
Block or Allow PinBoostrBot
Site owners can control PinBoostrBot with standard robots.txt rules. For example:
User-agent: PinBoostrBot
Disallow: /
User-agent: PinBoostrBot
Allow: /