PinBoostrBot
PinBoostrBot fetches sitemap files and page metadata for website owners who connect their own sites to PinBoostr.
Last updated: June 1, 2026
Bot Profile
- Bot name
- PinBoostrBot
- Purpose
- Fetch sitemap and page metadata for connected website owners
- User-Agent
- PinBoostrBot/1.0 (+https://pinboostr.com/bot)
- Respect robots.txt
- Yes
- Crawl rate
- Typically 1 request every 2-5 seconds per connected site
- Contact
- support@pinboostr.com
IP Ranges
PinBoostrBot currently runs from PinBoostr production infrastructure. Public fixed IP ranges are not published yet. Site owners who need current source IP details can contact support@pinboostr.com.
Sitemaps First
The bot starts with declared sitemap URLs and common sitemap index locations before reading page metadata.
Robots Aware
PinBoostrBot checks robots.txt and skips URLs that disallow PinBoostrBot or all crawlers.
Rate Limited
Requests are throttled per site and cached so repeated checks avoid unnecessary crawling.
Block or Allow PinBoostrBot
Site owners can control PinBoostrBot with standard robots.txt rules. For example:
User-agent: PinBoostrBot
Disallow: /
User-agent: PinBoostrBot
Allow: /