Our crawlers
Fast Forward runs one crawler. If you have seen it in your logs, this page tells you what it is and how to stop it.
ClimbingCalendarBot
User-Agent: ClimbingCalendarBot/0.1 (+https://fastforward.sh/bots)It builds climbing-calendar.com, a free, unofficial index of USA Climbing competitions. It is not affiliated with USA Climbing.
What it fetches
- USA Climbing's own published schedule pages and documents.
- Climbing gym websites, to find a gym's logo and confirm a match.
How it behaves
- About one request per second. It is never in a hurry.
- It honors robots.txt, including Allow rules and wildcards.
- It skips any document whose content has not changed since the last visit.
- It reads schedules once a week and checks gym sites twice a month.
What it does not do
- No forms, no logins, no paywalls, no personal data.
- It deliberately does not collect athlete names, rosters or paraclimbing classifications, even where those are published.
- It reads markup. It does not run your JavaScript.
Blocking it
A robots.txt rule is enough, and we will honor it:
User-agent: ClimbingCalendarBot
Disallow: /Contact
If it is causing you a problem, tell us and we will stop: fastforward.sh/contact-us.
