ThoughtfulDecisionsBot

Thoughtful Decisions builds source-grounded mentors from the public writing of the people they are modeled on. When a person asks us to, we fetch the pages they name, and pages we find from them, to read them. This page describes that fetcher.

How to recognize it

Every request it makes carries this user agent, and no other:

ThoughtfulDecisionsBot/1.0 (+https://thoughtfuldecisions.ai/bot)

It does not pretend to be a browser.

What it does

• It requests pages one at a time per site, with a pause between requests to the same host.
• It reads your robots.txt. A Crawl-delay you set is honored as the minimum pause between our requests to your host.
• It backs off when a site answers 429 or 503, and it honors Retry-After.
• It records which robots.txt rules matched a URL we fetched, so that we can see where we and site owners disagree.
• It does not log in, fill forms, or run scripts.

Contact

To have us slow down, stop fetching a site, or remove something we hold, write to thedebate@statechange.ai and name the host. We answer within a business day.