How Crsp works with publishers
If you landed here from a server log, hello: the user agent that visited you is ours, and this page explains exactly what it does. If you are a publisher with questions or an opt-out request, the contact at the bottom reaches a human quickly.
Our crawler, honestly identified
Crsp fetches news via one crawler, identified on every request as:
CrspBot/1.0 (+https://www.getcrsp.ca/publishers)
- It reads publicly offered RSS/Atom feeds and public APIs only, roughly once per hour, with per-feed limits.
- It does not scrape article pages, bypass paywalls, or disguise itself as a browser. If a publisher blocks CrspBot, we treat that as an answer and stop, and we reach out properly rather than working around it.
- We do not store full article text, and we never republish it.
What readers see
Crsp writes its own sixty-ish word summary of a story, machine-checked for accuracy against the feed content (the full pipeline is documented here). Every card displays the source name and links directly to the original article. We are an entry point to journalism, not a substitute for it: the click-through is the product working as intended.
Sources we currently carry
73 feeds and public data sources across these organizations:
Canada: Global News · National Post · Financial Post · The Globe and Mail · Bank of Canada · Statistics Canada · C.D. Howe Institute · The Tyee · The Conversation Canada · CityNews · The Walrus
United States: NPR · The Washington Post · CNBC · MarketWatch · Dow Jones · Yahoo Finance · Yahoo Sports · Fortune · Inc. · The Hill · The Guardian US · TechCrunch · Ars Technica · The Verge · Wired · Engadget · 9to5Mac · Slashdot · Hacker News · SEC EDGAR · NBER · KFF Health News · ESPN · Variety · Deadline · The Hollywood Reporter · Pitchfork · Rolling Stone · MIT Technology Review · MIT CSAIL · IEEE Spectrum · VentureBeat · OpenAI · Google AI · Google DeepMind · Hugging Face · Yale Environment 360 · Inside Climate News · Grist
World: BBC · Al Jazeera · DW News · The Guardian · WHO · The Register
Good news: Good News Network · Optimist Daily · Positive News · Reasons to be Cheerful
Government and public-domain sources (Bank of Canada, Statistics Canada, SEC EDGAR, WHO) are used under their open-data terms.
Opting out, or getting in touch
- To opt out: block
CrspBotin your robots.txt or at the server level, or email us; we will remove your feeds promptly, no argument. - To talk about inclusion, attribution, licensing, or anything else: email support@getcrsp.ca with the subject “Publisher inquiry”.
We are a small Canadian company that wants the newsrooms we summarize to thrive. If you feel our handling of your content is not fair to you, we want to hear it.