ModernLeft/modernleft-docs
Watch
4
0
Fork
You've already forked modernleft-docs
 0
Code Issues 2 Pull requests 1 Activity Actions

Document Anubis usage (bot / AI-scraper protection) #85

New issue
Open
opened 2026-07-17 03:54:22 +00:00 by gravityfargo · 0 comments
gravityfargo commented 2026-07-17 03:54:22 +00:00
Owner
Copy link

Document that the fleet uses Anubis — a proof-of-work challenge gate — in front of public web services to deter abusive bots and AI scrapers.

What to write

A short page covering:

  • Which services are gated: Forgejo web UI (code.modernleft.org), the athena archive, mainefrancostories, and git-pages (*.modernleft.page).
  • What visitors experience: a brief in-browser proof-of-work interstitial on first visit; one clearance cookie covers subdomains (dynamic cookie domain).
  • What is NOT gated: git-over-SSH (git.modernleft.org), and plain API / curl clients (allowed by default policy).
  • Why: deter scraper / AI-crawler abuse without blocking real people.
Document that the fleet uses [Anubis](https://anubis.techaro.lol) — a proof-of-work challenge gate — in front of public web services to deter abusive bots and AI scrapers. ## What to write A short page covering: - **Which services are gated:** Forgejo web UI (code.modernleft.org), the athena archive, mainefrancostories, and git-pages (`*.modernleft.page`). - **What visitors experience:** a brief in-browser proof-of-work interstitial on first visit; one clearance cookie covers subdomains (dynamic cookie domain). - **What is NOT gated:** git-over-SSH (`git.modernleft.org`), and plain API / `curl` clients (allowed by default policy). - **Why:** deter scraper / AI-crawler abuse without blocking real people.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
renovate/lock-file-maintenance
No results found.
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
ModernLeft/modernleft-docs#85
No description provided.