mirror/maigret
1
0
Fork 0
mirror of https://github.com/soxoj/maigret.git synced 2026-05-07 14:34:33 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fix false-positive site checks reported by Maigret Bot (#2376)

Browse Source
This commit is contained in:
Soxoj
2026-03-24 23:01:11 +01:00
committed by Soxoj
parent 31b759c08b
commit 55fc8694ed
3 changed files with 68 additions and 33 deletions
Download Patch File Download Diff File Expand all files Collapse all files
LLM/site-checks-playbook.md
+1
View File
@@ -81,6 +81,7 @@ Practical observations from fixing top-ranked sites. Full details: section **7**
| **GraphQL supports GET too** | hashnode GraphQL works via `GET ?query=...` (URL-encoded). You can use either native POST payloads or GET `urlProbe` for GraphQL. |
| **URL-encode braces for template safety** | GraphQL `{...}` conflicts with Maigret's `{username}`. Use `%7B`/`%7D` for literal braces in `urlProbe` — `.format()` ignores percent-encoded chars. |
| **Anti-bot bypass via simple UA** | "Anubis" anti-bot PoW screens (like on Weblate) intercept modern browser UAs via HTTP 307. Hardcoding `"headers": {"User-Agent": "python-requests/2.25.1"}` circumvents the scraper filter and restores default detection logic. |
| **Rate-limit → `errors`, not `absenceStrs`** | Rate-limit wording varies across API versions. If the phrasing doesn't match `absenceStrs` and `presenseStrs` is empty, the result is a false CLAIMED. Put all "can't answer right now" strings (rate limit, CAPTCHA, maintenance) in `errors` so the result is UNKNOWN. |
## 8. Documentation maintenance