3 Commits

Author	SHA1	Message	Date
Soxoj	959b2be136	feat(sites): fix false positives: disable 74 broken sites, fix 8 with API probes and better markers (#2302) ... - Disable 74 sites: Cloudflare/captcha blocks, identical responses, dead domains, vBulletin/phpBB engine failures - Fix Roblox, Salon24.pl, Planetaexcel → status_code (clear 404 signal) - Fix en.brickimedia.org → message with "noarticletext" absenceStr - Fix Arduino → narrower title-based presenseStrs/absenceStrs - Re-enable Fandom (3 wikis) via MediaWiki api.php urlProbe - Re-enable Substack via /api/v1/user/{}/public_profile urlProbe - Re-enable hashnode via GraphQL GET urlProbe (URL-encoded query) - Document lessons: engine template drift, search-by-author fragility, always-200 sites, TLS degradation, API bypassing Cloudflare, GraphQL GET support, URL-encoding for template safety	2026-03-22 20:47:51 +01:00
Soxoj	97cc4b46d9	Improve site-check quality: fix broken site configs, add diagnostic utilities, and make self-check report-only by default with opt-in auto-disable. (#2301) ... - Fix VK and TradingView checkType; add Reddit and Microsoft Learn API-style probes where appropriate; adjust or disable entries that are unreliable under anti-bot protection. - Self-check: stop aggressive auto-disable; default to reporting issues only; add --auto-disable and --diagnose for optional fixes and deeper output. - Tooling: add utils/site_check.py and utils/check_top_n.py (and related helpers) to inspect and rank site behavior against the top-N list - Scope: aligns with fixing top-traffic / high-impact sites and making diagnostics repeatable without silently flipping disabled flags	2026-03-22 16:48:35 +01:00
Soxoj	f99091f5f7	Fixed false positives in top-500 (#2292)	2026-03-21 23:35:59 +01:00