1 Commits

Author SHA1 Message Date
metatroncubeswdev
510c46e5ed Add a real, rate-limited public quick-audit endpoint for crawlerx.co
Some checks failed
CI / ci (push) Has been cancelled
CI / docker-build (push) Has been cancelled
Publish Docker image / docker (push) Has been cancelled
Upload sourcemaps / upload (push) Has been cancelled
The marketing site's "Run Live Audit" widget was entirely fake: it looked
up a canned preset or a generic templated result for any domain typed in,
after a scripted delay. This adds /api/public/quick-audit, which crawls
the submitted URL with the same crawler + HTML analyzer the authenticated
product uses, and reports one real finding (or an honest error if the
site is unreachable/blocked) instead of ever fabricating one. Per-IP and
global daily KV caps bound the cost of anonymous abuse.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-10-20 19:19:12 -04:00