Cap crawled HTML bodies at 2 MiB before Cheerio parsing, bulk-insert audit links on Postgres instead of per-row Hyperdrive round trips, and raise the Worker CPU ceiling to the 5-minute paid max for link-heavy crawl steps.
Cap crawled HTML bodies at 2 MiB before Cheerio parsing, bulk-insert audit links on Postgres instead of per-row Hyperdrive round trips, and raise the Worker CPU ceiling to the 5-minute paid max for link-heavy crawl steps.