brcrusoe72 · Web Scraping

AgentSearch

Self-hosted search for agents: SearXNG across 25 engines wrapped in a FastAPI layer of 17 endpoints that deduplicates across engines, scores results and escalates extraction from direct fetch through readability, browser render, Wayback and PDF handlers. Scrubs prompt injection, detects paywalls, and analyses its own fetch failures. No third-party API keys. MIT.