Repository
YOLOW92/pagesift
High-performance, memory-efficient Rust web crawler & content extraction engine for AI agents and RAG. Adaptive crawling, clean Markdown, structured data, PDF/RSS parsing, browser rendering, Firecrawl-compatible APIs, and Python/Node.js SDKs.
Stars
159
Today
+35
last 24 hours
This week
+63
Forks
18
Clone
git clone https://github.com/YOLOW92/pagesift.gitStar growth
#ai-agents#browser-automation#data-extraction#firecrawl#html-to-markdown#markdown#mcp#pdf-extraction#rag#rust
- Created
- 2026-10-20
- Last commit
- 2026-10-26
- Gained since tracking
- +63
Updated Thu, 29 Oct 2026 21:10:21 GMT · description from the project itself