content-extraction repositories
Trending repositories tagged content-extraction, ranked by trending score. Updated daily.
-
1
originaleric/digcrawl
Built by Dig: A local-first content crawler for AI agents. Retrieve web pages, posts, images, and videos from public and user-authorized signed-in sources via Agent Skills, MCP, and CLI.
GitHub · Go · 310 stars · 36 forks · +107 stars in 24 hours · Trending score 3.47
-
2
firecrawl/firecrawl-mcp-server
Official Firecrawl MCP server, the context API for AI agents: search, scrape, and interact with the web, plus parse, crawl, map, Agent and Monitor, from any MCP client.
GitHub · JavaScript · 7,877 stars · 943 forks · +12 stars in 24 hours · Trending score 2.40
-
3
parallel-web/search-mcp
Free web search and page fetching for agents. Hosted MCP, no API key required.
GitHub · 35 stars · 3 forks · +9 stars in 24 hours · Trending score 1.69
-
4
runesleo/x-reader
Universal content reader MCP Server for 10+ platforms
GitHub · Python · 992 stars · 97 forks · +2 stars in 24 hours · Trending score 0.84
-
5
mavam/webfox
The web, from your terminal. Search, extract pages, get grounded answers, and run deep research with your choice of providers. CLI, TypeScript library, and Pi extension.
GitHub · TypeScript · 94 stars · 16 forks · +1 stars in 24 hours · Trending score 0.45
-
6
portdeveloper/docusaurus-plugin-copy-page-button
Docusaurus plugin that adds a copy page button to extract documentation content as markdown for AI tools like ChatGPT, Claude, and Gemini
GitHub · JavaScript · 19 stars · 7 forks · 0 stars in 24 hours · Trending score 0.33
-
7
amirthfultehrani/Youtube-Transcript-Copier
A userscript that adds a button to YouTube video pages for copying the transcript with or without timestamps.
GitHub · JavaScript · 25 stars · 4 forks · 0 stars in 24 hours · Trending score 0.24
-
8
Khamel83/argus
Multi-provider web search broker for AI agents. 14 providers, budget-aware routing, content extraction — one API.
GitHub · Python · 9 stars · 3 forks · 0 stars in 24 hours · Trending score 0.07
-
9
zoharbabin/web-researcher-mcp
Search the web and primary sources, read full pages, and check every citation. MCP server for Claude, Cursor, Codex and more. Runs on your machine.
GitHub · Go · 79 stars · 18 forks · 0 stars in 24 hours · Trending score 0.05
-
10
AntonG87/codearia-sieve
Parses a web page into the exact format a decision model needs: dates as dates, numbers with units, chunks that fit the model's window. MCP server + TypeScript library, no model or API key required.
GitHub · TypeScript · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
11
alphaparkinc/genpark-dom-readability-boilerplate-remover-skill
Readability-inspired heuristic algorithm stripping navigation, footers, ads, and sidebars from web content
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00