content-extraction repositories

Trending repositories tagged content-extraction, ranked by trending score. Updated daily.

  1. 1
    originaleric/digcrawl

    Built by Dig: A local-first content crawler for AI agents. Retrieve web pages, posts, images, and videos from public and user-authorized signed-in sources via Agent Skills, MCP, and CLI.

    GitHub · Go · 310 stars · 36 forks · +107 stars in 24 hours · Trending score 3.47

  2. 2
    firecrawl/firecrawl-mcp-server

    Official Firecrawl MCP server, the context API for AI agents: search, scrape, and interact with the web, plus parse, crawl, map, Agent and Monitor, from any MCP client.

    GitHub · JavaScript · 7,877 stars · 943 forks · +12 stars in 24 hours · Trending score 2.40

  3. 3
    parallel-web/search-mcp

    Free web search and page fetching for agents. Hosted MCP, no API key required.

    GitHub · 35 stars · 3 forks · +9 stars in 24 hours · Trending score 1.69

  4. 4
    runesleo/x-reader

    Universal content reader MCP Server for 10+ platforms

    GitHub · Python · 992 stars · 97 forks · +2 stars in 24 hours · Trending score 0.84

  5. 5
    mavam/webfox

    The web, from your terminal. Search, extract pages, get grounded answers, and run deep research with your choice of providers. CLI, TypeScript library, and Pi extension.

    GitHub · TypeScript · 94 stars · 16 forks · +1 stars in 24 hours · Trending score 0.45

  6. 6
    portdeveloper/docusaurus-plugin-copy-page-button

    Docusaurus plugin that adds a copy page button to extract documentation content as markdown for AI tools like ChatGPT, Claude, and Gemini

    GitHub · JavaScript · 19 stars · 7 forks · 0 stars in 24 hours · Trending score 0.33

  7. 7
    amirthfultehrani/Youtube-Transcript-Copier

    A userscript that adds a button to YouTube video pages for copying the transcript with or without timestamps.

    GitHub · JavaScript · 25 stars · 4 forks · 0 stars in 24 hours · Trending score 0.24

  8. 8
    Khamel83/argus

    Multi-provider web search broker for AI agents. 14 providers, budget-aware routing, content extraction — one API.

    GitHub · Python · 9 stars · 3 forks · 0 stars in 24 hours · Trending score 0.07

  9. 9
    zoharbabin/web-researcher-mcp

    Search the web and primary sources, read full pages, and check every citation. MCP server for Claude, Cursor, Codex and more. Runs on your machine.

    GitHub · Go · 79 stars · 18 forks · 0 stars in 24 hours · Trending score 0.05

  10. 10
    AntonG87/codearia-sieve

    Parses a web page into the exact format a decision model needs: dates as dates, numbers with units, chunks that fit the model's window. MCP server + TypeScript library, no model or API key required.

    GitHub · TypeScript · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  11. 11
    alphaparkinc/genpark-dom-readability-boilerplate-remover-skill

    Readability-inspired heuristic algorithm stripping navigation, footers, ads, and sidebars from web content

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00