html-to-markdown repositories
Trending repositories tagged html-to-markdown, ranked by trending score. Updated daily.
-
1
firecrawl/firecrawl
Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.
GitHub · TypeScript · 205,629 stars · 10,754 forks · +2,082 stars in 24 hours · Trending score 5.92
-
2
fastcrw/crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
GitHub · Rust · 1,283 stars · 102 forks · +16 stars in 24 hours · Trending score 2.35
-
3
AeternaLabsHQ/pullmd
Self-hosted URL- and file-to-Markdown service for humans and AI agents - web pages, documents, images, audio, YouTube. PWA + REST + MCP + Claude Code skill, Reddit-aware, refreshable share links.
GitHub · JavaScript · 528 stars · 43 forks · +7 stars in 24 hours · Trending score 1.45
-
4
janreges/siteone-crawler
SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineers, and consultants. Supports Windows, macOS, and Linux (x64 and arm64).
GitHub · Rust · 1,018 stars · 98 forks · +3 stars in 24 hours · Trending score 1.33
-
5
adbar/trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
GitHub · Python · 7,138 stars · 510 forks · 0 stars in 24 hours · Trending score 1.14
-
6
YOLOW92/pagesift
Local-first web & document ingestion engine in Rust — HTTP/browser capture, layout-aware PDF/Office/OCR parsing, persistent sync, verifiable data graphs, and evidence-grounded AI context.
GitHub · Rust · 284 stars · 37 forks · +1 stars in 24 hours · Trending score 1.13
-
7
harehare/mq
A jq-like Markdown query language for command-line processing
GitHub · Rust · 1,085 stars · 24 forks · +1 stars in 24 hours · Trending score 0.63
-
8
SylphxAI/anymd
Any file → clean Markdown for AI agents: PDF, Word, PowerPoint, Excel, EPUB, HTML and web pages, images (OCR), audio and video (metadata, subtitles, transcripts). A fast Rust MCP server and CLI that runs on your machine. No API key.
GitHub · Rust · 1,072 stars · 96 forks · 0 stars in 24 hours · Trending score 0.55
-
9
iamsaquib8/domq
A tiny, zero-dependency, never-panicking HTML parser with CSS selectors — for Rust, your shell, JavaScript (a ~58 KB gzipped WebAssembly module, ~80 KB with reader mode and extraction) and Python.
GitHub · Rust · 12 stars · 7 forks · +1 stars in 24 hours · Trending score 0.47
-
10
ilien-dev/svipall
Local-first MCP server and CLI in Rust: any page as LLM-ready Markdown, whole-site crawls, keyless search, and local captcha solving. No cloud, no API keys.
GitHub · Rust · 22 stars · 2 forks · 0 stars in 24 hours · Trending score 0.30
-
11
0xMassi/webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
GitHub · Rust · 2,440 stars · 245 forks · −11 stars in 24 hours · Trending score 0.23
-
12
context-dot-dev/context-dev-cli
Context.dev CLI: scrape, crawl, search and screenshot the web from your terminal. Returns LLM-ready markdown or JSON.
GitHub · Go · 9 stars · 2 forks · 0 stars in 24 hours · Trending score 0.22
-
13
77777R7/Octocrawl
Web scraping MCP server and API for AI agents: any public URL to clean Markdown, plus site maps. Hosted MCP works without an API key or sign-up (20 pages a day); crawls and batches with a free account. Self-host with npx. Each page comes with an Evidence Record.
GitHub · TypeScript · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.19
-
14
thomas-villani/all2md
Convert PDF, Word, PowerPoint, HTML, email & 40+ formats to clean Markdown — and back. Built for LLMs, RAG & Python pipelines, with a built-in MCP server.
GitHub · Python · 34 stars · 5 forks · −1 stars in 24 hours · Trending score 0.10
-
15
kinorai/omnifeed
LLM-friendly web crawler & scraper with a dedicated Reddit engine, built on Crawl4AI — Open WebUI compatible
GitHub · Go · 11 stars · 2 forks · 0 stars in 24 hours · Trending score 0.09
-
16
wevm/curl.md
URL to markdown for agents
GitHub · TypeScript · 295 stars · 17 forks · 0 stars in 24 hours · Trending score 0.07
-
17
any4ai/AnyCrawl
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
GitHub · TypeScript · 3,528 stars · 372 forks · 0 stars in 24 hours · Trending score 0.04
-
18
inaridiy/webforai
Any HTML to the cleanest Markdown, for humans and AI agents: a TypeScript library, a CLI with an Agent Skill, and a hosted crawl/scrape API.
GitHub · TypeScript · 82 stars · 5 forks · 0 stars in 24 hours · Trending score 0.02
-
19
oidlabs-com/Lexoid
The open-source universal adapter for LLMs. Turn messy real-world data into clean, agent-ready context.
GitHub · Python · 109 stars · 15 forks · 0 stars in 24 hours · Trending score 0.02
-
20
Nano-Collective/get-md
A fast, lightweight HTML to Markdown converter optimized for LLM consumption. Uses proven parsing libraries to deliver clean, well-structured markdown with intelligent content extraction and noise filtering.
GitHub · TypeScript · 96 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00
-
21
Spenhouet/confluence-markdown-exporter
Export Atlassian Confluence pages as markdown files.
GitHub · Python · 598 stars · 135 forks · 0 stars in 24 hours · Trending score 0.00
-
22
mrusme/reader
reader is for your command line what the “readability” view is for modern browsers: A lightweight tool offering better readability of web pages (and EML files!) on the CLI. (https://tty.fail/mrus/reader)
GitHub · Go · 420 stars · 16 forks · 0 stars in 24 hours · Trending score 0.00
-
23
AntonG87/codearia-sieve
Parses a web page into the exact format a decision model needs: dates as dates, numbers with units, chunks that fit the model's window. MCP server + TypeScript library, no model or API key required.
GitHub · TypeScript · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
24
AbdoslamB/InkDoc
Turn any document into clean, AI-ready Markdown — locally on your machine. Desktop app for Windows, macOS & Linux powered by MarkItDown, Docling, GLM-OCR and Markit.
GitHub · Python · 60 stars · 9 forks · 0 stars in 24 hours · Trending score 0.00