common-crawl repositories
Trending repositories tagged common-crawl, ranked by trending score. Updated daily.
-
1
commoncrawl/cc-crawl-statistics
Statistics of Common Crawl monthly archives mined from URL index files
GitHub · HTML · 236 stars · 19 forks · +3 stars in 24 hours · Trending score 0.94
-
2
pucilpet/crawlgraph-mcp
MCP server for the CrawlGraph backlink-intelligence API (Common Crawl webgraph). Backlink lookups + competitor gap analysis for Claude, Cursor, Cline, and any MCP client.
GitHub · JavaScript · 8 stars · 1 forks · 0 stars in 24 hours · Trending score 0.04
-
3
commoncrawl/news-crawl
News crawling with StormCrawler - stores content as WARC
GitHub · Java · 383 stars · 44 forks · 0 stars in 24 hours · Trending score 0.01
-
4
MigoXLab/dingo
Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool
GitHub · Python · 771 stars · 82 forks · 0 stars in 24 hours · Trending score 0.00
-
5
commoncrawl/cc-webgraph
Tools to construct and process Common Crawl webgraphs
GitHub · Java · 118 stars · 7 forks · 0 stars in 24 hours · Trending score 0.00
-
6
superdoc/docx-corpus
The largest open corpus of classified docx documents
GitHub · TypeScript · 71 stars · 9 forks · 0 stars in 24 hours · Trending score 0.00