dataset-generation repositories

Trending repositories tagged dataset-generation, ranked by trending score. Updated daily.

  1. 1
    Valen-Team/Roller

    Turn agent runs into training data. Roller rolls out Claude Code, Codex, OpenClaw and four other Harnesses in disposable Docker containers, grades benchmark tasks in place, and exports SFT-ready trajectories that keep reasoning, images and compacted-context segments.

    GitHub · Python · 116 stars · 0 forks · +25 stars in 24 hours · Trending score 1.59

  2. 2
    oopsie-data/oopsie-data-tools

    Toolkit for the OopsieData - Recording, annotating, and submitting

    GitHub · Python · 24 stars · 4 forks · +5 stars in 24 hours · Trending score 1.34

  3. 3
    Kiln-AI/Kiln

    Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

    GitHub · Python · 5,286 stars · 406 forks · 0 stars in 24 hours · Trending score 0.85

  4. 4
    packing-box/docker-packing-box

    Docker image gathering packers and tools for making datasets of packed executables and training machine learning models for packing detection

    GitHub · YARA · 70 stars · 18 forks · 0 stars in 24 hours · Trending score 0.31

  5. 5
    pnnnx/local-code-tutor

    Fine-tune Qwen2.5-Coder-7B for free (QLoRA on Kaggle T4) and run a local coding agent that runs your code instead of guessing — 8 GB Mac, llama.cpp, LoRA weight analysis with charts

    GitHub · Python · 15 stars · 0 forks · 0 stars in 24 hours · Trending score 0.14

  6. 6
    codelion/pts

    Pivotal Token Search

    GitHub · Python · 160 stars · 9 forks · 0 stars in 24 hours · Trending score 0.01

  7. 7
    sileod/reasoning-core

    Procedural data generators for verifiable reasoning, synthetic pretraining, post-training, evaluation, and RL.

    GitHub · Python · 52 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00

  8. 8
    AudibleLight/AudibleLight

    A controllable, end-to-end API for soundscape synthesis across ray-traced & real-world measured acoustics

    GitHub · Jupyter Notebook · 32 stars · 7 forks · 0 stars in 24 hours · Trending score 0.00

  9. 9
    satellite-image-deep-learning/annotation

    Annotation of datasets for deep learning applied to satellite and aerial imagery

    GitHub · 64 stars · 16 forks · 0 stars in 24 hours · Trending score 0.00

  10. 10
    osscv/RaDUO

    RaDUO turns live radio broadcasts into multilingual STT datasets for ASR research. It records stations in parallel, splits streams into clips, transcribes audio, extracts quality features, and stores searchable metadata. Includes 16 kHz mono WAVs, transcripts, station info, languages, and optional word timings.

    GitHub · Python · 10 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00

  11. 11
    dengxianghua888-ops/preference-lab

    Policy-driven preference data for content moderation, with source-linked evidence, resumable runs, budget controls and TRL/ShareGPT exports.

    GitHub · Python · 50 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00

  12. 12
    Jolanoff/goated-prompter

    Advanced local AI prompt generator for image & video models — reference images, dataset creation, prompt refinement, model-specific outputs & llama.cpp.

    GitHub · Python · 13 stars · 3 forks · 0 stars in 24 hours · Trending score 0.00

  13. 13
    sgyaqing/RAG-BenchLab

    Build RAG evaluation testsets from documents and benchmark RAG systems.

    GitHub · Python · 16 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00