preprocessing repositories

Trending repositories tagged preprocessing, ranked by trending score. Updated daily.

  1. 1
    Unstructured-IO/unstructured

    Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

    GitHub · HTML · 15,759 stars · 1,404 forks · 0 stars in 24 hours · Trending score 1.38

  2. 2
    sunlabuiuc/PyHealth

    A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.

    GitHub · Python · 1,703 stars · 914 forks · −1 stars in 24 hours · Trending score 0.95

  3. 3
    acroucher/PyTOUGH

    A Python library for automating TOUGH2 simulations of subsurface fluid and heat flow

    GitHub · Python · 111 stars · 44 forks · 0 stars in 24 hours · Trending score 0.58

  4. 4
    dongrixinyu/JioNLP

    中文 NLP 预处理、解析工具包,准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com

    GitHub · Python · 3,877 stars · 444 forks · 0 stars in 24 hours · Trending score 0.56

  5. 5
    free-astro/siril

    The Siril image processing software for amateur astronomy

    GitLab · 196 stars · 255 forks · 0 stars in 24 hours · Trending score 0.56

  6. 6
    featrs/featrs

    A Polars-native feature engineering library for Rust.

    GitHub · Rust · 71 stars · 65 forks · 0 stars in 24 hours · Trending score 0.40

  7. 7
    cernodatainc/cernodata

    Open-source control layer over PDF parsing that picks the right method, verifies output quality, and falls back automatically when results fall short

    GitHub · Python · 24 stars · 6 forks · 0 stars in 24 hours · Trending score 0.30

  8. 8
    anlijun/awesome-CAE-software

    A curated list of awesome CAE frameworks, libraries, and software from a full CAE workflow perspective, including the integration of AI technologies.

    GitHub · 34 stars · 7 forks · 0 stars in 24 hours · Trending score 0.10

  9. 9
    Yu-Group/veridical-flow

    Making it easier to build stable, trustworthy data-science pipelines.

    GitHub · Jupyter Notebook · 76 stars · 8 forks · 0 stars in 24 hours · Trending score 0.08

  10. 10
    autoreject/autoreject

    Automated rejection and repair of bad trials/sensors in M/EEG

    GitHub · Python · 163 stars · 62 forks · 0 stars in 24 hours · Trending score 0.03

  11. 11
    ikegami-yukino/jaconv

    Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku

    GitHub · Python · 351 stars · 33 forks · 0 stars in 24 hours · Trending score 0.00

  12. 12
    calebevans/cordon

    Reduce logs to their semantic anomalies

    GitHub · Python · 165 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00

  13. 13
    qd-cae/awesome-CAE

    A curated list of awesome CAE frameworks, libraries and software.

    GitHub · 505 stars · 117 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    Haseebi-khan/MachineLearning

    Practical machine learning and projects.

    GitHub · Jupyter Notebook · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  15. 15
    mlr-org/mlr3pipelines

    Dataflow Programming for Machine Learning in R

    GitHub · R · 149 stars · 26 forks · 0 stars in 24 hours · Trending score 0.00

  16. 16
    OpenGene/fastp

    An ultra-fast all-in-one FASTQ preprocessor (QC/adapters/trimming/filtering/splitting/merging...)

    GitHub · C++ · 2,435 stars · 389 forks · 0 stars in 24 hours · Trending score 0.00

  17. 17
    OpenTabular/DeepTab

    DeepTab is a Python package that simplifies tabular deep learning by providing a suite of models for regression, classification, and distributional regression tasks. It includes models such as Mambular, TabM, FT-Transformer, TabulaRNN, TabTransformer, and tabular ResNets.

    GitHub · Python · 328 stars · 27 forks · 0 stars in 24 hours · Trending score 0.00

  18. 18
    paypal/gators

    Lightning-fast data preprocessing and feature engineering for Python, built on Polars. 108 sklearn-style transformers for imputation, encoding, scaling, outlier clipping, discretization and feature selection, with Pipeline support and ONNX export for low-latency inference.

    GitHub · Python · 30 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00

  19. 19
    MinishLab/semhash

    Fast Multimodal Semantic Deduplication & Filtering

    GitHub · Python · 978 stars · 56 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    martinguirado95-ux/untangling-ml-complexity

    Clean ML Framework 2026: Simplify Machine Learning Code Structure and Hyperparameters

    GitHub · HTML · 56 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00