dataops repositories

Trending repositories tagged dataops, ranked by trending score. Updated daily.

  1. 1
    lance-format/lance

    Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

    GitHub · Rust · 7,373 stars · 959 forks · +20 stars in 24 hours · Trending score 2.85

  2. 2
    datavane/tis

    Support agile Ontology DataOps Based on Flink, DataX and Flink-CDC with Web-UI

    GitHub · Java · 1,448 stars · 307 forks · +6 stars in 24 hours · Trending score 1.35

  3. 3
    DataRecce/recce

    The data-validation toolkit for enhanced dbt (data build tool) PR review

    GitHub · TypeScript · 484 stars · 31 forks · +3 stars in 24 hours · Trending score 1.09

  4. 4
    raystack/frontier

    Frontier is an all-in-one user management platform that provides identity, access and billing management to help organizations secure their systems and data. (Open source alternative to Clerk, WorkOS)

    GitHub · Go · 346 stars · 48 forks · +2 stars in 24 hours · Trending score 0.80

  5. 5
    meltano/meltano

    Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

    GitHub · Python · 2,683 stars · 282 forks · 0 stars in 24 hours · Trending score 0.57

  6. 6
    wgzhao/addax-admin

    面向 Addax 离线引擎的 T+1 ODS 采集控制台:采集定义、调度、补数、对账、告警与审计一体。 | Enterprise T+1 ODS console for the Addax offline ETL engine: collection definitions, scheduling, backfill, reconciliation, alerting and audit in one place.

    GitHub · Java · 38 stars · 9 forks · 0 stars in 24 hours · Trending score 0.23

  7. 7
    redpanda-data/console

    Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.

    GitHub · TypeScript · 4,353 stars · 435 forks · 0 stars in 24 hours · Trending score 0.22

  8. 8
    tenzir/tenzir

    Tenzir is the data pipeline engine for security teams.

    GitHub · C++ · 771 stars · 110 forks · −1 stars in 24 hours · Trending score 0.10

  9. 9
    jostrm/azure-enterprise-scale-ml

    Enterprise Scale Azure Factory (ESAF) - on Azure

    GitHub · Python · 53 stars · 22 forks · 0 stars in 24 hours · Trending score 0.08

  10. 10
    polyaxon/traceml

    Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

    GitHub · Python · 533 stars · 47 forks · 0 stars in 24 hours · Trending score 0.02

  11. 11
    lensesio/fast-data-dev

    Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, , 20+ connectors

    GitHub · Shell · 2,081 stars · 340 forks · 0 stars in 24 hours · Trending score 0.00

  12. 12
    SQLMesh/sqlmesh

    Scalable and efficient data transformation framework - backwards compatible with dbt.

    GitHub · Python · 3,360 stars · 493 forks · 0 stars in 24 hours · Trending score 0.00

  13. 13
    lensesio/lenses-docker

    ❤for real-time DataOps - where the application and data fabric blends - Lenses

    GitHub · Shell · 159 stars · 23 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    kythuatdulieu/kythuatdulieu.github.io

    Data Engineering notes in Vietnamese

    GitHub · JavaScript · 19 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00

  15. 15
    raystack/firehose

    Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

    GitHub · Java · 343 stars · 64 forks · 0 stars in 24 hours · Trending score 0.00