batching repositories
Trending repositories tagged batching, ranked by trending score. Updated daily.
-
1
aryamandarda/tamserve
Live, multi-camera object tracking with SAM3, SAM 2 and EdgeTAM, on one GPU or many. One model per GPU serves every camera: faster than the original code, about 4x less GPU memory, the same accuracy.
GitHub · Python · 255 stars · 14 forks · +163 stars in 24 hours · Trending score 2.55
-
2
General-Sequences/sequence-ai
SequenceLink: open source serving for robot policies on remote GPUs, verified with openpi, LeRobot, GR00T and Octo. An inference layer (CUDA graphs with the same outputs, replicas) and a network layer (a robot's connection to its GPU), on your own GPU or on the hosted SequenceLink platform. pip install sequence-ai
GitHub · Python · 48 stars · 0 forks · +28 stars in 24 hours · Trending score 1.73
-
3
TanStack/pacer
Utilities for debouncing, throttling, rate limiting, and queueing. Non-async and Async.
GitHub · TypeScript · 798 stars · 68 forks · +5 stars in 24 hours · Trending score 1.26
-
4
BuildMosaic/Mosaic
A Kotlin library for composing backend responses from reusable work, with concurrent execution, shared dependencies, and batching. Powered by a dynamic DAG scheduler.
GitHub · Kotlin · 29 stars · 1 forks · 0 stars in 24 hours · Trending score 0.06
-
5
nasa/batchee
NASA Harmony service that groups together files into batches for concatenation
GitHub · Python · 6 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00
-
6
jmaczan/tiny-vllm
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
GitHub · C++ · 1,161 stars · 101 forks · 0 stars in 24 hours · Trending score 0.00
-
7
tallslab/threeforge
Frame-budget compiler and diagnostics for three.js games: batches naive scenes, measures every frame cost, explains what to fix. CLI and MCP for AI agents
GitHub · TypeScript · 19 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
8
collapseindex/jev-ultralightspeed
BRRRRRRRRRRRRRRRRRRRRRR
GitHub · Python · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00