Lists (3)
Starred repositories
A Datacenter Scale Distributed Inference Serving Framework
📚A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, Parallelism, MLA, etc.
📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA/Tensor Cores Kernels, HGEMM, FA-2 MMA etc.🔥
A high-throughput and memory-efficient inference and serving engine for LLMs
SGLang is a fast serving framework for large language models and vision language models.
A General-purpose Task-parallel Programming System using Modern C++
The official GitHub page for the survey paper "A Survey of Large Language Models".
Probably the fastest coroutine lib in the world!
FlatBuffers: Memory Efficient Serialization Library
LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
NoSQL data store using the Seastar framework, compatible with Apache Cassandra and Amazon DynamoDB
ModelScope-Agent: An agent framework connecting models in ModelScope with the world
KubeBlocks is an open-source control plane software that runs and manages databases, message queues and other stateful applications on K8s.
FaceChain is a deep-learning toolchain for generating your Digital-Twin.
Curve is a sandbox project hosted by the CNCF Foundation. It's cloud-native, high-performance, and easy to operate. Curve is an open-source distributed storage system for block and shared file stor…
ModelScope: bring the notion of Model-as-a-Service to life.
MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.
Raft library for maintaining a replicated state machine
“连续八年成为全世界最受喜爱的语言，无 GC 也无需手动内存管理、极高的性能和安全性、过程/OO/函数式编程、优秀的包管理、JS 未来基石" — 工作之余的第二语言来试试 Rust 吧。本书拥有全面且深入的讲解、生动贴切的示例、德芙般丝滑的内容，这可能是目前最用心的 Rust 中文学习教程 / Book
DuckDB is an analytical in-process SQL database management system