Stars
Playing around "Less Slow" coding practices in C++ 20, C, CUDA, PTX, & Assembly, from numerics & SIMD to coroutines, ranges, exception handling, networking and user-space IO
GLake: optimizing GPU memory management and IO transmission.
A Datacenter Scale Distributed Inference Serving Framework
Realtime Web Based Kubernetes Visualizer with WebAssembly and Controller Runtime
Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch
[WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025)
Flet enables developers to easily build realtime web, mobile and desktop apps in Python. No frontend experience required.
Paella: Low-latency Model Serving with Virtualized GPU Scheduling
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
A Project dedicated to making GPU Partitioning on Windows easier!
A high-throughput and memory-efficient inference and serving engine for LLMs
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga…
COYO-700M: Large-scale Image-Text Pair Dataset
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.
GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)
Open-source implementation of Google Vizier for hyper parameters tuning
seungpyo / tensorflow
Forked from tensorflow/tensorflowAn Open Source Machine Learning Framework for Everyone
Memory consumption and FLOP count estimates for convnets
Google AI 2018 BERT pytorch implementation
TensorFlow 2.x version's Tutorials and Examples, including CNN, RNN, GAN, Auto-Encoders, FasterRCNN, GPT, BERT examples, etc. TF 2.0版入门实例代码，实战教程。
C++ Implementation of PyTorch Tutorials for Everyone
A starter kit for the TensorFlow Experiment and Estimator APIs