Starred repositories
You like pytorch? You like micrograd? You love tinygrad! ❤️
Modern C++ Programming Course (C++03/11/14/17/20/23/26)
NVIDIA Linux open GPU kernel module source
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
Reference implementations of MLPerf™ inference benchmarks
Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable…
The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Zero-1-to-3: Zero-shot One Image to 3D Object (ICCV 2023)
Code and documentation to train Stanford's Alpaca models, and generate the data.
Making large AI models cheaper, faster and more accessible
The simplest, fastest repository for training/finetuning medium-sized GPTs.
jax-triton contains integrations between JAX and OpenAI Triton
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (V…
Code for Cicero, an AI agent that plays the game of Diplomacy with open-domain natural language negotiation.
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.
Implementation of Flash Attention in Jax
Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
HIP: C++ Heterogeneous-Compute Interface for Portability
Solidity, the Smart Contract Programming Language
Hackable and optimized Transformers building blocks, supporting a composable construction.