Stars
A lightweight data processing framework built on DuckDB and 3FS.
verl: Volcano Engine Reinforcement Learning for LLMs
Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation
A Data Streaming Library for Efficient Neural Network Training
A flexible and efficient training framework for large-scale alignment tasks
[NeurIPS 2024 Best Paper][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ult…
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Large language model fine-tuning capabilities based on cloud native and distributed computing.
A high-throughput and memory-efficient inference and serving engine for LLMs
21 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…
An Easy-to-use, Scalable and High-performance RLHF Framework based on Ray (PPO & GRPO & REINFORCE++ & vLLM & RFT & Dynamic Sampling & Async Agent RL)
A blazingly fast multi-language serialization framework powered by JIT and zero-copy.
GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
Making large AI models cheaper, faster and more accessible
A multiple parties joint, distributed execution engine based on Ray, to help build your own federated learning frameworks in minutes.
exoshuffle / cloudsort
Forked from exoshuffle/raysortExoshuffle-CloudSort
Distributed SQL Query Engine in Python using Ray
Tmux configuration, that supercharges your tmux to build cozy and cool terminal environment
LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.