Stars
A lightweight data processing framework built on DuckDB and 3FS.
AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术
This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
《动手学大模型Dive into LLMs》系列编程实践教程
⛅️ 精选的 Cloudflare 工具、开源项目、指南、博客和其他资源列表。/ ⛅️ A curated list of Cloudflare tools, open source projects, guides, blogs and other resources.
Redisson - Valkey & Redis Java client. Real-Time Data Platform. Sync/Async/RxJava/Reactive API. Over 50 Valkey and Redis based Java objects and services: Set, Multimap, SortedSet, Map, List, Queue,…
A high-throughput and memory-efficient inference and serving engine for LLMs
A PyTorch native platform for training generative AI models
Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.
🇨🇳 GitHub中文排行榜，各语言分设「软件 | 资料」榜单，精准定位中文好项目。各取所需，高效学习。
Learn System Design concepts and prepare for interviews using free resources.
💅🏻 ⚒ A collection of awesome design systems
A complete computer science study plan to become a software engineer.
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
项目注释+论文复现+算法竞赛+Pytorch实践+LeetCode+VLM预训练
人工智能学习路线图，整理近200个实战案例与项目，免费提供配套教材，零基础入门，就业实战！包括：Python，数学，机器学习，数据分析，深度学习，计算机视觉，自然语言处理，PyTorch tensorflow machine-learning,deep-learning data-analysis data-mining mathematics data-science artificial…
[TMLR 2024] Efficient Large Language Models: A Survey
alibaba / Megatron-LLaMA
Forked from NVIDIA/Megatron-LMBest practice for training LLaMA models in Megatron-LM
李宏毅2021/2022/2023春季机器学习课程课件及作业
Ongoing research training transformer models at scale
📚 Guide to Galaxy, curated, worthy and up-to-date links/reading List, CheatSheets, MindMaps for ITCS-Coding/Algorithm/SoftwareArchitecture/AI. 💫 ITCS-编程/算法/软件架构/人工智能等领域的文章/书籍/资料/项目链接精选，岁月沉淀的美好
Example models using DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.