Stars
FlashInfer: Kernel Library for LLM Serving
An extremely fast Python package and project manager, written in Rust.
Python tool for converting files and office documents to Markdown.
Fast, Flexible and Portable Structured Generation
A Data Streaming Library for Efficient Neural Network Training
Enforce the output format (JSON Schema, Regex etc) of a language model
Allows to check regexes for overlaps. Based on greenery by @qntm.
A simple pip-installable Python tool to generate your own HTML citation world map from your Google Scholar ID.
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.
A high-throughput and memory-efficient inference and serving engine for LLMs
The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.
https://wavespeed.ai/ Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
LaTeX style file for the Journal of Machine Learning Research
🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术
Data validation using Python type hints
Human ChatGPT Comparison Corpus (HC3), Detectors, and more! 🔥
✨✨Latest Advances on Multimodal Large Language Models
Infinite Photorealistic Worlds using Procedural Generation
Samples for CUDA Developers which demonstrates features in CUDA Toolkit
Z-Bench 1.0 by 真格基金：一个麻瓜的大语言模型中文测试集。Z-Bench is a LLM prompt dataset for non-technical users, developed by an enthusiastic AI-focused team in Zhenfund.