#
Lists (4)
Starred repositories
The python library for real-time communication
这是一个用于显示当前网速、CPU及内存利用率的桌面悬浮窗软件，并支持任务栏显示，支持更换皮肤。
RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
RAG Web UI is an intelligent dialogue system based on RAG (Retrieval-Augmented Generation) technology.
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.
LLMs-from-scratch项目中文翻译
Master Python typing (type hints) with interactive online exercises!
Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models"
Fast and memory-efficient exact attention
中文翻译的 Hands-On-Large-Language-Models (hands-on-llms)，动手学习大模型
LLM大模型（重点）以及搜广推等 AI 算法中手写的面试题，（非 LeetCode），比如 Self-Attention, AUC等，一般比 LeetCode 更考察一个人的综合能力，又更贴近业务和基础知识一点
Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller
Python package built to ease deep learning on graph, on top of existing DL frameworks.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
A high-throughput and memory-efficient inference and serving engine for LLMs
Retrieval and Retrieval-augmented LLMs
MTEB: Massive Text Embedding Benchmark
目前已囊括232个大模型，覆盖chatgpt、gpt-4o、o3-mini、谷歌gemini、Claude3.5、智谱GLM-Zero、文心一言、qwen-max、百川、讯飞星火、商汤senseChat、minimax等商用模型， 以及DeepSeek-R1、qwq-32b、deepseek-v3、qwen2.5、llama3.3、phi-4、glm4、gemma3、mistral、书生in…
Learning Large Language Model (LLM）(大语言模型学习)
Doing simple retrieval from LLM models at various context lengths to measure accuracy
An extremely fast Python package and project manager, written in Rust.
Code and documentation to train Stanford's Alpaca models, and generate the data.