Stars
Distribute and run LLMs with a single file.
HFS is a web file server to run on your computer. Share folders or even a single file thanks to the virtual file system.
🚀 One-stop solution for creating your digital avatar from chat logs 💡 Fine-tune LLMs with your chat logs to capture your unique style, then bind to a chatbot to bring your digital self to life. 从聊天…
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seaml…
A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-fri…
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
An OpenAI API compatible FastAPI server that sits on top of the Anemll repo. Tested with Open WebUI.
Largest list of models for Core ML (for iOS 11+)
Build Real-Time Knowledge Graphs for AI Agents
Python tool for converting files and office documents to Markdown.
🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.
📝 EchoAI: Explore knowledges with your own studymate.
Demux media files in the browser using WebAssembly, designed for WebCodecs 在浏览器中实现媒体文件的解封装，专为WebCodecs设计
Extract media file metadata in the browser using WebAssembly.
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Dive is an open-source MCP Host Desktop Application that seamlessly integrates with any LLMs supporting function calling capabilities. ✨
Enhanced ChatGPT Clone: Features Agents, DeepSeek, Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message se…
A tiny command line DNS client with support for UDP, TCP, DoT, DoH, DoQ and ODoH.
A self-hosted data logger for your Tesla 🚘
The open-source, cross-platform API client for GraphQL, REST, WebSockets, SSE and gRPC. With Cloud, Local and Git storage.
Open source codebase powering the HuggingChat app
Xiaomi Home Integration for Home Assistant
Create scheduled jobs with human readable time settings