#
Lists (1)
Starred repositories
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (p…
A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (p…
A repository dedicated to evaluating the performance of quantizied LLaMA3 using various quantization methods..
PyTorch native quantization and sparsity for training and inference
Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
A system-level, binary package and environment manager running on all major operating systems and platforms.
A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
Production ready LLM model compression/quantization toolkit with hw accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.
The icon font for Visual Studio Code
Font converter to convert woff2ttf, wof2otf & ttf2woff, otf2woff
Ollama chat client in Vue, everything you need to do your private text rpg in browser
Private & local AI personal knowledge management app for high entropy people.
A privacy-first, self-hosted, fully open source personal knowledge management software, written in typescript and golang.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
AI Studio is an independent app for utilizing LLMs.
Easily create LLM tools and agents using plain Bash/JavaScript/Python functions.
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
Materials for following along with Hands-On Data Analysis with Pandas – Second Edition
A framework for evaluating RAG pipelines, specifically adapted for the legal domain.
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama mode…