gguf

Here are 6 public repositories matching this topic...

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Effortlessly run LLM backends, APIs, frontends, and services with one command.

bash docker cli npm package tools ai local tool docker-compose pypi container self-hosted llm safetensors gguf exl2

Run AI ✨ assistant locally! with simple API for Node.js 🚀

nodejs ai chatbot openai chatui vicuna ai-assistant llm chatgpt dalai llama-cpp vicuna-installation-guide localai wizardlm local-llm catai ggmlv3 gguf node-llama-cpp

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.

machine-learning large-language-models llm llamacpp ggml gguf

Local Llama project, L³ is an electron app that runs llama 3 models locally

electron chat privacy local chatbot llm gguf node-llama-cpp llama3

Kaalaman AI is an open source web app that use GPT-Generated Unified Format (GGUF)

typescript ai nextjs fastify javacsript gguf nextjs14

Add a description, image, and links to the gguf topic page so that developers can more easily learn about it.

To associate your repository with the gguf topic, visit your repo's landing page and select "manage topics."