Lists (8)
Stars
A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/READ…
A micro Vulkan compute pipeline and a collection of benchmarking compute shaders
Official repository for our work on micro-budget training of large-scale diffusion models.
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.
Distributed LLM and StableDiffusion inference for mobile, desktop and server.
Extract Metal functions from .metallib files.
An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
A simple screen parsing tool towards pure vision based GUI agent
An app that brings language models directly to your phone.
Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
The world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writing Tools. Works on Windows, Linux, & macOS, with the free Gemini API, local LLMs, & more.
Reverse Engineering: Decompiling Binary Code with Large Language Models
Official inference framework for 1-bit LLMs
Run PyTorch LLMs locally on servers, desktop and mobile
A tool which profiles OpenCL devices to find their peak capacities
2 books and related source codes for algorithmic trading.
Demonstration of various hardware effects on CUDA GPUs.
Python library for portfolio optimization built on top of scikit-learn
Investment Research for Everyone, Everywhere.
ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
llama3 implementation one matrix multiplication at a time
talipp - incremental technical analysis library for python
STUMPY is a powerful and scalable Python library for modern time series analysis