Stars
LLMs
5 repositories
Thunder gives you PyTorch models superpowers for training and inference. Unlock out-of-the-box optimizations for performance, memory and parallelism, or roll out your own.
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Instruct-tune LLaMA on consumer hardware
◉ Universal Intelligence: AI made simple.