Senior Partner Engineer @github
- GitHub Staff
- New York, NY
-
09:45
(UTC -04:00) - https://bsky.app/profile/marzvrover.com
- @marzvrover@hachyderm.io
- marzvrover
- in/marzvrover
Stars
ml
4 repositories
A high-throughput and memory-efficient inference and serving engine for LLMs
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.
Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚