Stars
Custom Python Scheduler for Kubernetes
Training transformer models (e.g. RoBERTa, GPT2 and GPT-J) from scratch.
The paper list of the 86-page paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.
A high-throughput and memory-efficient inference and serving engine for LLMs