Welcome to the LLM Hosting Container GitHub repository!
This repository contains the Dockerfiles and associated resources for building and hosting containers for large language models and embedding models.
- Hugging Face Text Generation Inference (TGI) container
- Hugging Face Text Embeddings Inference (TEI) container
See CONTRIBUTING for more information.
This project is licensed under the Apache-2.0 License.