Embedding service with mosec that is compatible with OpenAI embedding API.
EMB_MODEL=thenlper/gte-base python main.pyYou can find more embedding models from the HuggingFace Embedding LeaderBoard.
envd upYou can use the prebuilt image from ghcr: kemingy/mosec_emb.
docker run --rm -p 8000:8000 ghcr.io/kemingy/mosec_emb:latestOr build your own image:
# docker
docker build .
# envd
envd build :servingpython client.py