8000 llm-d · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
@llm-d

llm-d

llm-d is a Kubernetes-native high-performance distributed LLM inference framework

Popular repositories Loading

  1. llm-d llm-d Public

    llm-d is a Kubernetes-native high-performance distributed LLM inference framework

    Makefile 720 37

  2. llm-d-inference-scheduler llm-d-inference-scheduler Public

    Inference scheduler for llm-d

    Go 38 14

  3. llm-d-kv-cache-manager llm-d-kv-cache-manager Public

    Distributed KV cache coordinator

    Go 27 3

  4. llm-d-deployer llm-d-deployer Public

    Helm charts for llm-d

    Shell 26 13

  5. llm-d-inference-sim llm-d-inference-sim Public

    A light weight vLLM simulator, for mocking out replicas.

    Go 15 5

  6. llm-d-model-service llm-d-model-service Public

    Simplified model deployment on llm-d

    Go 13 4

Repositories

Showing 10 of 10 repositories
  • llm-d-benchmark Public

    llm-d benchmark scripts and tooling

    llm-d/llm-d-benchmark’s past year of commit activity
    Shell 10 Apache-2.0 2 2 0 Updated May 22, 2025
  • llm-d Public

    llm-d is a Kubernetes-native high-performance distributed LLM inference framework

    llm-d/llm-d’s past year of commit activity
    Makefile 720 Apache-2.0 37 14 13 Updated May 22, 2025
  • llm-d-inference-sim Public

    A light weight vLLM simulator, for mocking out replicas.

    llm-d/llm-d-inference-sim’s past year of commit activity
    Go 15 4 2 1 Updated May 22, 2025
  • llm-d-deployer Public

    Helm charts for llm-d

    llm-d/llm-d-deployer’s past year of commit activity
    Shell 26 Apache-2.0 13 23 10 Updated May 22, 2025
  • llm-d.github.io Public

    Website for llm-d: This repository builds the website seen at llm-d.ai

    llm-d/llm-d.github.io’s past year of commit activity
    JavaScript 2 5 2 0 Updated May 21, 2025
  • llm-d-model-service Public

    Simplified model deployment on llm-d

    llm-d/llm-d-model-service’s past year of commit activity
    Go 13 Apache-2.0 4 26 2 Updated May 21, 2025
  • llm-d-kv-cache-manager Public

    Distributed KV cache coordinator

    llm-d/llm-d-kv-cache-manager’s past year of commit activity
    Go 27 3 8 (2 issues need help) 0 Updated May 21, 2025
  • llm-d-pd-utils Public
    llm-d/llm-d-pd-utils’s past year of commit activity
    Makefile 3 3 0 0 Updated May 21, 2025
  • llm-d-routing-sidecar Public

    Incubating P/D sidecar for llm-d

    llm-d/llm-d-routing-sidecar’s past year of commit activity
    Go 8 Apache-2.0 2 5 (1 issue needs help) 0 Updated May 21, 2025
  • llm-d-inference-scheduler Public

    Inference scheduler for llm-d

    llm-d/llm-d-inference-scheduler’s past year of commit activity
    Go 38 Apache-2.0 14 34 (2 issues need help) 6 Updated May 21, 2025

Most used topics

incubating ai
0