8000 vectorch-ai repositories · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

@vectorch-ai Vectorch AI

Change the repository type filter

All

    Repositories list

    13 repositories

    • ScaleLLM

      Public
      A high-performance inference system for large language models, designed for production environments.
      performancegpumodelproductioncudaefficiencyinferencetransformerllamaspeculative
      C++
      •
      Apache License 2.0
      •35•439•48•9•Updated May 15, 2025May 15, 2025

    • flux

      Public
      A fast communication-overlapping library for tensor/expert parallelism on GPUs.
      C++
      •
      Apache License 2.0
      •59•0•0•0•Updated Apr 15, 2025Apr 15, 2025

    • whl

      Public
      repository to host python whl package.
      HTML
      •0•0•0•0•Updated Mar 2, 2025Mar 2, 2025

    • 3FS

      Public
      A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
      C++
      •
      MIT License
      •881•0•0•0•Updated Feb 28, 2025Feb 28, 2025

    • flashinfer

      Public
      FlashInfer: Kernel Library for LLM Serving
      Cuda
      •
      Apache License 2.0
      •306•0•0•0•Updated Feb 27, 2025Feb 27, 2025

    • FlashMLA

      Public
      C++
      •
      MIT License
      •834•0•0•0•Updated Feb 26, 2025Feb 26, 2025

    • vcpkg

      Public
      C++ Library Manager for Windows, Linux, and MacOS
      CMake
      •
      MIT License
      •6.8k•0•0•0•Updated Feb 24, 2025Feb 24, 2025

    • discussions

      Public
      0•0•0•0•Updated Jun 5, 2024Jun 5, 2024

    • flash-attention

      Public
      Fast and memory-efficient exact attention
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •1.7k•0•0•0•Updated Oct 15, 2023Oct 15, 2023

    • tokenizers

      Public
      💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
      Rust
      •
      Apache License 2.0
      •896•0•0•0•Updated Aug 4, 2023Aug 4, 2023

    • xformers

      Public
      Hackable and optimized Transformers building blocks, supporting a composable construction.
      Python
      •
      Other
      •671•0•0•0•Updated Aug 1, 2023Aug 1, 2023

    • FasterTransformer

      Public
      Transformer related optimization, including BERT, GPT
      C++
      •
      Apache License 2.0
      •904•0•0•0•Updated Jul 28, 2023Jul 28, 2023

    • ByteTransformer

      Public
      optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
      C++
      •
      Apache License 2.0
      •37•0•0•0•Updated Jul 24, 2023Jul 24, 2023
    0