8000 Commits · personalityb0y/PowerInfer · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Jun 11, 2024

Commits on May 20, 2024

Support AMD ROCm(#187)

freelulul
and
hodlen
authored

Commits on Apr 7, 2024

fix: offload ffn norm weights (#179)
hodlen
authored

Commits on Apr 2, 2024

Commits on Mar 28, 2024

Support Bamboo LM sparse and dense inference (#171)
hodlen
authored

Commits on Mar 27, 2024

Optimize `mul_mat_sparse` for INT4 quantized weights (#174)

hodlen
and
syx
authored
Use `mul_mat_transpose` at axpy op for large batch (#168)

Begunner
and
hodlen
authored

Commits on Mar 17, 2024

Full-GPU computational graph and CUDA refactoring (#153)
hodlen
authored

Commits on Mar 14, 2024

Add prosparse to README (#149)

Raincleared-Song
and
hodlen
authored

Commits on Mar 7, 2024

fix: unknown host compiler flags passed to nvcc (#161)
hodlen
authored

Commits on Feb 20, 2024

Fix compiling issue under git worktrees (#146)
hodlen
authored

Commits on Feb 18, 2024

Fix CMake requirement in README (#145)
hodlen
authored

Commits on Feb 1, 2024

Commits on Jan 30, 2024

Docs: add detailed instruction on downloading HF models (#136)
hodlen
authored

Commits on Jan 26, 2024

Update README: add Windows-specific commands (#133)
hodlen
authored
fix activation file detection (#134)
hodlen
authored
< 8000 /div>

Commits on Jan 24, 2024

Commits on Jan 11, 2024

Support CPU/GPU inference on Windows (#114)

hodlen
and
zwb
authored

Commits on Jan 4, 2024

Convert HF models with sparse threshold specified (#76)
Szy0127
authored

Commits on Jan 3, 2024

Commits on Dec 29, 2023

Support setting VRAM budget for `examples/server` (#106)
hodlen
authored

Commits on Dec 27, 2023

Commits on Dec 24, 2023

Commits on Dec 22, 2023

Fix VRAM capacity assertion bug (#62)
hodlen
authored

Commits on Dec 21, 2023

0