8000 Tags · kalomaze/koboldcpp · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Tags: kalomaze/koboldcpp

Tags

v1.57-cuda12-oldyield

Toggle v1.57-cuda12-oldyield's commit message
Revert scheduling to the old method for CPU perf

v1.57-cuda12

Toggle v1.57-cuda12's commit message
updated readme

quad-sampling-v1

Toggle quad-sampling-v1's commit message
smooth sampling v2

smooth-sampling-v1

Toggle smooth-sampling-v1's commit message
Update ExtStuff.txt

v1.54-ui-dynatemp-fix

Toggle v1.54-ui-dynatemp-fix's commit message
compact dynatemp into a single value dynatemp_range. This is a float …

…which represents the allowed deviation from the min and max temperature when using dynatemp. Thus, if we want a value of dynatemp_min=0.3, dynatemp_max=0.5, then we would simply set temperature=0.4 and dynatemp_range=0.1. Functionally dynatemp would operate the same, but it would simplify usage and make it a single easy to adjust value.

dynatemp-ui

Toggle dynatemp-ui's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Merge Dynamic Temp UI + cleanups into dynatemp-pr-upstream

cuda-12-updated-kcpp

Toggle cuda-12-updated-kcpp's commit message
fixed incorrect localflag

faster-pp-mixtral-kcpp

Toggle faster-pp-mixtral-kcpp's commit message
CUDA: mul_mat_id always on GPU for batches >= 32

dec-15-updated

Toggle dec-15-updated's commit message
Change override values for DynaTemp variants

3.9 Temp for Greedy Dynamic Temp
2.2 Temp for HHI Dynamic Temp

1.84 Temp for Entropy Dynamic Temp (this one remains the same as before)

custom-routing-test

Toggle custom-routing-test's commit message
Change default expert count to 2

0