8000 QoL: Default to using fast tokenizer for Llama models by arnavgarg1 · Pull Request #3625 · ludwig-ai/ludwig · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

QoL: Default to using fast tokenizer for Llama models#3625

Merged
arnavgarg1 merged 2 commits intomasterfrom
llama-tokenizer
Sep 18, 2023

Commits

Commits on Sep 17, 2023

Commits on Sep 18, 2023

0