8000 how to inference with pretrained model? · Issue #1169 · pytorch/torchtitan · GitHub

More Web Proxy on the site http://driver.im/

how to inference with pretrained model? #1169

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

dragen1860 opened this issue May 6, 2025 · 1 comment

dragen1860 commented

hi, after pretrain/sft with torchtitan, how to inference with the checkpoint? does the repo provide the inference code? thank you.

Contributor

tianyu-l commented

We provide basic generation script for llama 3 at https://github.com/pytorch/torchtitan/tree/main/scripts/generate

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

0