Replies: 2 comments
-
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Typically that's sufficient. We know some folks have tried smollm2 with ultravox. If it turns out some small changes are needed, please create a PR. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I would like to train a smaller ultravox model with whisper-small as audio encoder and smollm2 as language model. In the file https://github.com/fixie-ai/ultravox/blob/main/ultravox/training/configs/tiny_config.yaml if I change the text_model property to smollm2-360m-instruct , will that be sufficient or do I need to make other changes also?
Beta Was this translation helpful? Give feedback.
All reactions