Unable to use Baseten with Instructor #664
Unanswered
duncandevs
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Trying to use baseten with instructor and keep running into the following error
AssertionError: Instructor does not support multiple tool calls, use List[Model] instead.for more context to use Baseten requires making the following changes to the client
openAiClient = OpenAI( api_key=<baseten_api_key>, base_url=<baseten_model_url> )and the model is changed to
minstral-7bBeta Was this translation helpful? Give feedback.
All reactions