8000 Do not hardcode agent llm and embedding model · Issue #43 · SAP/STARS · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Do not hardcode agent llm and embedding model #43

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and pr 92F4 ivacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
marcorosa opened this issue Apr 24, 2025 · 0 comments
Open

Do not hardcode agent llm and embedding model #43

marcorosa opened this issue Apr 24, 2025 · 0 comments
Labels
agent Issues specifically about the agent

Comments

@marcorosa
Copy link
Member

Currently, the LLM powering the agent is gpt-4, and this choice is not configurable as its value is hardcoded here.
Same goes for the embedding model text-embedding-ada-002.

They should be default values and overriding should be possible with environment variables (e.g., in .env).

Furthermore, gpt-4 is getting aged and we should consider replacing it with gpt-4o or a o-model. See SAP notes on model for the currently available
@marcorosa marcorosa added the agent Issues specifically about the agent label Apr 24, 2025
@marcorosa marcorosa mentioned this issue May 7, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
agent Issues specifically about the agent
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@marcorosa
0