remove litellm dependency #545

ohdearquant · 2025-01-23T15:30:54Z

PR 2: Remove `litellm` Dependency

Summary of Changes:

Removed all references to litellm within chat_completion.py and related modules.
Removed litellm from pyproject.toml dependency list and adjusted uv.lock.
Cleaned up any import checks for litellm (check_import("litellm")) and replaced them with either direct code or no-op checks as needed.

Why This PR?

litellm is no longer required in our workflow due to internal reorganization of how LLM calls are managed.
Streamlines dependencies, reducing potential conflicts or overhead for users who do not require litellm.
Simplifies environment setup.

Impact and Testing:

Validated no breakage in any module reliant on litellm, as these were either removed or replaced with native logic.
Confirmed that references in pyproject.toml and README.md are updated accordingly.

… dependency availability

…iocache, aiohttp, pydantic, and tiktoken

ohdearquant added 2 commits January 23, 2025 10:30

fix: add import check for litellm in ChatCompletionEndPoint to ensure…

2209bc6

… dependency availability

fix: update dependencies in README.md and pyproject.toml to include a…

3800337

…iocache, aiohttp, pydantic, and tiktoken

ohdearquant merged commit 7785af2 into main Jan 23, 2025
5 checks passed

ohdearquant deleted the updated-imodel2 branch January 23, 2025 15:38