8000 Add OpenAI API compatible endpoint to API · Issue #883 · neuml/txtai · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Add OpenAI API compatible endpoint to API #883

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
davidmezzetti opened this issue Mar 1, 2025 · 1 comment
Closed

Add OpenAI API compatible endpoint to API #883

davidmezzetti opened this issue Mar 1, 2025 · 1 comment
Assignees
@davidmezzetti
Milestone
v8.4.0

Comments

@davidmezzetti
Copy link
Member

Add an OpenAI API compatible endpoint. See https://github.com/openai/openai-openapi for endpoint details to implement.

This will enable users to interface with txtai using an API they are (likely) already familiar with. While txtai already has an API, this will provide another option.

Add the following endpoints:

  • /v1/chat/completions
    • model parameter controls logic path. Support llm, rag, embeddings, agents, pipelines and workflows.
  • /v1/embeddings
  • /v1/audio/speech
  • /v1/audio/transcriptions
  • /v1/audio/translations

Each endpoint will assume the necessary pipeline is enabled in the API configuration file.

Once implemented, any of the OpenAI API libraries can be used to interface with txtai.
@davidmezzetti davidmezzetti added this to the v8.4.0 milestone Mar 1, 2025
@davidmezzetti davidmezzetti self-assigned this Mar 1, 2025
@ccdv-ai
Copy link
ccdv-ai commented Mar 3, 2025

will it be compatible with the vLLM score/reward/classify APIs ??

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@davidmezzetti davidmezzetti

Labels
None yet
Projects
None yet
Milestone
v8.4.0
Development

No branches or pull requests
2 participants
@davidmezzetti @ccdv-ai
0