8000 Integrate CSGHub with dstack for apps, training, and inference · Issue #838 · OpenCSGs/csghub · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Integrate CSGHub with dstack for apps, training, and inference #838

Open
peterschmidt85 opened this issue Dec 10, 2024 · 4 comments
Open

Integrate CSGHub with dstack for apps, training, and inference #838

peterschmidt85 opened this issue Dec 10, 2024 · 4 comments
Assignees
@ganisback
Labels
enhancement New feature or request GitLab linked linked to a GitLab task or issue. in-progress Work in progress

Comments

@peterschmidt85
Copy link

CSGHub integrates with Kubernetes, Ray, and Knative to deploy apps, train models, and run model inference.

dstack is a lightweight alternative to Kubernetes, Ray, and Knative that could be a much better fit.

Here are its key advantages:

  1. dstack supports leading cloud GPU providers and makes it easy to add native support for new providers.
  2. dstack simplifies the use of on-prem GPU machines compared to Kubernetes.
  3. dstack addresses many challenges related to deploying apps, managing endpoints, and scheduling complex training tasks.

By integrating with dstack, CSGHub users could experience up to a 10x simplification when connecting to cloud providers or on-prem clusters.
@peterschmidt85
Copy link
Author

If required, our team is happy to assist with the integration.

@ganisback ganisback self-assigned this Dec 11, 2024
@ganisback ganisback added the enhancement New feature or request label Dec 11, 2024
@ganisback
Copy link
Collaborator

Thank you for reporting feature requirement, I just looked at it, dstack is a very light framework for LLM deployment. we will start investigation in next a few weeks.

@samchen8008
Copy link
Contributor

Guys, @peterschmidt85 @ganisback can you guys create one PR for the further integration?

@jialudev jialudev added the in-progress Work in progress label Jan 23, 2025
@jialudev jialudev added the GitLab linked linked to a GitLab task or issue. label Feb 11, 2025
@jialudev
Copy link
Collaborator

gitlab-issue-343

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ganisback ganisback

Labels
enhancement New feature or request GitLab linked linked to a GitLab task or issue. in-progress Work in progress
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@ganisback @jialudev @peterschmidt85 @samchen8008
0