Skip to content

Integrate CSGHub with dstack for apps, training, and inference #838

@peterschmidt85

Description

@peterschmidt85

CSGHub integrates with Kubernetes, Ray, and Knative to deploy apps, train models, and run model inference.

dstack is a lightweight alternative to Kubernetes, Ray, and Knative that could be a much better fit.

Here are its key advantages:

  1. dstack supports leading cloud GPU providers and makes it easy to add native support for new providers.
  2. dstack simplifies the use of on-prem GPU machines compared to Kubernetes.
  3. dstack addresses many challenges related to deploying apps, managing endpoints, and scheduling complex training tasks.

By integrating with dstack, CSGHub users could experience up to a 10x simplification when connecting to cloud providers or on-prem clusters.

Metadata

Metadata

Assignees

Labels

GitLab linkedlinked to a GitLab task or issue.enhancementNew feature or requestin-progressWork in progress

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions