Lab 12: Serve Models from a KitOps ModelKit on HAMi
Package a model as a KitOps ModelKit, pull it from Jozu Hub with an initContainer, and serve it locally with SGLang (and optionally vLLM) on HAMi GPU shares.
2 docs tagged with "inference"
View all tagsLab 6: Run vLLM on HAMi GPU Shares
Install HAMi on a GPU cluster and schedule vLLM inference services with GPU partitioning.
