Skip to content
This repository was archived by the owner on Feb 26, 2026. It is now read-only.

CD-29 - Add deploying custom models docs#64

Open
WashingtonKK wants to merge 4 commits intoultravioletrs:mainfrom
WashingtonKK:cd-29
Open

CD-29 - Add deploying custom models docs#64
WashingtonKK wants to merge 4 commits intoultravioletrs:mainfrom
WashingtonKK:cd-29

Conversation

@WashingtonKK
Copy link
Contributor

What type of PR is this?

What does this do?

Which issue(s) does this PR fix/relate to?

Have you included tests for your changes?

Did you document any new/modified features?

Notes

Signed-off-by: WashingtonKK <washingtonkigan@gmail.com>
@WashingtonKK WashingtonKK self-assigned this Feb 20, 2026
Signed-off-by: WashingtonKK <washingtonkigan@gmail.com>
Signed-off-by: WashingtonKK <washingtonkigan@gmail.com>
Comment on lines +30 to +31
# Buildroot CVM
scp -P 6190 my-model.tar.gz root@localhost:/var/lib/ollama/
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

our buildroot has a way to load this during build with menuconfig

scp -P 6190 my-model.tar.gz root@localhost:/var/lib/ollama/

# Ubuntu cloud-init CVM
scp -P 6190 my-model.tar.gz ultraviolet@localhost:/var/lib/ollama/
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what is the 6190 magic number, other magic numbers on this file


#### 3. Extract and Register the Model

SSH into the CVM and create an Ollama model from the uploaded files using a [Modelfile](https://github.com/ollama/ollama/blob/main/docs/modelfile.md):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what about vllm

Signed-off-by: WashingtonKK <washingtonkigan@gmail.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Document deploying custom models with HAL and cloud init

2 participants