feat: Add vLLM as a Custom Inference Provider - #46

Open

Hadar301 wants to merge 41 commits into

validatedpatterns-sandbox:mainfrom

Hadar301:feat/custom-inference-provider

Commits on Sep 17, 2026

feat: add vLLM custom inference provider support

Hadar301
and
claude
committed
38ac2f3
feat: set customEndpointHost for vLLM governance profile

Hadar301
and
claude
committed
a210853
fix: use distinct workspace name 'vllm' for custom provider profile

Hadar301
and
claude
committed
311e38e
fix: use TCP socket check for governance interceptor reachability

Hadar301
and
claude
committed
d77f81c
fix: gate URL propagation on explicit urlSecretKey in providers.yaml

Hadar301
and
claude
committed
35c5012
fix: delete ArgoCD apps before uninstall to prevent hub-deletion deadlock

Hadar301
and
claude
committed
0a31917
fix: remove ESO webhook config in pre-uninstall to prevent ns termination deadlock

Hadar301
and
claude
committed
bcb63af
fix: set featureGates to empty array in HyperConverged CR

Hadar301
and
claude
committed
3a55ab7
revert: restore HyperConverged spec: {} — featureGates: [] rejected by webhook

Hadar301
and
claude
committed
fbde0f5
fix: wait for HyperConverged CR deletion in pre-uninstall

Hadar301
and
claude
committed
598aeab
fix: disable ArgoCD auto-sync before deleting apps in pre-uninstall

Hadar301
and
claude
committed
153caf7
fix: pre-populate gateway supervisor cache to prevent startup failure

Hadar301
and
claude
committed
b696aac
fix: use openai provider type for custom vLLM endpoints

Hadar301
and
claude
committed
a1b8d98
chore: set customEndpointHost for cluster-xgrmq vLLM deployment

Hadar301
and
claude
committed
b7b3846
fix: extract /openshell-supervisor (not /openshell-sandbox) from upstream image

Hadar301
and
claude
committed
278ef94
fix: force-finalize namespace after uninstall to handle ESO webhook race

Hadar301
and
claude
committed
e5bcef1
fix: use single-line guest_ssh for supervisor cache pre-population

Hadar301
and
claude
committed
ac5bc00
fix: update vllm sandbox profile to reference openai provider name

Hadar301
and
claude
committed
b4682b4
fix: use ODH binary (not upstream /openshell-supervisor) for gateway cache

Hadar301
and
claude
committed
05e4c48
fix: set chmod 755 after copying ODH binary to gateway supervisor cache

Hadar301
and
claude
committed
45f87f0
fix: increase setup job activeDeadlineSeconds to 60 minutes

Hadar301
and
claude
committed
b06d9df
fix: skip verifier checks for providers with type mismatches

Hadar301
and
claude
committed
d86d1f6
fix: add systemd ExecStartPre to pre-populate gateway supervisor cache

Hadar301
and
claude
committed
0924d6f
fix: add StartLimitIntervalSec/Burst to sandbox keep-alive service

Hadar301
and
claude
committed
0bdfa91

Commits on Sep 22, 2026

chore: update customEndpointHost for cluster-n9ln8

Hadar301
and
claude
committed
31b8659
docs: add custom vLLM inference provider guide and README link

Hadar301
and
claude
committed
7743601
fix: pull upstream image in ExecStartPre before pre-populating cache

Hadar301
and
claude
committed
b871073
fix: set nemoclawProvider: custom to match inference.provider field

Hadar301
and
claude
committed
aadbece
fix: delete App-of-Apps first in pre-uninstall to prevent child app recreation

Hadar301
and
claude
committed
4464d3e
fix: use docker images --no-trunc -q instead of --format {{.Id}} in systemd unit

Hadar301
and
claude
committed
aec94c5
fix: escape \$D and \$() in guest_ssh heredoc for systemd drop-in

Hadar301
and
claude
committed
ff608dc
fix: use docker images --no-trunc -q + background uninstall loop
Hadar301
committed
3719eb6
fix: delete Keycloak PVC in pre-uninstall to prevent stale DB on reinstall
Hadar301
committed
f1adb76

Commits on Sep 23, 2026

chore: update vLLM endpoint for cluster-9djv7
Hadar301
committed
4bdd4b8
fix: repair supervisor cache setup and propagate custom inference model
Hadar301
committed
09bfb0c
fix: preserve supervisor cache startup hook after route SAN override
Hadar301
committed
d557e39
fix: harden custom inference setup and deployment recovery
Hadar301
committed
86416a2
fix: align Docker sandbox networking with the VM uplink MTU
Hadar301
committed
a60f48a
chore: update gitignore
Hadar301
committed
22e477b

Commits on Sep 24, 2026