Skip to content

[Model Manager]: Litellm enhancements - #1596

Merged
yussufsh merged 2 commits into
IBM:mainfrom
hasan4791:litellm-enhancements
Oct 27, 2026
Merged

yussufsh merged 2 commits into
IBM:mainfrom
hasan4791:litellm-enhancements

Conversation

@hasan4791

@hasan4791 hasan4791 commented Oct 8, 2026 •

Copy link
Copy Markdown
Member
  1. Enable DB integration by building prisma-engines for ppc64le
  2. Update Containerfile to build Litellm & prisma-engines in parallel
  3. Integrity check for the downloaded files by maintaining checksums
  4. Updated patch script to quickly regenerate the patches for litellm version bump & CVE fixes
  5. Added new make targets: run, clean, verify-patch, update-checksums
  6. Refactored Containerfile by moving it to relavant scripts (build-litellm.sh, build-prisma.sh, install-prisma-cli.sh)
  7. Patches are now segregated into patches/litellm, patches/prisma
  8. Updated config.yaml: removed modelinfo & passthrough configs

@hasan4791
hasan4791 force-pushed the litellm-enhancements branch 3 times, most recently from ee50b1a to b5764a6 Compare October 13, 2026 12:53
@hasan4791
hasan4791 requested a review from yussufsh October 13, 2026 13:49
Comment thread images/litellm/config/config.yaml Resolved
Comment thread images/litellm/config/config.yaml Resolved
Comment thread images/litellm/config/config.yaml Resolved
Comment thread images/litellm/Containerfile Resolved

@Shubhamag12 Shubhamag12 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

minor nits

Comment thread images/litellm/Containerfile Resolved
Comment thread images/litellm/Containerfile Resolved
Comment thread images/litellm/Containerfile Resolved
1. Enable DB integration by building prisma-engines for ppc64le
2. Update Containerfile to build Litellm & prisma-engines in parallel
3. Integrity check for the downloaded files by maintaining checksums
4. Updated patch script to quickly regenerate the patches for litellm version bump & CVE fixes
5. Added new make targets: run, clean, verify-patch, update-checksums
6. Refactored Containerfile by moving it to relavant scripts (build-litellm.sh, build-prisma.sh, install-prisma-cli.sh)
7. Patches are now segregated into patches/litellm, patches/prisma
8. Updated config.yaml: removed modelinfo & passthrough configs

Signed-off-by: T K Chandra Hasan <t.k.chandra.hasan@ibm.com>
@hasan4791
hasan4791 force-pushed the litellm-enhancements branch from a6942d9 to 71d4f52 Compare October 27, 2026 13:38
@hasan4791 hasan4791 changed the title Litellm enhancements for model management. [Model Manager]: Litellm enhancements Oct 27, 2026
Signed-off-by: T K Chandra Hasan <t.k.chandra.hasan@ibm.com>

@yussufsh yussufsh left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm
Only worry is use of python3.14. We might not have full support in future from devpi since this project mostly rely on python3.12 packages.
Something we can change later as well as you have added it as an arg.

@yussufsh
yussufsh dismissed mkumatag’s stale review October 27, 2026 15:48

review comment resolved.

@yussufsh
yussufsh merged commit 5a668cc into IBM:main Oct 27, 2026
13 checks passed
Abhishek-Kushwaha1 pushed a commit to Abhishek-Kushwaha1/project-ai-services that referenced this pull request Oct 28, 2026
1. Enable DB integration by building prisma-engines for ppc64le
2. Update Containerfile to build Litellm & prisma-engines in parallel
3. Integrity check for the downloaded files by maintaining checksums
4. Updated patch script to quickly regenerate the patches for litellm
version bump & CVE fixes
5. Added new make targets: run, clean, verify-patch, update-checksums
6. Refactored Containerfile by moving it to relavant scripts
(build-litellm.sh, build-prisma.sh, install-prisma-cli.sh)
7. Patches are now segregated into patches/litellm, patches/prisma
8. Updated config.yaml: removed modelinfo & passthrough configs

---------

Signed-off-by: T K Chandra Hasan <t.k.chandra.hasan@ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants