Skip to content

Fix package validation failure with llama.cpp - #8341

Merged
cdeepali merged 35 commits into
ppc64le:masterfrom
shalinib-ibm:patch-10
Jul 30, 2026
Merged

cdeepali merged 35 commits into
ppc64le:masterfrom
shalinib-ibm:patch-10

Conversation

@shalinib-ibm

@shalinib-ibm shalinib-ibm commented Jul 2, 2026 •

Copy link
Copy Markdown
Contributor

Installing the .whl file and running llama binaries

  1. pip show llama_cpp_python_package
  2. pip install llama_cpp_python_package-1.0+ppc64le10145-py3-none-linux_ppc64le.whl
  3. pip show llama_cpp_python_package
  4. export LD_LIBRARY_PATH=/usr/local/lib/python3.9/site-packages/llama_cpp_python_package/lib:$LD_LIBRARY_PATH
  5. /usr/local/lib/python3.9/site-packages/llama_cpp_python_package/bin/llama-bench -m /home/shalini/Models/granite-3.3-8b-instruct-f16.gguf -t 20

Checklist

  • Have you checked and followed all the points mention in the CONTRIBUTING.MD
  • Have you validated script on UBI 9 container
  • Did you run the script(s) on fresh container with set -e option enabled and observe success ?
  • Did you have Legal approvals for patch files ?

@cdeepali

cdeepali commented Jul 3, 2026

Copy link
Copy Markdown
Contributor

@shalinib-ibm the output wheel generated is llama_cpp_scripts-0.0.0-py3-none-any.whl. Can you please check.

Also, currently the script is using master branch. Can you please change it to build desired version?

@shalinib-ibm

Copy link
Copy Markdown
Contributor Author

@shalinib-ibm the output wheel generated is llama_cpp_scripts-0.0.0-py3-none-any.whl. Can you please check.

Also, currently the script is using master branch. Can you please change it to build desired version?

Thank you @deepali . I have fixed the versioning number in wheel.

@cdeepali

cdeepali commented Jul 6, 2026 •

Copy link
Copy Markdown
Contributor

@shalinib-ibm the generated wheel file is still, pls check.

2026-07-06T10:17:54.9528111Z ============ Final wheel: llama_cpp_scripts-0.0.0+ppc64le1-py3-none-any.whl ===========.

Also there is an error while creating wheel:

2026-07-06T10:19:11.4959340Z ==================== Building wheel ====================
2026-07-06T10:19:11.4960572Z 
2026-07-06T10:19:11.4961181Z * Getting build dependencies for wheel...
2026-07-06T10:19:11.4963261Z ERROR Backend 'poetry.core.masonry.api' is not available.
2026-07-06T10:19:11.4964740Z 
2026-07-06T10:19:11.4965384Z Traceback (most recent call last):
2026-07-06T10:19:11.4968411Z   File "/home/tester/pyvenv_3.11/lib64/python3.11/site-packages/pyproject_hooks/_impl.py", line 402, in _call_hook
2026-07-06T10:19:11.4978681Z     raise BackendUnavailable(
2026-07-06T10:19:11.4981557Z pyproject_hooks._impl.BackendUnavailable: Cannot import 'poetry.core.masonry.api'
2026-07-06T10:19:11.4984530Z 
2026-07-06T10:19:11.4984631Z 
2026-07-06T10:19:11.4986825Z ===> Wheel Creation Failed for Python 3.11 (without isolation)
2026-07-06T10:19:11.4988907Z 
2026-07-06T10:19:11.4989827Z * Creating isolated environment: venv+pip...
2026-07-06T10:19:11.4991784Z * Installing packages in isolated environment:
2026-07-06T10:19:11.4993613Z   - poetry-core>=1.0.0
2026-07-06T10:19:11.4995038Z * Getting build dependencies for wheel...
2026-07-06T10:19:11.4996537Z * Building wheel...
2026-07-06T10:19:11.4998450Z Successfully built llama_cpp_scripts-0.0.0-py3-none-any.whl

@github-actions

Copy link
Copy Markdown

@shalinib-ibm

  **Reminder 1**

  This PR has had **no activity for 20 days**.
  Please respond to keep it active.

Make required changes so that wheel is bult properly with version number and can be installed.
@shalinib-ibm shalinib-ibm changed the title Add release tag as version for llama.cpp build Fix package validation failure with llama.cpp Jul 27, 2026
@shalinib-ibm

Copy link
Copy Markdown
Contributor Author

@cdeepali I have fixed the package validation failure and the generataed wheel file also has build tag information as version number . Can you please take a look now ?

@cdeepali

cdeepali commented Jul 28, 2026 •

Copy link
Copy Markdown
Contributor

@shalinib-ibm The CI adds the ppc64le suffix to the wheel as part of postprocessing. The the wheel file being generated now is:

llama_cpp_python_package-1.0+ppc64le10158ppc64le1-py3-none-manylinux_2_34_ppc64le.whl

Can you skip added ppc64le in the version, because the CI will anyway add it, and then we will get wheel name like:
llama_cpp_python_package-1.0+10158ppc64le1-py3-none-manylinux_2_34_ppc64le.whl

@cdeepali cdeepali closed this Jul 28, 2026
@cdeepali cdeepali reopened this Jul 28, 2026
@shalinib-ibm

Copy link
Copy Markdown
Contributor Author

@shalinib-ibm The CI adds the ppc64le suffix to the wheel as part of postprocessing. The the wheel file being generated now is:

llama_cpp_python_package-1.0+ppc64le10158ppc64le1-py3-none-manylinux_2_34_ppc64le.whl

Can you skip added ppc64le in the version, because the CI will anyway add it, and then we will get wheel name like: llama_cpp_python_package-1.0+10158ppc64le1-py3-none-manylinux_2_34_ppc64le.whl

Thank you @cdeepali for pointing this out. Removed extra ppc64le from the generated .whl name. It now matches. what you have given above.
llama_cpp_python_package-1.0+10158ppc64le1-py3-none-manylinux_2_34_ppc64le.whl

Comment thread l/llama.cpp/llama_cpp_ubi_9.6.sh Outdated
Comment thread l/llama.cpp/llama_cpp_ubi_9.6.sh Outdated
@cdeepali

Copy link
Copy Markdown
Contributor

@shalinib-ibm pls check minor comments wrt the echo statements.

shalinib-ibm and others added 2 commits July 30, 2026 11:37
Co-authored-by: Deepali <70963368+cdeepali@users.noreply.github.com>
Co-authored-by: Deepali <70963368+cdeepali@users.noreply.github.com>
@cdeepali
cdeepali merged commit ecba978 into ppc64le:master Jul 30, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants