Skip to content

add build script for tiktoken 0.13.0 - #8332

Merged
cdeepali merged 4 commits into
ppc64le:masterfrom
varshakumarrr:tiktoken_0.13.0
Jul 1, 2026
Merged

cdeepali merged 4 commits into
ppc64le:masterfrom
varshakumarrr:tiktoken_0.13.0

Conversation

@varshakumarrr

@varshakumarrr varshakumarrr commented Jun 29, 2026 •

Copy link
Copy Markdown
Contributor

Checklist

  • Have you checked and followed all the points mention in the CONTRIBUTING.MD
  • Have you validated script on UBI 9 container
  • Did you run the script(s) on fresh container with set -e option enabled and observe success ?
  • Did you have Legal approvals for patch files ?

Signed-off-by: Varsha Kumar <varsha.kumar@ibm.com>
@rcarino5
rcarino5 requested a review from cdeepali June 29, 2026 21:59
@jcho02

jcho02 commented Jun 30, 2026

Copy link
Copy Markdown
Contributor

@cdeepali how do we get the checks to run the 0.13.0.sh file

Comment thread t/tiktoken/build_info.json Outdated
"docker_build": false,
"validate_build_script": true,
"use_non_root_user": false,
"v0.13.0":{

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
"v0.13.0":{
"0.13.0":{

@cdeepali

Copy link
Copy Markdown
Contributor

@jcho02 pls remove v prefix from the version string in build-info.json eg - https://github.com/ppc64le/build-scripts/pull/8332/changes#r3499630849.

Signed-off-by: Varsha Kumar <varsha.kumar@ibm.com>
@jcho02

jcho02 commented Jun 30, 2026

Copy link
Copy Markdown
Contributor

@jcho02 pls remove v prefix from the version string in build-info.json eg - https://github.com/ppc64le/build-scripts/pull/8332/changes#r3499630849.

Done, can we re-do the checks?

@cdeepali

Copy link
Copy Markdown
Contributor

I have restarted the checks.

@cdeepali

cdeepali commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

Recording test results:

2026-06-30T15:51:00.0866292Z Running pytest...
2026-06-30T15:51:01.0197345Z ============================= test session starts ==============================
2026-06-30T15:51:01.0199291Z platform linux -- Python 3.12.13, pytest-9.1.1, pluggy-1.6.0
2026-06-30T15:51:01.0200660Z rootdir: /tmp
2026-06-30T15:51:01.0201460Z plugins: hypothesis-6.155.7
2026-06-30T15:51:01.0202406Z collected 33 items
2026-06-30T15:51:01.0202917Z 
2026-06-30T15:51:01.0203297Z tiktoken_tests/test_encoding.py
2026-06-30T15:51:11.5505995Z .
2026-06-30T15:51:11.5514104Z .
2026-06-30T15:51:11.9698884Z .
2026-06-30T15:51:11.9705964Z .
2026-06-30T15:51:11.9713311Z .
2026-06-30T15:51:11.9719991Z .
2026-06-30T15:51:11.9726730Z .
2026-06-30T15:51:12.0475216Z .
2026-06-30T15:51:12.0985072Z .
2026-06-30T15:51:12.0992115Z .
2026-06-30T15:51:12.1344325Z .
2026-06-30T15:51:12.1813163Z .
2026-06-30T15:51:12.1822052Z .
2026-06-30T15:51:12.1830256Z .
2026-06-30T15:51:13.4606191Z .
2026-06-30T15:51:13.5162025Z .
2026-06-30T15:51:13.5518903Z .
2026-06-30T15:51:13.6230064Z .
2026-06-30T15:51:13.6241814Z .
2026-06-30T15:51:13.6806483Z .
2026-06-30T15:51:13.7357828Z .
2026-06-30T15:51:13.7376464Z .
2026-06-30T15:51:13.7394452Z .
2026-06-30T15:51:14.0136437Z .
2026-06-30T15:51:14.2563346Z .
2026-06-30T15:51:14.2564508Z                 [ 75%]
2026-06-30T15:51:14.2568932Z 
2026-06-30T15:51:14.2569375Z tiktoken_tests/test_misc.py
2026-06-30T15:51:14.2575696Z .
2026-06-30T15:51:14.2885881Z .
2026-06-30T15:51:14.2888885Z                                            [ 81%]
2026-06-30T15:51:14.2889819Z 
2026-06-30T15:51:14.2891860Z tiktoken_tests/test_offsets.py
2026-06-30T15:51:14.6747181Z .
2026-06-30T15:51:14.6753994Z .
2026-06-30T15:51:14.6757942Z                                         [ 87%]
2026-06-30T15:51:14.6758870Z 
2026-06-30T15:51:14.6759434Z tiktoken_tests/test_pickle.py
2026-06-30T15:51:14.7343146Z .
2026-06-30T15:51:14.7346927Z                                           [ 90%]
2026-06-30T15:51:14.7347834Z 
2026-06-30T15:51:14.7348392Z tiktoken_tests/test_simple_public.py
2026-06-30T15:51:14.7935609Z .
2026-06-30T15:51:14.7941475Z .
2026-06-30T15:51:14.8249578Z .
2026-06-30T15:51:14.8250632Z                                  [100%]
2026-06-30T15:51:14.8629194Z 
2026-06-30T15:51:14.8629266Z 
2026-06-30T15:51:14.8629879Z ============================= 33 passed in 14.57s ==============================
2026-06-30T15:51:14.9374251Z ------------------tiktoken:install_and_test_both_success-------------------------
2026-06-30T15:51:14.9376312Z https://github.com/openai/tiktoken.git tiktoken

@cdeepali
cdeepali merged commit ea9a48a into ppc64le:master Jul 1, 2026
8 checks passed
shivansh-ibm pushed a commit to shivansh-ibm/build-scripts that referenced this pull request Jul 14, 2026
* add build script for tiktoken 0.13.0

Signed-off-by: Varsha Kumar <varsha.kumar@ibm.com>

* Changed line 20 to tiktoken_ubi_9.3.sh

Signed-off-by: Varsha Kumar <varsha.kumar@ibm.com>

* Added suggestion in line 13

Signed-off-by: Varsha Kumar <varsha.kumar@ibm.com>

---------

Signed-off-by: Varsha Kumar <varsha.kumar@ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants