-
Notifications
You must be signed in to change notification settings - Fork 69
Cx Organization #1884
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Cx Organization #1884
Changes from 24 commits
Commits
Show all changes
34 commits
Select commit
Hold shift + click to select a range
7765578
wip: workflows and actions refactoring
JuanPedroGHM ee2e39f
wip: we continue
JuanPedroGHM fa49855
fix: need to checkout stuff
JuanPedroGHM 9d3d83b
fix: did not save
JuanPedroGHM b4edb8e
fix: correct actio definition
JuanPedroGHM 6f2058e
fix: typos
JuanPedroGHM 436952b
fix: secret handling in actions
JuanPedroGHM fdedcf3
fix: pre-execution bug for trigger steps
JuanPedroGHM e0e9370
fix: larger single step
JuanPedroGHM 56be9bd
fix: simplified tests
JuanPedroGHM d285420
fix: simplified trigger actions
JuanPedroGHM cee02f7
fix: split pr update action
JuanPedroGHM 4790da2
fix: forgot to checkout individual jobs
JuanPedroGHM 753e328
fix: figuring out how this actually works
JuanPedroGHM e3018c1
fix: removed ready for review
JuanPedroGHM 9fd947b
fix: more test configurations
JuanPedroGHM 3888d94
--amend
JuanPedroGHM 5bc5cd1
fix: uv - no system python
JuanPedroGHM 3dacec8
fix: split python and uv action
JuanPedroGHM f2067d4
fix: addressing review comments
JuanPedroGHM 70b38e1
Merge branch 'main' into cx/workflow_action_refactor
JuanPedroGHM 6d3bd0a
Merge branch 'main' into cx/workflow_action_refactor
JuanPedroGHM f414294
fix: corrected support workflow branch
JuanPedroGHM 46b29a4
Merge branch 'main' into cx/workflow_action_refactor
JuanPedroGHM 864d1f7
fix: review comments
JuanPedroGHM dab9b7e
Apply suggestions from code review
JuanPedroGHM 1462176
Merge branch 'main' into cx/workflow_action_refactor
JuanPedroGHM 00defd4
fix: changed openmpi for mpich for gh tests
JuanPedroGHM 9ba670a
fix: removed empty folder
JuanPedroGHM 31d158f
Merge branch 'main' into cx/workflow_action_refactor
JuanPedroGHM 1b3fb66
fix: missing flaky install
JuanPedroGHM 709cdf2
fix: added flaky tests
JuanPedroGHM 702e1e2
Apply suggestions from code review
JuanPedroGHM f114035
Fix indentation
brownbaerchen File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,80 @@ | ||
| name: GH Tests | ||
| description: "Run quick or full tests with a single configurable action." | ||
| inputs: | ||
| mode: | ||
| description: "Test mode: quick (only serial), medium (1 and 4 ranks), and full (1 to 4)." | ||
| required: false | ||
| default: "full" | ||
| sha: | ||
| description: "Commit SHA to checkout before running tests." | ||
| required: false | ||
| default: "${{ github.sha }}" | ||
| py-version: | ||
| description: "Python version for the test run." | ||
| required: false | ||
| default: "3.14" | ||
| mpi: | ||
| description: "MPI implementation to install." | ||
| required: false | ||
| default: "openmpi" | ||
| install-options: | ||
| description: "Package install target/options for heat." | ||
| required: false | ||
| default: ".[dev]" | ||
| pytorch-version: | ||
| description: "Pinned torch/torchvision/torchaudio versions." | ||
| required: false | ||
| default: "torch==2.11.0 torchvision==0.26.0 torchaudio==2.11.0" | ||
| runs: | ||
| using: "composite" | ||
| steps: | ||
| - name: Setup MPI | ||
| uses: mpi4py/setup-mpi@3969f247e8fceef153418744f9d9ee6fdaeda29f # v1.2.0 | ||
| with: | ||
| mpi: ${{ inputs.mpi }} | ||
| - name: "Set up Python" | ||
| uses: actions/setup-python@v6 | ||
| with: | ||
| python-version: "${{ inputs.py-version }}" | ||
| - name: Install uv and set the Python version | ||
| uses: astral-sh/setup-uv@v7 | ||
|
JuanPedroGHM marked this conversation as resolved.
Outdated
|
||
| with: | ||
| enable-cache: true | ||
| # Installations | ||
| - name: Install heat | ||
| if: ${{ inputs.mode == 'full' || inputs.mode == 'medium' }} | ||
| shell: bash | ||
| env: | ||
| UV_SYSTEM_PYTHON: 1 | ||
| run: | | ||
| uv pip install pytest | ||
| uv pip install ${{ inputs.pytorch-version }} --extra-index-url https://download.pytorch.org/whl/cpu | ||
| uv pip install -e ${{ inputs.install-options }} | ||
| - name: Install quick test dependencies | ||
| if: ${{ inputs.mode == 'quick' }} | ||
| shell: bash | ||
| env: | ||
| UV_SYSTEM_PYTHON: 1 | ||
| run: | | ||
| uv pip install pytest | ||
| uv pip install . | ||
| # Running tests | ||
| - name: Run serial tests | ||
| shell: bash | ||
| run: | | ||
| mpirun -n 1 pytest -vv | ||
| - name: Run tests on 2 ranks | ||
| if: ${{ inputs.mode == 'full'}} | ||
| shell: bash | ||
| run: | | ||
| mpirun -n 2 pytest -vv | ||
| - name: Run tests on 3 ranks | ||
| if: ${{ inputs.mode == 'full'}} | ||
| shell: bash | ||
| run: | | ||
| mpirun -n 3 pytest -vv | ||
| - name: Run tests on 4 ranks | ||
| if: ${{ inputs.mode == 'full' || inputs.mode == 'medium' }} | ||
| shell: bash | ||
| run: | | ||
| mpirun -n 4 pytest -vv | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,45 @@ | ||
| name: Trigger Codebase Benchmarks | ||
| description: "Trigger benchmarks on Codebase for performance testing and analysis." | ||
| inputs: | ||
| branch: | ||
| description: "The branch to trigger benchmarks on. Defaults to 'main'." | ||
| required: false | ||
| default: "main" | ||
| sha: | ||
| description: "The commit SHA to trigger benchmarks on. Defaults to the current commit." | ||
| required: false | ||
| default: "${{ github.sha }}" | ||
| pr_number: | ||
| description: "The pull request number to trigger benchmarks on. Defaults to the current PR number." | ||
| required: false | ||
| default: "" | ||
| author: | ||
| description: "The author of the benchmarks. Defaults to the PR assignee or 'heat_team'." | ||
| required: false | ||
| default: "${{ github.event.pull_request.assignee.login || 'heat_team' }}" | ||
| trigger_token: | ||
| description: "The trigger token used to start the Codebase pipeline." | ||
| required: true | ||
| runs: | ||
| using: "composite" | ||
| steps: | ||
| - name: Trigger benchmarks | ||
| shell: bash | ||
| env: | ||
| AUTHOR: ${{ inputs.author}} | ||
| BRANCH: ${{ inputs.branch }} | ||
| API_TOKEN: ${{ inputs.trigger_token }} | ||
| SHA: ${{ inputs.sha }} | ||
| PR_NUMBER: ${{ inputs.pr_number }} | ||
| run: | | ||
| SHORT_SHA=$(git rev-parse --short $SHA) | ||
| curl -s -X POST \ | ||
| --fail-with-body \ | ||
| -F "token=$API_TOKEN" \ | ||
| -F "ref=pipeline/cb/base" \ | ||
| -F "variables[SHA]=$SHA" \ | ||
| -F "variables[SHORT_SHA]=${SHORT_SHA}" \ | ||
| -F "variables[BRANCH]=$BRANCH" \ | ||
| -F "variables[PR]=$PR_NUMBER" \ | ||
| -F "variables[AUTHOR]=${AUTHOR}" \ | ||
| https://codebase.helmholtz.cloud/api/v4/projects/20697/trigger/pipeline |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,36 @@ | ||
| name: Trigger Codebase Tests | ||
| description: "Trigger tests on Codebase for performance testing and analysis." | ||
| inputs: | ||
| branch: | ||
| description: "The branch to trigger tests on. Defaults to 'main'." | ||
| required: false | ||
| default: "main" | ||
| sha: | ||
| description: "The commit SHA to trigger tests on. Defaults to the current commit." | ||
| required: false | ||
| default: "${{ github.sha }}" | ||
| pr_number: | ||
| description: "The pull request number to trigger tests on. Defaults to the current PR number." | ||
| required: false | ||
| default: "" | ||
| trigger_token: | ||
| description: "The trigger token used to start the Codebase pipeline." | ||
| required: true | ||
| runs: | ||
| using: "composite" | ||
| steps: | ||
| - name: Trigger codebase tests | ||
| shell: bash | ||
| env: | ||
| API_TOKEN: ${{ inputs.trigger_token }} | ||
| BRANCH: ${{ inputs.branch }} | ||
| PR_NUMBER: ${{ inputs.pr_number }} | ||
| run: | | ||
| curl -s -X POST \ | ||
| --fail-with-body \ | ||
| -F "token=$API_TOKEN" \ | ||
| -F "ref=pipeline/ci/base" \ | ||
| -F "variables[BRANCH]=$BRANCH" \ | ||
| -F "variables[PR]=$PR_NUMBER" \ | ||
| -F "variables[SHA]=${{ inputs.sha }}" \ | ||
| https://codebase.helmholtz.cloud/api/v4/projects/20697/trigger/pipeline |
File renamed without changes.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.