Repository navigation
ci: add nightly Linux® brick tests #12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,106 @@ | ||
| # SPDX-FileCopyrightText: Copyright 2026 Arm Limited and/or its affiliates <open-source-office@arm.com> | ||
| # | ||
| # SPDX-License-Identifier: Apache-2.0 | ||
|
|
||
| name: Nightly | ||
|
|
||
| on: | ||
| schedule: | ||
| - cron: '37 2 * * *' | ||
| workflow_dispatch: | ||
|
|
||
| permissions: | ||
| contents: read | ||
|
|
||
| concurrency: | ||
| group: ${{ github.workflow }}-${{ github.ref }} | ||
| cancel-in-progress: true | ||
|
|
||
| env: | ||
| UV_NO_SYNC: "1" | ||
|
|
||
| jobs: | ||
| brick-tests: | ||
| name: Brick tests (Linux® ARM64, Clang) | ||
| runs-on: ubuntu-24.04-arm | ||
| timeout-minutes: 360 | ||
| env: | ||
| CC: clang-18 | ||
| CXX: clang++-18 | ||
| CMAKE_BUILD_PARALLEL_LEVEL: "4" | ||
| COMPUTE_FLOW_HOME: ${{ github.workspace }}/.compute-flow | ||
| COMPUTE_FLOW_TEST_MODEL_HOME: /tmp/cf-${{ github.run_id }}-${{ github.run_attempt }} | ||
| steps: | ||
| - uses: actions/checkout@d23441a48e516b6c34aea4fa41551a30e30af803 # v6.1.0 | ||
| with: | ||
| persist-credentials: false | ||
| - uses: astral-sh/setup-uv@68559e99cc807c1eb7e9238fd43a15bba460eec2 # v10.3.3 | ||
| with: | ||
| python-version: "3.12" | ||
| - name: Install Linux® system dependencies | ||
| run: | | ||
| sudo apt-get update | ||
| sudo apt-get install -y --no-install-recommends \ | ||
| build-essential clang-18 lld-18 ninja-build pkg-config python3-dev \ | ||
| libsndfile1 | ||
| - name: Install Python dependencies | ||
| run: uv sync --locked --no-default-groups --group build --group bricks --group tests | ||
| - name: Install bricks | ||
| run: | | ||
| uv run compute-flow update | ||
| uv run compute-flow brick install --all | ||
| uv run compute-flow brick list | ||
| ln -s "$COMPUTE_FLOW_HOME" "$COMPUTE_FLOW_TEST_MODEL_HOME" | ||
| # TODO: Build bricks with the Brick Manager using `compute-flow build native`. | ||
| - name: Configure generated brick tests | ||
| run: | | ||
| uv run cmake -S . -B build \ | ||
| -DBUILD_TESTING=ON \ | ||
| -DCMAKE_BUILD_TYPE=Release | ||
| # TODO: Check whether these prebuilt dependency assertions can be removed. | ||
| - name: Require prebuilt dependencies | ||
| run: | | ||
| cache=build/CMakeCache.txt | ||
| grep -qx 'COMPUTE_FLOW_USE_PREBUILT_DEPS:BOOL=ON' "$cache" | ||
| for dependency in PROTOBUF LITERT EXECUTORCH ONNXRUNTIME MNN SENTENCEPIECE; do | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. can you add a TODO to check whether this part can be removed?
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| grep -qx "COMPUTE_FLOW_BUILD_${dependency}_FROM_SOURCE:BOOL=OFF" "$cache" | ||
| done | ||
| - name: Build generated brick tests | ||
| run: uv run cmake --build build --parallel "$CMAKE_BUILD_PARALLEL_LEVEL" | ||
| - name: Run generated brick tests | ||
| run: | | ||
| set -euo pipefail | ||
| export PYTHONPATH="$GITHUB_WORKSPACE/build/python${PYTHONPATH:+:$PYTHONPATH}" | ||
| # TODO: Discover installed bricks with generated tests automatically. | ||
| bricks=( | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Add a TODO to discover the available brick rather than manually maintain a list. Otherwise, we require to update this for each new developed brick
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| vad:silero-vad | ||
| audio_detection:perch | ||
| audio_tool_calling:neu-decide | ||
| audio_to_audio:ulunas | ||
| stt:moonshine | ||
| audio_detection:nemotron3-diarization | ||
| stt:parakeet-tdt | ||
| stt:nemotron-asr | ||
| lm_text:lm-text-generic | ||
| monocular_depth_estimation:depth-anything-v3 | ||
| monocular_depth_estimation:zip-depth | ||
| object_detection:yolo | ||
| tts:qwen3-tts | ||
| # TODO: Enable FLUX once its tests match the public model package; | ||
| # flux2_klein_generation_4step_manifest.json is currently missing. | ||
| # image_generation:flux2-klein-generation | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. You can uncomment since now the model is public
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. The model is public, but the test definition also references |
||
| tts:pocket-tts | ||
| ) | ||
| for brick in "${bricks[@]}"; do | ||
| brick_path="$(uv run compute-flow brick path "$brick")" | ||
| echo "::group::Test $brick" | ||
| COMPUTE_FLOW_HOME="$COMPUTE_FLOW_TEST_MODEL_HOME" \ | ||
| uv run bash "$brick_path/test/run_tests.sh" | ||
| echo "::endgroup::" | ||
| done | ||
| - name: Clean up the short model path | ||
| if: always() | ||
| run: | | ||
| if [ -L "$COMPUTE_FLOW_TEST_MODEL_HOME" ]; then | ||
| unlink "$COMPUTE_FLOW_TEST_MODEL_HOME" | ||
| fi | ||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you add a TODO to say that we should build the bricks with the brick manager?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
0feb9fe