Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
106 changes: 106 additions & 0 deletions .github/workflows/nightly.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,106 @@
# SPDX-FileCopyrightText: Copyright 2026 Arm Limited and/or its affiliates <open-source-office@arm.com>
#
# SPDX-License-Identifier: Apache-2.0

name: Nightly

on:
schedule:
- cron: '37 2 * * *'
workflow_dispatch:

permissions:
contents: read

concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true

env:
UV_NO_SYNC: "1"

jobs:
brick-tests:
name: Brick tests (Linux® ARM64, Clang)
runs-on: ubuntu-24.04-arm
timeout-minutes: 360
env:
CC: clang-18
CXX: clang++-18
CMAKE_BUILD_PARALLEL_LEVEL: "4"
COMPUTE_FLOW_HOME: ${{ github.workspace }}/.compute-flow
COMPUTE_FLOW_TEST_MODEL_HOME: /tmp/cf-${{ github.run_id }}-${{ github.run_attempt }}
steps:
- uses: actions/checkout@d23441a48e516b6c34aea4fa41551a30e30af803 # v6.1.0
with:
persist-credentials: false
- uses: astral-sh/setup-uv@68559e99cc807c1eb7e9238fd43a15bba460eec2 # v10.3.3
with:
python-version: "3.12"
- name: Install Linux® system dependencies
run: |
sudo apt-get update
sudo apt-get install -y --no-install-recommends \
build-essential clang-18 lld-18 ninja-build pkg-config python3-dev \
libsndfile1
- name: Install Python dependencies
run: uv sync --locked --no-default-groups --group build --group bricks --group tests
- name: Install bricks
run: |
uv run compute-flow update
uv run compute-flow brick install --all
uv run compute-flow brick list
ln -s "$COMPUTE_FLOW_HOME" "$COMPUTE_FLOW_TEST_MODEL_HOME"
# TODO: Build bricks with the Brick Manager using `compute-flow build native`.
- name: Configure generated brick tests
run: |
uv run cmake -S . -B build \

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add a TODO to say that we should build the bricks with the brick manager?

compute-flow build native

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

-DBUILD_TESTING=ON \
-DCMAKE_BUILD_TYPE=Release
# TODO: Check whether these prebuilt dependency assertions can be removed.
- name: Require prebuilt dependencies
run: |
cache=build/CMakeCache.txt
grep -qx 'COMPUTE_FLOW_USE_PREBUILT_DEPS:BOOL=ON' "$cache"
for dependency in PROTOBUF LITERT EXECUTORCH ONNXRUNTIME MNN SENTENCEPIECE; do

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add a TODO to check whether this part can be removed?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

grep -qx "COMPUTE_FLOW_BUILD_${dependency}_FROM_SOURCE:BOOL=OFF" "$cache"
done
- name: Build generated brick tests
run: uv run cmake --build build --parallel "$CMAKE_BUILD_PARALLEL_LEVEL"
- name: Run generated brick tests
run: |
set -euo pipefail
export PYTHONPATH="$GITHUB_WORKSPACE/build/python${PYTHONPATH:+:$PYTHONPATH}"
# TODO: Discover installed bricks with generated tests automatically.
bricks=(

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add a TODO to discover the available brick rather than manually maintain a list. Otherwise, we require to update this for each new developed brick

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

vad:silero-vad
audio_detection:perch
audio_tool_calling:neu-decide
audio_to_audio:ulunas
stt:moonshine
audio_detection:nemotron3-diarization
stt:parakeet-tdt
stt:nemotron-asr
lm_text:lm-text-generic
monocular_depth_estimation:depth-anything-v3
monocular_depth_estimation:zip-depth
object_detection:yolo
tts:qwen3-tts
# TODO: Enable FLUX once its tests match the public model package;
# flux2_klein_generation_4step_manifest.json is currently missing.
# image_generation:flux2-klein-generation

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can uncomment since now the model is public

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The model is public, but the test definition also references flux2_klein_generation_4step_manifest.json, which is missing from the pinned model package. Enabling FLUX would therefore fail nightly. Let’s address this mismatch separately and enable FLUX once it’s resolved if it's OK with you.

tts:pocket-tts
)
for brick in "${bricks[@]}"; do
brick_path="$(uv run compute-flow brick path "$brick")"
echo "::group::Test $brick"
COMPUTE_FLOW_HOME="$COMPUTE_FLOW_TEST_MODEL_HOME" \
uv run bash "$brick_path/test/run_tests.sh"
echo "::endgroup::"
done
- name: Clean up the short model path
if: always()
run: |
if [ -L "$COMPUTE_FLOW_TEST_MODEL_HOME" ]; then
unlink "$COMPUTE_FLOW_TEST_MODEL_HOME"
fi
Loading