CI pipeline (make ci)

One-key full regression: build → suites → image → boot regressions + benchmarks → full LTP → stress loop — unattended, no LLM required · implemented in userspace/ci/ (2026-11-10)
What it is: anyone (or any timer) runs make ci at the repository root for one complete test pass; the daily campaign (daily-stress.sh) drives the same phases in a loop. All artifacts land in run/ci-*.log and userspace/ci/<date>/; a KERNPANIC detected in any phase writes an ALERT and halts the pipeline — the one condition that warrants human intervention.

§1The six phases

#PhaseContentStatus
1Kernel buildPLATFORM=x86_64 make build, producing the bzImagewired
2Suite buildsfio / rt-tests / futex-selftests / fsfuzz, static (x86_64 musl)wired
3Guest imageseeded from the asset store (falls back to repo-native generation; images are not downloadable — reflink-seeded from the standing image store only)wired
4aUbuntu boot regressionscripted-serial boot, 420 s (KVM q35 4G/4CPU, -snapshot); pass = a login / gnome-shell / Ubuntu marker; a KERNPANIC is UBUNTU-REGRESSwired
4bOH boot regressiondual-disk boot (system + userdata), 600 s (KVM q35 2G/2CPU); liveness = "insert SA:" count ≥20; a KERNPANIC is OH-REGRESSwired
4clmbench / Geekbenchasset auto-fetch wired (lmbench downloaded and built, the Geekbench 6 tarball unpacked; build-once, skip-if-present); injection runs + CSV parsing being wired to the test platformPENDING
5Full LTP scanall 1,869 cases, launched detached (setsid), the result row lands on completion (log run/ci-ltp.log)wired
632-class stress loop3-slot QEMU loop (fio / futex / rt-tests / fsfuzz classes; finite pass or the daily loop until stop); verdicts append to rounds.logwired

§2The daily loop (daily-stress.sh)

Drives the same phase order in a loop: bootreg → bench → LTP → the stress loop (until daily-stress.sh stop); each phase logs into userspace/ci/<date>/. fio/cyclictest performance rows are parsed per round. Start: bash userspace/ci/daily-stress.sh start; status: status; stop: stop.

§3Asset-store discipline

  • Location: ~/rux-assets by default (outside git; RUX_ASSETS overrides), split into images / src / bin / logs.
  • Read-mostly: scripts only read; seeding/updating happens only when an asset is missing — existence implies freshness, builds skip when outputs exist.
  • Images are not downloadable: reflink-seeded from the standing image store (/home/william/rux-images); no seed + failed generation raises a loud ASSET-MISSING, never a silent skip.
  • Sources on demand: lmbench downloads and builds from upstream, the Geekbench 6 tarball unpacks into the store — each built once.

§4Usage

make ci                            # one full pass (build→suites→image→bootreg→LTP→finite stress)
bash userspace/ci/daily-stress.sh start   # daily loop mode
bash userspace/ci/daily-stress.sh status  # phase status
bash userspace/ci/stress-fleet.sh log 20  # tail of the stress loop log