CI Status
Known issues and maintenance notices. Edit status_updates.json in the
analytics repo to update.
info
Windows debug build fixed (proxy DLL link race)
2026-04-01 — jkiviluoto-nv
PR #10684 (remove slang-binaries) exposed a latent link race between slang-proxy (slang.dll) and slang-dispatcher (slang.exe) — both have OUTPUT_NAME slang, causing .ilk and .pdb collisions when Ninja parallelizes the link steps. Fixed by PR #10698 (/INCREMENTAL:NO) and PR #10702 (PDB_NAME slang-proxy). Sccache populate workflow should also recover.
info
Linux GPU persistence mode enabled
2026-03-25 — jkiviluoto-nv
Linux CI runner VMs now enable GPU persistence mode (nvidia-smi -pm 1) at boot. This prevents NVML state corruption that caused intermittent 'Failed to initialize NVML: Unknown Error' during multi-server GPU test runs in Docker containers. Three other CI crash sources were also fixed: Mesa/LLVM removal from container (#10618, #10646), DeviceCache cleanup (#10595), and CountOfIntVal null guard (#10535). See #10596 for full investigation.