Reduce conformance test CI time

[jserv]

This limits default architecture set to representative archs (x86_64, arm64, riscv, arm) instead of iterating all ~24. test_min_config is further restricted to x86_64 only by default. Full coverage is preserved via environment variables:

• KCONFIGLIB_OBSESSIVE=1 -- all architectures
• KCONFIGLIB_MIN_CONFIG=1 -- expand test_min_config to representative set

Parametrize test_defconfig, test_min_config, and test_sanity by (arch, srcarch) so pytest reports per-arch timing and supports selective re-runs (e.g. -k "test_defconfig[x86_64]").

Also replace shell("cp ...") with shutil.copyfile() in test_min_config to eliminate shell injection risk from paths with spaces or special characters.

---

Summary by cubic

Cuts conformance test CI time by default by running a small, representative arch set and parametrizing tests for per-arch reporting. Full coverage remains opt-in via env vars.

• Refactors

  • Default arch set: x86_64, arm64, riscv, arm. test_allconfig, test_defconfig, and test_sanity use it by default; set KCONFIGLIB_OBSESSIVE=1 for all architectures.
  • test_min_config runs on x86_64 only by default. Use KCONFIGLIB_MIN_CONFIG=1 (or KCONFIGLIB_OBSESSIVE_MIN_CONFIG=1 / KCONFIGLIB_OBSESSIVE=1) to expand.
  • Parametrized test_defconfig, test_min_config, and test_sanity by (arch, srcarch) for per-arch timing and selective re-runs.

• Bug Fixes

  • Replaced shell("cp ...") with shutil.copyfile() in test_min_config to remove shell injection risk.

^{Written for commit 7087ba1. Summary will update on new commits.}

[cubic-dev-ai]

1 issue found across 1 file

Prompt for AI agents (all issues)

Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="tests/test_conformance.py">

<violation number="1" location="tests/test_conformance.py:371">
P2: `KCONFIGLIB_OBSESSIVE_MIN_CONFIG` is still parsed but no longer affects defconfig collection, so enabling it no longer restores the previous cross-arch coverage. This is a behavior regression for the legacy env flag and silently reduces test coverage.</violation>
</file>

_{Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.}