Skip to content

feat: run the pilot wrapper tests with pixi - #8908

Open
fstagni wants to merge 6 commits into
DIRACGrid:rel-v8r0from
fstagni:pilotwrapper-pixi-rel-v8r0
Open

fstagni wants to merge 6 commits into
DIRACGrid:rel-v8r0from
fstagni:pilotwrapper-pixi-rel-v8r0

Conversation

@fstagni

@fstagni fstagni commented Nov 17, 2026

Copy link
Copy Markdown
Contributor

Part of DIRACGrid/.github#5. Port of #8903 (integration) to rel-v8r0.

The run-time conda environments (setup-miniconda, conda create for python 3.6.9/3.11.4) are replaced by the locked pixi environments:

  • a bare-bones py36 environment (no-default-feature, python only — like the previous conda env that deliberately excluded pip; the shared dependencies require python >= 3.9), solving to python 3.6.15 on conda-forge
  • py311 reuses the default environment
  • the exact python versions are pinned by pixi.lock, refreshed to include py36
  • the INVALID_UTF8_VAR test variable is set inside the pixi-spawned shell: pixi panics on non-UTF-8 env vars (env::var().unwrap() on "\xFF")

Stacked on #8907 (pixi check jobs for rel-v8r0), which is stacked on #8893 (zizmor).

Running the matrix command via an unquoted $COMMAND env var loses the
shell quoting of e.g. -k 'not test_BaseType_Unicode and not
test_nestedStructure': pytest receives the quote characters literally
and treats test_BaseType_Unicode as a missing file path, exiting with
code 4. Use eval "$COMMAND" to re-parse the quoting, keeping the
zizmor template-injection fix intact.
Quoting "$MATRIX_ARGS" passes the whole space-separated KEY=VALUE list
as a single argument, so integration_tests.py's split('=', 1) puts
e.g. 'mariadb:10.6.3 ES_VER=opensearchproject/opensearch:2.1.0' into
MYSQL_VER and docker compose fails with 'invalid reference format'.
Leave $MATRIX_ARGS unquoted so the shell word-splits it into separate
flags, as the original ${{ matrix.ARGS }} expansion did.
The pylint-py27 job was already removed upstream (DIRACGrid#8895); take that
removal to resolve the conflict with the zizmor changes.
Port of DIRACGrid#8900 to rel-v8r0: the check/check-py314 jobs move from the
conda environment (created at run time from environment.yml via
setup-miniconda, including the sed hack to swap python to 3.14) to
locked pixi environments (py311 default + py314, exclude-newer
enforced). pixi.toml mirrors environment.yml (no pydantic, mysqlclient
unpinned, Authlib >=1.0.0a2 - rel-v8r0 has no dirac-common). pixi.lock
is committed (removed from .gitignore, which broke the setup-pixi cache
key on integration - see DIRACGrid#8900).

Also ports DIRACGrid#8904: the pre-commit job runs via pre-commit/action and
pushes auto-fixes with pre-commit-ci/lite-action (hook rev updates come
from Renovate's pre-commit manager, DIRACGrid/.github#8). Python stays
pinned to 3.11 there until the 2023-era pinned hooks are updated.

Stacked on DIRACGrid#8893 (zizmor).
Port of DIRACGrid#8903 to rel-v8r0: the run-time conda environments (created with
setup-miniconda for python 3.6.9/3.11.4) are replaced by the locked pixi
environments from pixi.toml. A bare-bones py36 environment
(no-default-feature, python only - like the previous conda env that
excluded pip) is added for the Python 3.6 leg, solving to python
3.6.15 on conda-forge.

The INVALID_UTF8_VAR test variable is set inside the pixi-spawned shell:
pixi panics on non-UTF-8 env vars (env::var().unwrap() on "\xFF").

Stacked on DIRACGrid#8907 (pixi check jobs for rel-v8r0).

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant