DON'T MERGE {2023.06}[foss/2023b] ~wget v1.21.4~ -> py-cpuinfo v9.0.0 by trz42 · Pull Request #74 · trz42/software-layer

trz42 · 2024-04-23T20:22:55Z

PR to test bot PR 266

We probably want to upload to an S3 bucket too, but not ingest it.

eessi-bot-devel-trz42 · 2024-04-23T20:23:00Z

Instance dev-PR254 is configured to build for:

architectures: x86_64/amd/zen2, aarch64/generic, aarch64/thunderx2
repositories: nessi-2022.11-swl-deb10, nessi-2023.06-swl-deb11, nessi-2023.06-cl, nessi-2023.06-swl-deb10

trz42 · 2024-04-23T20:24:10Z

bot: build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11

eessi-bot-devel-trz42 · 2024-04-23T20:24:13Z

Updates by the bot instance dev-PR254 (click for details)

received bot command build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11 from trz42
- expanded format: build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11
handling command build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11 resulted in:
- submitted job 178223, for details & status see DON'T MERGE {2023.06}[foss/2023b] ~wget v1.21.4~ -> py-cpuinfo v9.0.0 #74 (comment)

eessi-bot-devel-trz42 · 2024-04-23T20:24:18Z

New job on instance dev-PR254 for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.04/pr_74/178223

two bot instances running on the same host didn't work
wait until the other bot instance can be stopped, then repeat test

date	job status	comment
Apr 23 08:24:16 PM UTC 2024	submitted	job id `178223` awaits release by job manager

trz42 · 2024-04-27T10:13:25Z

bot: build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11

eessi-bot-devel-trz42 · 2024-04-27T10:13:28Z

Updates by the bot instance dev-PR254 (click for details)

received bot command build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11 from trz42
- expanded format: build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11
handling command build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11 resulted in:
- submitted job 180043, for details & status see DON'T MERGE {2023.06}[foss/2023b] ~wget v1.21.4~ -> py-cpuinfo v9.0.0 #74 (comment)

eessi-bot-devel-trz42 · 2024-04-27T10:13:33Z

New job on instance dev-PR254 for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.04/pr_74/180043

date	job status	comment
Apr 27 10:13:32 AM UTC 2024	submitted	job id `180043` awaits release by job manager
Apr 27 10:13:57 AM UTC 2024	released	job awaits launch by Slurm scheduler
Apr 27 10:15:00 AM UTC 2024	running	job `180043` is running
Apr 27 10:26:16 AM UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-180043.out` ❌ found message matching `ERROR:` ❌ found message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts Details No artefacts were created or found.
Apr 27 10:26:16 AM UTC 2024	test result	(no tests yet)

trz42 · 2024-04-27T11:00:34Z

bot: build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11

eessi-bot-devel-trz42 · 2024-04-27T11:00:37Z

Updates by the bot instance dev-PR254 (click for details)

received bot command build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11 from trz42
- expanded format: build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11
handling command build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11 resulted in:
- submitted job 180051, for details & status see DON'T MERGE {2023.06}[foss/2023b] ~wget v1.21.4~ -> py-cpuinfo v9.0.0 #74 (comment)

eessi-bot-devel-trz42 · 2024-04-27T11:00:41Z

New job on instance dev-PR254 for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.04/pr_74/180051

failed while trying to load CUDA module ... not sure we need this currently ... error message is

== FAILED: Installation ended unsuccessfully (build directory: /tmp/tmp.ruIZOY8FxX/build/CUDA/12.1.1/system-system): build failed (first 300 chars): Sanity check failed: loading fake module failed: "Module co
mmand '/cvmfs/pilot.nessi.no/versions/2023.06/compat/linux/x86_64/usr/share/Lmod/libexec/lmod python load CUDA/12.1.1' failed with exit code 1; stderr: Lmod has detected the following error:\nYou requested to
 load CUDA  but while the module  (took 5 mins 48 secs)
== Results of the build can be found in the log file(s) /tmp/eb-fmjc5fl_/easybuild-CUDA-12.1.1-20240427.130306.jDvxV.log
ERROR: Build of /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/software/EasyBuild/4.9.1/easybuild/easyconfigs/c/CUDA/CUDA-12.1.1.eb failed (err: 'build failed (first 300 chars): Sanity
check failed: loading fake module failed: "Module command \'/cvmfs/pilot.nessi.no/versions/2023.06/compat/linux/x86_64/usr/share/Lmod/libexec/lmod python load CUDA/12.1.1\' failed with exit code 1; stderr: Lm
od has detected the following error:\\nYou requested to load CUDA  but while the module ')
ESC[31mERROR: CUDA installation failed, please check EasyBuild logs easybuild-zyzdxny9.log...ESC[0m

date	job status	comment
Apr 27 11:00:40 AM UTC 2024	submitted	job id `180051` awaits release by job manager
Apr 27 11:01:23 AM UTC 2024	released	job awaits launch by Slurm scheduler
Apr 27 11:02:26 AM UTC 2024	running	job `180051` is running
Apr 27 11:11:39 AM UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-180051.out` ❌ found message matching `ERROR:` ❌ found message matching `FAILED:` ✅ no message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts Details No artefacts were created or found.
Apr 27 11:11:39 AM UTC 2024	test result	(no tests yet)

trz42 · 2024-04-27T13:29:49Z

Using MODE install for Nvidia argument (instead of all).

bot: build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11

eessi-bot-devel-trz42 · 2024-04-27T13:29:53Z

Updates by the bot instance dev-PR254 (click for details)

received bot command build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11 from trz42
- expanded format: build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11
handling command build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11 resulted in:
- submitted job 180101, for details & status see DON'T MERGE {2023.06}[foss/2023b] ~wget v1.21.4~ -> py-cpuinfo v9.0.0 #74 (comment)

eessi-bot-devel-trz42 · 2024-04-27T13:29:57Z

New job on instance dev-PR254 for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.04/pr_74/180101

date	job status	comment
Apr 27 01:29:56 PM UTC 2024	submitted	job id `180101` awaits release by job manager
Apr 27 01:30:54 PM UTC 2024	released	job awaits launch by Slurm scheduler
Apr 27 01:31:57 PM UTC 2024	running	job `180101` is running
Apr 27 01:41:10 PM UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-180101.out` ❌ found message matching `ERROR:` ❌ found message matching `FAILED:` ✅ no message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts Details No artefacts were created or found.
Apr 27 01:41:10 PM UTC 2024	test result	(no tests yet)

…ections

trz42 · 2024-04-28T07:21:54Z

Rebuild after trying to work around failing sanity check when installing CUDA/12.1.1 under host_injections

bot: build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11

eessi-bot-devel-trz42 · 2024-04-28T07:21:57Z

Updates by the bot instance dev-PR254 (click for details)

received bot command build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11 from trz42
- expanded format: build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11
handling command build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11 resulted in:
- submitted job 180752, for details & status see DON'T MERGE {2023.06}[foss/2023b] ~wget v1.21.4~ -> py-cpuinfo v9.0.0 #74 (comment)

eessi-bot-devel-trz42 · 2024-04-28T07:22:01Z

New job on instance dev-PR254 for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.04/pr_74/180752

date	job status	comment
Apr 28 07:22:00 AM UTC 2024	submitted	job id `180752` awaits release by job manager
Apr 28 07:22:42 AM UTC 2024	released	job awaits launch by Slurm scheduler
Apr 28 07:23:45 AM UTC 2024	running	job `180752` is running
Apr 28 07:32:58 AM UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-180752.out` ❌ found message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts Details No artefacts were created or found.
Apr 28 07:32:58 AM UTC 2024	test result	(no tests yet)

trz42 · 2024-04-28T07:36:44Z

bot: build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11

eessi-bot-devel-trz42 · 2024-04-28T07:36:47Z

Updates by the bot instance dev-PR254 (click for details)

received bot command build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11 from trz42
- expanded format: build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11
handling command build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11 resulted in:
- submitted job 180754, for details & status see DON'T MERGE {2023.06}[foss/2023b] ~wget v1.21.4~ -> py-cpuinfo v9.0.0 #74 (comment)

eessi-bot-devel-trz42 · 2024-04-28T07:36:51Z

New job on instance dev-PR254 for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.04/pr_74/180754

date	job status	comment
Apr 28 07:36:50 AM UTC 2024	submitted	job id `180754` awaits release by job manager
Apr 28 07:37:02 AM UTC 2024	released	job awaits launch by Slurm scheduler
Apr 28 07:38:05 AM UTC 2024	running	job `180754` is running
Apr 28 07:43:13 AM UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-180754.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1714290128.tar.gz` size: 0 MiB (140382 bytes) entries: 40 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `py-cpuinfo/9.0.0-GCCcore-13.2.0.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `py-cpuinfo/9.0.0-GCCcore-13.2.0` other under 2023.06/software/linux/x86_64/amd/zen2 `2023.06/scripts/gpu_support/nvidia/install_cuda_host_injections.sh`
Apr 28 07:43:13 AM UTC 2024	test result	(no tests yet)

trz42 · 2024-04-28T07:48:18Z

Rerun after a bit of polishing (removing temporary SitePackage.lua under host_injections) and after CUDA has been deleted from host_injections (check if it builds if not present)

bot: build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11

eessi-bot-devel-trz42 · 2024-04-28T07:48:20Z

Updates by the bot instance dev-PR254 (click for details)

received bot command build inst:dev-PR254 arch:zen2 repo:nessi-2023.06-swl-deb11 from trz42
- expanded format: build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11
handling command build instance:dev-PR254 architecture:zen2 repository:nessi-2023.06-swl-deb11 resulted in:
- submitted job 180755, for details & status see DON'T MERGE {2023.06}[foss/2023b] ~wget v1.21.4~ -> py-cpuinfo v9.0.0 #74 (comment)

eessi-bot-devel-trz42 · 2024-04-28T07:48:25Z

New job on instance dev-PR254 for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.04/pr_74/180755

date	job status	comment
Apr 28 07:48:23 AM UTC 2024	submitted	job id `180755` awaits release by job manager
Apr 28 07:49:17 AM UTC 2024	released	job awaits launch by Slurm scheduler
Apr 28 07:50:20 AM UTC 2024	running	job `180755` is running
Apr 28 08:00:36 AM UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-180755.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1714291209.tar.gz` size: 0 MiB (137843 bytes) entries: 40 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `py-cpuinfo/9.0.0-GCCcore-13.2.0.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `py-cpuinfo/9.0.0-GCCcore-13.2.0` other under 2023.06/software/linux/x86_64/amd/zen2 `2023.06/scripts/gpu_support/nvidia/install_cuda_host_injections.sh`
Apr 28 08:00:36 AM UTC 2024	test result	(no tests yet)

DON'T MERGE {2023.06}[foss/2023b] wget v1.21.4

cab183d

trz42 added the development label Apr 23, 2024

add py-cpuinfo instead of wget

363890c

trz42 changed the title ~~DON'T MERGE {2023.06}[foss/2023b] wget v1.21.4~~ DON'T MERGE {2023.06}[foss/2023b] ~wget v1.21.4~ -> py-cpuinfo v9.0.0 Apr 27, 2024

only use install MODE for nvidia when building

b87cf83

truib added 2 commits April 28, 2024 09:19

work around failing sanity check while installing CUDA under host_inj…

08a6f0c

…ections

revert mode back to 'all'

a97f89c

fix easystack syntax err

8b23e28

remove temporary SitePackage.lua

718ce0b

trz42 mentioned this pull request Apr 28, 2024

reorganisation of constants and validation of config settings EESSI/eessi-bot-software-layer#266

Merged

2 tasks

Conversation

trz42 commented Apr 23, 2024

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 23, 2024

Uh oh!

trz42 commented Apr 23, 2024

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 23, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 23, 2024 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Apr 27, 2024

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Apr 27, 2024

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 27, 2024 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Apr 27, 2024

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 27, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Apr 28, 2024

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 28, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 28, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Apr 28, 2024

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 28, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 28, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Apr 28, 2024

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 28, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 bot commented Apr 28, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

eessi-bot-devel-trz42 bot commented Apr 23, 2024 •

edited

Loading

eessi-bot-devel-trz42 bot commented Apr 23, 2024 •

edited by trz42

Loading

eessi-bot-devel-trz42 bot commented Apr 27, 2024 •

edited

Loading

eessi-bot-devel-trz42 bot commented Apr 27, 2024 •

edited

Loading

eessi-bot-devel-trz42 bot commented Apr 27, 2024 •

edited

Loading

eessi-bot-devel-trz42 bot commented Apr 27, 2024 •

edited by trz42

Loading

eessi-bot-devel-trz42 bot commented Apr 27, 2024 •

edited

Loading

eessi-bot-devel-trz42 bot commented Apr 27, 2024 •

edited

Loading

eessi-bot-devel-trz42 bot commented Apr 28, 2024 •

edited

Loading

eessi-bot-devel-trz42 bot commented Apr 28, 2024 •

edited

Loading

eessi-bot-devel-trz42 bot commented Apr 28, 2024 •

edited

Loading

eessi-bot-devel-trz42 bot commented Apr 28, 2024 •

edited

Loading

eessi-bot-devel-trz42 bot commented Apr 28, 2024 •

edited

Loading

eessi-bot-devel-trz42 bot commented Apr 28, 2024 •

edited

Loading