Skip to content

testing EESSI/bot PR#182 & EESSI/fs PR#146#64

Open
poksumdo wants to merge 183 commits intotrz42:mainfrom
poksumdo:nessi.no-2023.04-OpenBLAS
Open

testing EESSI/bot PR#182 & EESSI/fs PR#146#64
poksumdo wants to merge 183 commits intotrz42:mainfrom
poksumdo:nessi.no-2023.04-OpenBLAS

Conversation

@poksumdo
Copy link
Collaborator

@poksumdo poksumdo commented May 16, 2023

Main purpose of this PR is to test the improved deployment provided through PRs EESSI/eessi-bot-software-layer#182 and EESSI/filesystem-layer#146

trz42 and others added 30 commits February 3, 2023 14:08
@trz42
Merge pull request #3 from trz42/enhancement/bot-build-with-swl-216
89e61c4 
Update NESSI/2022.11-dev branch with bot/build.sh from trz42
@truib
updates to base branch for nessi.no-2022.11-dev
c36412c
@truib
Merge branch 'nessi.no-2022.11-dev' of github-trz:NorESSI/software-la…
f69993f 
…yer into nessi.no-2022.11-dev
@truib
fix issues in eessi_container.sh
78f325e
@truib
fix easystack typo in eessi-2022.11.yml
0ce3e09
@truib
fix RUN_QUIET setting
32aa711
@truib
adding GCC/11.3.0 to NESSI/2022.11
a524d91
@truib
Revert "adding GCC/11.3.0 to NESSI/2022.11"
8e2f09c 
This reverts commit a524d91.
@truib
adding latest EB to NESSI/2022.11
7eb8308
@truib
improvements to resuming job environment
23e773c
@truib
address requested change
d4504c2
@poksumdo
Merge pull request trz42#6 from trz42/enhancement/improvements_to_job…
5d36f45 
…_env

improvements to resuming job environment
@truib
Merge branch 'nessi.no-2022.11-dev' of gh-nessi:NorESSI/software-laye…
5e24563 
…r into nessi.no-2022.11-EasyBuild-4.7.0
@truib
removing unnecessary debug information
f7f7980
@truib
special handling of EB when building for EESSI/2021.12
ad0b377
@trz42
Merge pull request trz42#5 from trz42/nessi.no-2022.11-EasyBuild-4.7.0
2dac8fc 
Add latest EasyBuild release to NESSI/2022.11
Setting EasyBuild version_to 4.7.0 and modifying the YML file format
35d0261
modifying the YML file format
0496c8d
@trz42
Merge pull request trz42#17 from TopRichard/Setting_EasyBuild_version…
bb0ad9f 
…_to_4.7_and_modifying_the_YML_file_format

Setting EasyBuild version to 4.7.0 and modifying the YML file format
CMake-3.20.1-GCCcore-10.3.0 to NESSI/2022.11
3cff9c6
replaced #### with #
e7e4cea
replaced #### with #
999708e
@trz42
Merge pull request trz42#18 from TopRichard/nessi.no-2022.11-CMake-3.…
94e39c6 
…20.1-GCCcore-10.3.0

ADD CMake-3.20.1-GCCcore-10.3.0 to NESSI/2022.11
Add Python-3.9.5-GCCcore-10.3.0-bare.eb to NESSI/2022.11
4c9c3e7
Added back CMake in both EESSI-pilot-install-software.sh and eessi-20…
69151fe 
…22.11.yml + went back to default Python WITHOUT the bare version
Fixed Python version in yml file
9f93226
@trz42
Merge pull request trz42#20 from TopRichard/nessi.no-2022.11-Python-3…
5d5e955 
….9.5-GCCcore-10.3.0

Add Python-3.9.5-GCCcore-10.3.0.eb to NESSI/2022.11
@dajon
Adding Qt5/5.14.1-GCCcore-9.3.0 to NESSI/2022.11
58d28c6
Add OpenMPI/4.1.1 with GCC/10.3.0 to NESSI/2022.11
a9622e2
Add ImageMagick/7.0.11.14 with GCC/10.3.0 to NESSI/2022.11
67df600
trz42 and others added 13 commits May 10, 2023 14:16
@trz42
Merge pull request EESSI#106 from TopRichard/nessi.no-2023.04-Replace…
8774328 
…-Rust/1.52.1-by-Rust/1.60.0

Nessi.no 2023.04 replace Rust/1.52.1 by Rust/1.60.0
@truib
add OpenBLAS/0.3.15 with GCC/10.3.0 to NESSI/2023.04
867392a
@truib
add easyblock file to repo and use it instead of *-from-pr
657b86c
@truib
fix race condition when building OpenBLAS
4a94993 
see spack/spack#35395 and OpenMathLib/OpenBLAS#3899
@truib
ensure patch file name is same as in ec file
0909aac
@truib
try a new patch adding targets to .NOTPARALLEL
397b9e9
@truib
removing patch for OpenBLAS-0.3.15 + using --parallel 1 instead
b07d227
@truib
'parallel: 1' doesn't work as option in easystack file
94df2a2
@truib
trying to put 1 in quotes in easystack file
ea134c2
@truib
reintroducing new patch for OpenBLAS based on OpenBLAS/PR3983
dc11c9a
@truib
Revert "reintroducing new patch for OpenBLAS based on OpenBLAS/PR3983"
35a9e27 
This reverts commit dc11c9a.

patching OpenBLAS didn't work out. So only option to build OpenBLAS seems to be
to run eb with --parallel 1 or parallel: "1"
@truib
clarify comment + cleanup obsolete else branch
13a15fa
@truib
try to use make v4.3 as build dependency for OpenBLAS
3bc684e
@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented May 16, 2023

Instance CitC-commander is configured to build:

  • arch x86_64/generic for repo nessi.no-2022.11
  • arch x86_64/generic for repo nessi.no-2023.04
  • arch x86_64/generic for repo eessi-2023.04
  • arch x86_64/amd/zen2 for repo nessi.no-2022.11
  • arch x86_64/intel/skylake_avx512 for repo nessi.no-2022.11
  • arch x86_64/intel/cascadelake for repo nessi.no-2022.11
  • arch aarch64/generic for repo nessi.no-2022.11
  • arch aarch64/generic for repo nessi.no-2023.04
  • arch aarch64/generic for repo eessi-2023.04

@trz42
Copy link
Owner

trz42 commented May 16, 2023 •
edited by eessi-bot-devel-trz42 bot
Loading

bot: build repo:nessi.no-2023.04 arch:aarch64

  • received bot command build repo:nessi.no-2023.04 arch:aarch64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:aarch64)

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented May 16, 2023 •
edited by trz42
Loading

New job on instance CitC-commander for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/PR182/jobs/2023.05/pr_64/4772

  • job failed (job manager crashed when attempting to update comment because of a bug)
  • the modified easyconfig for OpenBLAS was not pushed, hence it wasn't used ... instead make v4.4 resulted in the build issue
date job status comment
May 16 07:58:16 PM UTC 2023 submitted job id 4772 awaits release by job manager
May 16 08:24:24 PM UTC 2023 released job awaits launch by Slurm scheduler
May 16 08:27:26 PM UTC 2023 running job 4772 is running

@trz42
Copy link
Owner

trz42 commented May 16, 2023 •
edited by eessi-bot-devel-trz42 bot
Loading

bot: build repo:nessi.no-2023.04 arch:aarch64

  • received bot command build repo:nessi.no-2023.04 arch:aarch64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:aarch64)

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented May 16, 2023 •
edited by trz42
Loading

New job on instance CitC-commander for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/PR182/jobs/2023.05/pr_64/4773

  • job was actually successful but bot/check-result.sh didn't produce the HTML blob it still produced the old format
date job status comment
May 16 09:00:16 PM UTC 2023 submitted job id 4773 awaits release by job manager
May 16 09:02:38 PM UTC 2023 released job awaits launch by Slurm scheduler
May 16 09:03:41 PM UTC 2023 running job 4773 is running
May 16 10:44:43 PM UTC 2023 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job4773.result does not exist in job directory or reading it failed.
  • No artefacts were found/reported.

@trz42
Copy link
Owner

trz42 commented May 16, 2023 •
edited by eessi-bot-devel-trz42 bot
Loading

bot: build repo:nessi.no-2023.04 arch:aarch64

  • received bot command build repo:nessi.no-2023.04 arch:aarch64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:aarch64)

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented May 16, 2023 •
edited
Loading

New job on instance CitC-commander for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/PR182/jobs/2023.05/pr_64/4774

date job status comment
May 16 11:18:10 PM UTC 2023 submitted job id 4774 awaits release by job manager
May 16 11:18:51 PM UTC 2023 released job awaits launch by Slurm scheduler
May 16 11:22:54 PM UTC 2023 running job 4774 is running
May 16 11:39:11 PM UTC 2023 finished
😁 SUCCESS (click triangle for detailed information)Details:
    :heavy_check_mark: job
    :heavy_check_mark: no
    :heavy_check_mark: no
    :heavy_check_mark: no
    :heavy_check_mark: found
    :heavy_check_mark: found
Artefacts:
  • eessi-2023.04-software-linux-aarch64-generic-1684280268.tar.gz
    		•

    @trz42
    Copy link
    Owner

    trz42 commented May 16, 2023 •
    edited by eessi-bot-devel-trz42 bot
    Loading

    bot: build repo:nessi.no-2023.04 arch:aarch64

    • received bot command build repo:nessi.no-2023.04 arch:aarch64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:aarch64)

    @eessi-bot-devel-trz42
    Copy link

    eessi-bot-devel-trz42 bot commented May 16, 2023 •
    edited by trz42
    Loading

    New job on instance CitC-commander for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/PR182/jobs/2023.05/pr_64/4775

    date job status comment
    May 16 11:51:54 PM UTC 2023 submitted job id 4775 awaits release by job manager
    May 16 11:52:16 PM UTC 2023 released job awaits launch by Slurm scheduler
    May 16 11:55:19 PM UTC 2023 running job 4775 is running
    May 17 12:11:36 AM UTC 2023 finished
    😁 SUCCESS (click triangle for detailed information)Details:
        :heavy_check_mark: job output file slurm-4775.out
        :heavy_check_mark: no message matching ERROR:
        :heavy_check_mark: no message matching FAILED:
        :heavy_check_mark: no message matching required modules missing:
        :heavy_check_mark: found message(s) matching No missing modules!
        :heavy_check_mark: found message matching tar.gz created!
    Artefacts:
  • eessi-2023.04-software-linux-aarch64-generic-1684282223.tar.gz
    		•
    May 17 12:22:04 AM UTC 2023 uploaded transfer of eessi-2023.04-software-linux-aarch64-generic-1684282223.tar.gz to S3 bucket succeeded
    May 17 01:07:22 AM UTC 2023 uploaded transfer of eessi-2023.04-software-linux-aarch64-generic-1684282223.tar.gz to S3 bucket succeeded
    May 17 02:41:40 AM UTC 2023 staged tarball eessi-2023.04-software-linux-aarch64-generic-1684282223.tar.gz downloaded to S0,
    merge PR https://github.com/trz42/staging/pull/211 for approval
    May 17 02:59:21 AM UTC 2023 staged tarball eessi-2023.04-software-linux-aarch64-generic-1684282223.tar.gz downloaded to S0,
    merge PR https://github.com/trz42/staging/pull/214 for approval

    @trz42 trz42 added bot:deploy Instruct bot to deploy built artefacts to Stratum 0 and removed bot:deploy Instruct bot to deploy built artefacts to Stratum 0 labels May 17, 2023
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

    Reviewers

    No reviews

    Assignees

    No one assigned

    Labels

    bot:deploy Instruct bot to deploy built artefacts to Stratum 0

    Projects

    None yet

    Milestone

    No milestone

    Development

    Successfully merging this pull request may close these issues.

    6 participants

    @poksumdo @trz42 @truib @dajon @terjekv @TopRichard