Skip to content

add psm2 to filter-deps and rebuild GROMACS#361

Merged
poksumdo merged 3 commits into
NorESSI:nessi.no-2023.06from
trz42:nessi-2023.06-fix-missing-psm2-dependency
May 16, 2024
Merged

add psm2 to filter-deps and rebuild GROMACS#361
poksumdo merged 3 commits into
NorESSI:nessi.no-2023.06from
trz42:nessi-2023.06-fix-missing-psm2-dependency

Conversation

@trz42

@trz42 trz42 commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Needed to fix check for missing installations. PSM2 is shipped in the compat layer, so for the moment it can be filtered from dependencies.

Also rebuilds GROMACS and adds build dependency for scikit...

Also see EESSI#576

@nessi-bot

nessi-bot Bot commented May 15, 2024

Copy link
Copy Markdown

Instance AWS-MC-NESSI is configured to build for:

  • architectures: x86_64/generic, x86_64/intel/skylake_avx512, x86_64/amd/zen2, aarch64/generic
  • repositories: nessi-2023.06-swl-deb11, nessi-2023.06-cl, nessi-2023.06-swl-deb10

@nessi-bot

nessi-bot Bot commented May 15, 2024

Copy link
Copy Markdown

Instance eX3-NESSI is configured to build for:

  • architectures: x86_64/amd/zen2, aarch64/generic
  • repositories: nessi-2023.06-swl-deb10, nessi-2023.06-swl-deb11, nessi-2023.06-cl

@nessi-bot

nessi-bot Bot commented May 15, 2024

Copy link
Copy Markdown

Instance Fram-NESSI is configured to build for:

  • architectures: x86_64/generic, x86_64/intel/broadwell
  • repositories: nessi-2023.06-swl-deb10, nessi-2023.06-swl-deb11, nessi-2023.06-cl

@nessi-bot

nessi-bot Bot commented May 15, 2024

Copy link
Copy Markdown

Instance Saga-NESSI is configured to build for:

  • architectures: x86_64/intel/skylake_avx512, x86_64/intel/broadwell, x86_64/generic
  • repositories: nessi-2023.06-swl-deb10, nessi-2023.06-swl-deb11, nessi-2023.06-cl

@trz42

trz42 commented May 15, 2024

Copy link
Copy Markdown
Collaborator Author

Just run a quick test build. May fail ...

bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance AWS-MC-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance eX3-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Saga-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Fram-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.05/pr_361/10797

date job status comment
May 15 18:12:44 UTC 2024 submitted job id 10797 awaits release by job manager
May 15 18:13:41 UTC 2024 released job awaits launch by Slurm scheduler
May 15 18:14:43 UTC 2024 running job 10797 is running
May 15 18:16:46 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-10797.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
Details
No artefacts were created or found.
May 15 18:16:46 UTC 2024 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite produced failures.
ReFrame Summary
[ FAILED ] Ran 7/7 test case(s) from 7 check(s) (3 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10797.out
❌ found message matching ERROR:
❌ found message matching [\s*FAILED\s*].*Ran .* test case

@trz42 trz42 changed the title add psm2 to filter-deps add psm2 to filter-deps and rebuild GROMACS May 15, 2024
@trz42

trz42 commented May 15, 2024

Copy link
Copy Markdown
Collaborator Author

Rerun after adding rebuilding of GROMACS...

bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance eX3-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance AWS-MC-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Saga-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Fram-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.05/pr_361/10798

date job status comment
May 15 18:26:46 UTC 2024 submitted job id 10798 awaits release by job manager
May 15 18:26:49 UTC 2024 released job awaits launch by Slurm scheduler
May 15 18:27:51 UTC 2024 running job 10798 is running
May 15 19:36:03 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-10798.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1715801622.tar.gzsize: 47 MiB (49843690 bytes)
entries: 980
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
GROMACS/2024.1-foss-2023b.lua
scikit-build-core/0.9.3-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
GROMACS/2024.1-foss-2023b
scikit-build-core/0.9.3-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/amd/zen2
no other files in tarball
May 15 19:36:03 UTC 2024 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite produced failures.
ReFrame Summary
[ FAILED ] Ran 7/7 test case(s) from 7 check(s) (3 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10798.out
❌ found message matching ERROR:
❌ found message matching [\s*FAILED\s*].*Ran .* test case

@trz42

trz42 commented May 15, 2024

Copy link
Copy Markdown
Collaborator Author

Rerun with a specific version of the test suite (v0.2.0)...

bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance AWS-MC-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance eX3-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Fram-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Saga-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited by trz42
Loading

Copy link
Copy Markdown

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.05/pr_361/10800

date job status comment
May 15 21:21:31 UTC 2024 submitted job id 10800 awaits release by job manager
May 15 21:22:16 UTC 2024 released job awaits launch by Slurm scheduler
May 15 21:23:18 UTC 2024 running job 10800 is running
May 15 22:41:38 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-10800.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1715811819.tar.gzsize: 47 MiB (49839315 bytes)
entries: 980
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
GROMACS/2024.1-foss-2023b.lua
scikit-build-core/0.9.3-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
GROMACS/2024.1-foss-2023b
scikit-build-core/0.9.3-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/amd/zen2
no other files in tarball
May 15 22:41:38 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 7/7 test case(s) from 7 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10800.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
May 16 12:25:26 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1715811819.tar.gz to S3 bucket succeeded
May 16 12:48:22 PM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-amd-zen2-1715811819.tar.gz downloaded to Stratum-0
May 16 12:48:40 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/303 to approve ingest
May 16 12:57:17 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-amd-zen2-1715811819.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/303
May 16 01:00:43 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-amd-zen2-1715811819.tar.gz successfully ingested at 2023.06/software/linux/x86_64/amd/zen2/

@trz42

trz42 commented May 15, 2024

Copy link
Copy Markdown
Collaborator Author

bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell
bot: build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake
bot: build inst:eX3-NESSI repo:nessi-2023.06-swl-deb10 arch:aarch64/generic
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic

@nessi-bot

nessi-bot Bot commented May 15, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance AWS-MC-NESSI (click for details)

  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake

  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb10 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb10 architecture:aarch64/generic

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic

  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted

  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb10 architecture:aarch64/generic resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Fram-NESSI (click for details)

  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown

New job on instance Saga-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.05/pr_361/11626092

date job status comment
May 16 07:27:59 AM UTC 2024 submitted job id 11626092 awaits release by job manager
May 16 07:28:55 AM UTC 2024 released job awaits launch by Slurm scheduler
May 16 07:52:58 AM UTC 2024 finished
🤷 UNKNOWN (click triangle for details)
  • Job results file _bot_job11626092.result does not exist in job directory, or parsing it failed.
  • No artefacts were found/reported.
May 16 07:52:58 AM UTC 2024 test result
🤷 UNKNOWN (click triangle for details)
  • Job test file _bot_job11626092.test does not exist in job directory, or parsing it failed.

@trz42

trz42 commented May 16, 2024

Copy link
Copy Markdown
Collaborator Author

Just repeat failed builds for x86_64/generic...

bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb10 arch:x86_64/generic

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance eX3-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb10 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/generic

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance AWS-MC-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb10 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/generic

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/generic resulted in:

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Saga-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb10 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/generic

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Fram-NESSI (click for details)

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb10 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/generic

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb10 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown

New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.05/pr_361/10850

date job status comment
May 16 07:31:45 UTC 2024 submitted job id 10850 awaits release by job manager
May 16 07:32:31 UTC 2024 released job awaits launch by Slurm scheduler
May 16 07:36:36 UTC 2024 running job 10850 is running
May 16 09:01:24 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-10850.out
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1715848560.tar.gzsize: 0 MiB (410625 bytes)
entries: 210
modules under 2023.06/software/linux/x86_64/generic/modules/all
scikit-build-core/0.9.3-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/generic/software
scikit-build-core/0.9.3-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/generic
no other files in tarball
May 16 09:01:24 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 7/7 test case(s) from 7 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10850.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited by trz42
Loading

Copy link
Copy Markdown

New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb10 in job dir /project/def-nessi/SHARED/jobs/2024.05/pr_361/10851

date job status comment
May 16 07:31:49 UTC 2024 submitted job id 10851 awaits release by job manager
May 16 07:32:29 UTC 2024 released job awaits launch by Slurm scheduler
May 16 07:36:34 UTC 2024 running job 10851 is running
May 16 09:24:59 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-10851.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1715849971.tar.gzsize: 44 MiB (47054118 bytes)
entries: 980
modules under 2023.06/software/linux/x86_64/generic/modules/all
GROMACS/2024.1-foss-2023b.lua
scikit-build-core/0.9.3-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/generic/software
GROMACS/2024.1-foss-2023b
scikit-build-core/0.9.3-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/generic
no other files in tarball
May 16 09:24:59 UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 7/7 test case(s) from 7 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-10851.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
May 16 12:25:46 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-generic-1715849971.tar.gz to S3 bucket succeeded
May 16 12:48:25 PM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-generic-1715849971.tar.gz downloaded to Stratum-0
May 16 12:48:44 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/304 to approve ingest
May 16 12:57:20 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-generic-1715849971.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/304
May 16 01:01:34 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-generic-1715849971.tar.gz successfully ingested at 2023.06/software/linux/x86_64/generic/

@trz42

trz42 commented May 16, 2024

Copy link
Copy Markdown
Collaborator Author

Resubmit job after adjusting job parameters (different partition, fewer cores)...

bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance AWS-MC-NESSI (click for details)

  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance eX3-NESSI (click for details)

  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Saga-NESSI (click for details)

  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Fram-NESSI (click for details)

  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown

New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.05/pr_361/5800044

date job status comment
May 16 07:48:37 UTC 2024 submitted job id 5800044 awaits release by job manager
May 16 07:49:01 UTC 2024 released job awaits launch by Slurm scheduler
May 16 11:36:21 UTC 2024 finished
🤷 UNKNOWN (click triangle for details)
  • Job results file _bot_job5800044.result does not exist in job directory, or parsing it failed.
  • No artefacts were found/reported.
May 16 11:36:21 UTC 2024 test result
🤷 UNKNOWN (click triangle for details)
  • Job test file _bot_job5800044.test does not exist in job directory, or parsing it failed.

@trz42

trz42 commented May 16, 2024

Copy link
Copy Markdown
Collaborator Author

Resubmit job after lowering requested resources (20 -> 4 CPU cores)...

bot: build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance AWS-MC-NESSI (click for details)

  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance eX3-NESSI (click for details)

  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Fram-NESSI (click for details)

  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Updates by the bot instance Saga-NESSI (click for details)

  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

@nessi-bot

nessi-bot Bot commented May 16, 2024 •
edited by trz42
Loading

Copy link
Copy Markdown

New job on instance Saga-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.05/pr_361/11626184

date job status comment
May 16 07:53:22 AM UTC 2024 submitted job id 11626184 awaits release by job manager
May 16 07:54:03 AM UTC 2024 released job awaits launch by Slurm scheduler
May 16 07:55:06 AM UTC 2024 running job 11626184 is running
May 16 10:50:27 AM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-11626184.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-broadwell-1715853414.tar.gzsize: 47 MiB (49852334 bytes)
entries: 980
modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all
GROMACS/2024.1-foss-2023b.lua
scikit-build-core/0.9.3-GCCcore-13.2.0.lua
software under 2023.06/software/linux/x86_64/intel/broadwell/software
GROMACS/2024.1-foss-2023b
scikit-build-core/0.9.3-GCCcore-13.2.0
other under 2023.06/software/linux/x86_64/intel/broadwell
no other files in tarball
May 16 10:50:27 AM UTC 2024 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ PASSED ] Ran 7/7 test case(s) from 7 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-11626184.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
May 16 12:25:39 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-broadwell-1715853414.tar.gz to S3 bucket succeeded
May 16 12:48:28 PM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-intel-broadwell-1715853414.tar.gz downloaded to Stratum-0
May 16 12:48:47 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/305 to approve ingest
May 16 12:57:23 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-intel-broadwell-1715853414.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/305
May 16 01:02:20 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-intel-broadwell-1715853414.tar.gz successfully ingested at 2023.06/software/linux/x86_64/intel/broadwell/

@trz42

trz42 commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Collaborator Author

Builds for all architectures succeeded. Deployment needs to be semi-automatic:

  1. Show contents of packages/modules to be replaced (need to show timestamps).
  2. Open a transaction, remove the packages, and publish.
  3. Verify that the packages/modules have been removed.
  4. Proceed with normal ingestion.
  5. Show contents of packages/modules to be replaced (need to show timestamps which should be different from step 1).

Step 1:

BASE_DIR=/cvmfs/pilot.nessi.no/versions/2023.06/software/linux \
ARCHS=() \
ARCHS+=("aarch64/generic") ; \
ARCHS+=("x86_64/generic") ; \
ARCHS+=("x86_64/amd/zen2") ; \
ARCHS+=("x86_64/intel/broadwell") ; \
ARCHS+=("x86_64/intel/skylake_avx512") ; \
for arch in "${ARCHS[@]}"; do \
  ls -l \
    ${BASE_DIR}/${arch}/{software,modules/all}/GROMACS/2024.1* \
    ${BASE_DIR}/${arch}/{software,modules/all}/scikit-build-core/0.9.3* ; \
done
log 
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/modules/all/scikit-build-core/0.9.3*': No such file or directory
-rw-r--r-- 1 cvmfs cvmfs 2430 May  2 11:31  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/modules/all/GROMACS/2024.1-foss-2023b.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x 2 cvmfs cvmfs 4096 May  2 11:29 bin
dr-xr-xr-x 3 cvmfs cvmfs 4096 May  2 11:32 easybuild
dr-xr-xr-x 5 cvmfs cvmfs 4096 May  2 10:02 include
dr-xr-xr-x 4 cvmfs cvmfs 4096 May  2 11:29 lib
lrwxrwxrwx 1 cvmfs cvmfs    3 May  2 11:31 lib64 -> lib
dr-xr-xr-x 5 cvmfs cvmfs 4096 May  2 10:02 share
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/software/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/modules/all/scikit-build-core/0.9.3*': No such file or directory
-rw-rw-r-- 1 cvmfs cvmfs 2429 May  2 09:05  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/modules/all/GROMACS/2024.1-foss-2023b.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x 2 cvmfs cvmfs 4096 May  2 09:04 bin
dr-xr-xr-x 3 cvmfs cvmfs 4096 May  2 09:05 easybuild
dr-xr-xr-x 5 cvmfs cvmfs 4096 May  2 08:31 include
dr-xr-xr-x 4 cvmfs cvmfs 4096 May  2 09:04 lib
lrwxrwxrwx 1 cvmfs cvmfs    3 May  2 09:05 lib64 -> lib
dr-xr-xr-x 5 cvmfs cvmfs 4096 May  2 08:31 share
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/software/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/scikit-build-core/0.9.3*': No such file or directory
-rw-rw-r-- 1 cvmfs cvmfs 2430 May  2 09:05  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/GROMACS/2024.1-foss-2023b.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x 2 cvmfs cvmfs 4096 May  2 09:04 bin
dr-xr-xr-x 3 cvmfs cvmfs 4096 May  2 09:05 easybuild
dr-xr-xr-x 5 cvmfs cvmfs 4096 May  2 08:29 include
dr-xr-xr-x 4 cvmfs cvmfs 4096 May  2 09:04 lib
lrwxrwxrwx 1 cvmfs cvmfs    3 May  2 09:05 lib64 -> lib
dr-xr-xr-x 5 cvmfs cvmfs 4096 May  2 08:29 share
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/software/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/modules/all/scikit-build-core/0.9.3*': No such file or directory
-rw-rw-r-- 1 cvmfs cvmfs 2437 May  2 09:06  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/modules/all/GROMACS/2024.1-foss-2023b.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x 2 cvmfs cvmfs 4096 May  2 09:04 bin
dr-xr-xr-x 3 cvmfs cvmfs 4096 May  2 09:06 easybuild
dr-xr-xr-x 5 cvmfs cvmfs 4096 May  2 08:25 include
dr-xr-xr-x 4 cvmfs cvmfs 4096 May  2 09:04 lib
lrwxrwxrwx 1 cvmfs cvmfs    3 May  2 09:06 lib64 -> lib
dr-xr-xr-x 5 cvmfs cvmfs 4096 May  2 08:25 share
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all/scikit-build-core/0.9.3*': No such file or directory
-rw-rw-r-- 1 cvmfs cvmfs 2442 May  2 09:14  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all/GROMACS/2024.1-foss-2023b.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x 2 cvmfs cvmfs 4096 May  2 09:12 bin
dr-xr-xr-x 3 cvmfs cvmfs 4096 May  2 09:14 easybuild
dr-xr-xr-x 5 cvmfs cvmfs 4096 May  2 08:26 include
dr-xr-xr-x 4 cvmfs cvmfs 4096 May  2 09:12 lib
lrwxrwxrwx 1 cvmfs cvmfs    3 May  2 09:13 lib64 -> lib
dr-xr-xr-x 5 cvmfs cvmfs 4096 May  2 08:26 share

Step 2 (since scikit-build-core/0.9.3 doesn't exist yet we don't remove it):

rm -rf \
  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/modules/all/GROMACS/2024.1-foss-2023b.lua \
  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/GROMACS/2024.1-foss-2023b \
  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/modules/all/GROMACS/2024.1-foss-2023b.lua \
  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/software/GROMACS/2024.1-foss-2023b \
  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/GROMACS/2024.1-foss-2023b.lua \
  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/software/GROMACS/2024.1-foss-2023b \
  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/modules/all/GROMACS/2024.1-foss-2023b.lua \
  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/software/GROMACS/2024.1-foss-2023b \
  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all/GROMACS/2024.1-foss-2023b.lua \
  /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/GROMACS/2024.1-foss-2023b

Step 3 (reuse command from step 1):

log 
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/GROMACS/2024.1*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/modules/all/GROMACS/2024.1*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/modules/all/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/software/GROMACS/2024.1*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/modules/all/GROMACS/2024.1*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/software/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/modules/all/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/software/GROMACS/2024.1*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/GROMACS/2024.1*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/software/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/software/GROMACS/2024.1*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/modules/all/GROMACS/2024.1*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/software/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/modules/all/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/GROMACS/2024.1*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all/GROMACS/2024.1*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/scikit-build-core/0.9.3*': No such file or directory
ls: cannot access '/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all/scikit-build-core/0.9.3*': No such file or directory

Step 4: done as usually

Step 5 (reuse command from step 1):

log 
-rw-r--r--. 1 cvmfs cvmfs 2430 May 16 00:50 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/modules/all/GROMACS/2024.1-foss-2023b.lua
-rw-r--r--. 1 cvmfs cvmfs 2035 May 15 22:48 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/modules/all/scikit-build-core/0.9.3-GCCcore-13.2.0.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x. 2 cvmfs cvmfs 4096 May 16 00:48 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 00:51 easybuild
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 15 23:22 include
dr-xr-xr-x. 4 cvmfs cvmfs 4096 May 16 00:48 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 00:50 lib64 -> lib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 15 23:22 share

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/scikit-build-core/0.9.3-GCCcore-13.2.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 15 22:48 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 15 22:47 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 15 22:48 lib64 -> lib
-rw-rw-r--. 1 cvmfs cvmfs 2429 May 16 08:58 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/modules/all/GROMACS/2024.1-foss-2023b.lua
-rw-rw-r--. 1 cvmfs cvmfs 2034 May 16 07:42 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/modules/all/scikit-build-core/0.9.3-GCCcore-13.2.0.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x. 2 cvmfs cvmfs 4096 May 16 08:57 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 08:59 easybuild
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 16 08:02 include
dr-xr-xr-x. 4 cvmfs cvmfs 4096 May 16 08:57 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 08:58 lib64 -> lib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 16 08:02 share

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/software/scikit-build-core/0.9.3-GCCcore-13.2.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 07:42 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 07:41 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 07:42 lib64 -> lib
-rw-rw-r--. 1 cvmfs cvmfs 2430 May 15 22:22 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/GROMACS/2024.1-foss-2023b.lua
-rw-rw-r--. 1 cvmfs cvmfs 2035 May 15 21:33 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/scikit-build-core/0.9.3-GCCcore-13.2.0.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x. 2 cvmfs cvmfs 4096 May 15 22:21 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 15 22:23 easybuild
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 15 21:47 include
dr-xr-xr-x. 4 cvmfs cvmfs 4096 May 15 22:21 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 15 22:22 lib64 -> lib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 15 21:47 share

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/software/scikit-build-core/0.9.3-GCCcore-13.2.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 15 21:33 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 15 21:32 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 15 21:33 lib64 -> lib
-rw-rw-r--. 1 cvmfs cvmfs 2437 May 16 09:54 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/modules/all/GROMACS/2024.1-foss-2023b.lua
-rw-rw-r--. 1 cvmfs cvmfs 2042 May 16 08:02 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/modules/all/scikit-build-core/0.9.3-GCCcore-13.2.0.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x. 2 cvmfs cvmfs 4096 May 16 09:52 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 09:54 easybuild
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 16 08:30 include
dr-xr-xr-x. 4 cvmfs cvmfs 4096 May 16 09:52 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 09:54 lib64 -> lib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 16 08:30 share

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/software/scikit-build-core/0.9.3-GCCcore-13.2.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 08:03 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 08:01 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 08:02 lib64 -> lib
-rw-rw-r--. 1 cvmfs cvmfs 2442 May 16 01:15 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all/GROMACS/2024.1-foss-2023b.lua
-rw-rw-r--. 1 cvmfs cvmfs 2047 May 16 00:15 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all/scikit-build-core/0.9.3-GCCcore-13.2.0.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x. 2 cvmfs cvmfs 4096 May 16 01:13 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 01:16 easybuild
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 16 00:29 include
dr-xr-xr-x. 4 cvmfs cvmfs 4096 May 16 01:14 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 01:15 lib64 -> lib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 16 00:29 share

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/scikit-build-core/0.9.3-GCCcore-13.2.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 00:16 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 00:14 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 00:15 lib64 -> lib
</details>

@trz42

trz42 commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Collaborator Author

Checklist before starting deployment (setting bot:deploy label):

  • Check if the SPDX license identifier is provided
    • just a rebuild
  • Check whether builds for all required architectures succeed (SUCCESS message + reasonably sized tarball)
  • Check if the PR is up-to-date with the target branch nessi.no-2023.06 in the repository (if not what are the differences)
  • Assess if all requested changes are sound (checking files changed on GitHub.com)
  • Verify that all easyconfig/s being built are included with the EB version used (if not why not)
  • Review changes (if any) needed to get the build(s) succeed (common changes for all architectures, changes for a single architecture, changes because of build environment specifics, etc.)

@trz42

trz42 commented May 16, 2024 •
edited
Loading

Copy link
Copy Markdown
Collaborator Author

Target architectures

  • x86_64-intel-broadwell
  • x86_64-intel-skylake_avx512
  • x86_64-amd-zen2
  • x86_64-generic
  • aarch64-generic

Checklist for deployment/ingestion

  • at least one tarball for each architecture has been uploaded
  • at least one tarball for each architecture has been staged
  • for each staged tarball was a PR for approval/rejection opened
  • for each architecture one and only one tarball has been approved
  • for each architecture one and only one tarball was ingested
  • all tests in the CI have succeeded (rerun failed tests ~ 10 mins after last ingest)
  • has the package become available via CernVM-FS for all architectures ingested (for lmod cache updates pay attention to timestamp of files)
command & log

command

BASE_DIR=/cvmfs/pilot.nessi.no/versions/2023.06/software/linux \
ARCHS=() \
ARCHS+=("aarch64/generic") ; \
ARCHS+=("x86_64/generic") ; \
ARCHS+=("x86_64/amd/zen2") ; \
ARCHS+=("x86_64/intel/broadwell") ; \
ARCHS+=("x86_64/intel/skylake_avx512") ; \
for arch in "${ARCHS[@]}"; do \
  ls -l \
    ${BASE_DIR}/${arch}/{software,modules/all}/GROMACS/2024.1* \
    ${BASE_DIR}/${arch}/{software,modules/all}/scikit-build-core/0.9.3* ; \
done

log

-rw-r--r--. 1 cvmfs cvmfs 2430 May 16 00:50 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/modules/all/GROMACS/2024.1-foss-2023b.lua
-rw-r--r--. 1 cvmfs cvmfs 2035 May 15 22:48 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/modules/all/scikit-build-core/0.9.3-GCCcore-13.2.0.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x. 2 cvmfs cvmfs 4096 May 16 00:48 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 00:51 easybuild
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 15 23:22 include
dr-xr-xr-x. 4 cvmfs cvmfs 4096 May 16 00:48 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 00:50 lib64 -> lib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 15 23:22 share

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/scikit-build-core/0.9.3-GCCcore-13.2.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 15 22:48 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 15 22:47 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 15 22:48 lib64 -> lib
-rw-rw-r--. 1 cvmfs cvmfs 2429 May 16 08:58 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/modules/all/GROMACS/2024.1-foss-2023b.lua
-rw-rw-r--. 1 cvmfs cvmfs 2034 May 16 07:42 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/modules/all/scikit-build-core/0.9.3-GCCcore-13.2.0.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x. 2 cvmfs cvmfs 4096 May 16 08:57 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 08:59 easybuild
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 16 08:02 include
dr-xr-xr-x. 4 cvmfs cvmfs 4096 May 16 08:57 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 08:58 lib64 -> lib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 16 08:02 share

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/generic/software/scikit-build-core/0.9.3-GCCcore-13.2.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 07:42 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 07:41 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 07:42 lib64 -> lib
-rw-rw-r--. 1 cvmfs cvmfs 2430 May 15 22:22 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/GROMACS/2024.1-foss-2023b.lua
-rw-rw-r--. 1 cvmfs cvmfs 2035 May 15 21:33 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/modules/all/scikit-build-core/0.9.3-GCCcore-13.2.0.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x. 2 cvmfs cvmfs 4096 May 15 22:21 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 15 22:23 easybuild
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 15 21:47 include
dr-xr-xr-x. 4 cvmfs cvmfs 4096 May 15 22:21 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 15 22:22 lib64 -> lib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 15 21:47 share

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/amd/zen2/software/scikit-build-core/0.9.3-GCCcore-13.2.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 15 21:33 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 15 21:32 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 15 21:33 lib64 -> lib
-rw-rw-r--. 1 cvmfs cvmfs 2437 May 16 09:54 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/modules/all/GROMACS/2024.1-foss-2023b.lua
-rw-rw-r--. 1 cvmfs cvmfs 2042 May 16 08:02 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/modules/all/scikit-build-core/0.9.3-GCCcore-13.2.0.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x. 2 cvmfs cvmfs 4096 May 16 09:52 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 09:54 easybuild
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 16 08:30 include
dr-xr-xr-x. 4 cvmfs cvmfs 4096 May 16 09:52 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 09:54 lib64 -> lib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 16 08:30 share

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/broadwell/software/scikit-build-core/0.9.3-GCCcore-13.2.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 08:03 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 08:01 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 08:02 lib64 -> lib
-rw-rw-r--. 1 cvmfs cvmfs 2442 May 16 01:15 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all/GROMACS/2024.1-foss-2023b.lua
-rw-rw-r--. 1 cvmfs cvmfs 2047 May 16 00:15 /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all/scikit-build-core/0.9.3-GCCcore-13.2.0.lua

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/GROMACS/2024.1-foss-2023b:
total 23
dr-xr-xr-x. 2 cvmfs cvmfs 4096 May 16 01:13 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 01:16 easybuild
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 16 00:29 include
dr-xr-xr-x. 4 cvmfs cvmfs 4096 May 16 01:14 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 01:15 lib64 -> lib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 May 16 00:29 share

/cvmfs/pilot.nessi.no/versions/2023.06/software/linux/x86_64/intel/skylake_avx512/software/scikit-build-core/0.9.3-GCCcore-13.2.0:
total 10
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 00:16 easybuild
dr-xr-xr-x. 3 cvmfs cvmfs 4096 May 16 00:14 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 May 16 00:15 lib64 -> lib

poksumdo
poksumdo approved these changes May 16, 2024
View reviewed changes

@poksumdo poksumdo left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

@poksumdo poksumdo merged commit bbbea34 into NorESSI:nessi.no-2023.06 May 16, 2024
@trz42 trz42 mentioned this pull request May 16, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@poksumdo poksumdo poksumdo approved these changes

Assignees

No one assigned

Labels

bot:deploy ingested NESSI/2023.06 rebuild sync-with-EESSI

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@trz42 @poksumdo @truib