Testing PRs to EESSI/software layer by poksumdo · Pull Request #52 · trz42/software-layer

poksumdo · 2023-01-15T11:27:51Z

PR #221 together with PR #141

EESSI_PILOT_VERSION is not available before a script is sourced.

Otherwise there seems to be no other way currently to tell the EESSI install script to build for the generic architecture.

This reverts commit 8415e2e. Reverting because it didn't work.

`install_software_layer.sh` now passes command line arguments to `EESSI-pilot-install-software.sh` (attempt to build stack by bot for architecture `generic`).

Added a 4th parameter. If it is set to "--generic", the variable EESSI_SOFTWARE_SUBDIR_OVERRIDE will be set to EESSI_OS_TYPE/EESSI_CPU_FAMILY/generic.

Otherwise it would not be visible to the .py script determining the target.

Removed unneccessary code (echos etc)

Added command line arguments for setting http(s)_proxy. Added parsing of command line arguments.

Verifying if pypi.org can be accessed.

Started from commit that was patchable and added changes that were made to poksumdo/software-layer/add-Java-11.0.2-generic-nessi.

This reverts commit 4d431fb.

Branch add-Java-11.0.2-nessi-new

…re-layer into test_eessi_software-layer Pulled in recent changes for testing PR 221.

eessi-bot-devel-trz42 · 2023-01-15T11:29:03Z

New job on instance Fram-PR141 for architecture x86_64-generic in job dir /cluster/projects/nn9992k/pilot.nessi/PR62/jobs/2023.01/pr_52/4929993

date	job status	comment
Jan 15 11:29:02 UTC 2023	submitted	job id `4929993` awaits release by job manager
Jan 15 11:29:25 UTC 2023	released	job awaits launch by Slurm scheduler
Jan 15 11:30:26 UTC 2023	running	job 4929993 is running
Jan 15 11:32:32 UTC 2023	finished	😢 FAILURE Found slurm output `slurm-4929993.out` in job dir Slurm output lacks message "No missing modules!". Slurm output lacks message about created tarball. No tarball matching `eessi-software-.tar.gz` found in job dir.

eessi-bot-devel-trz42 · 2023-01-15T11:29:05Z

New job on instance Fram-PR141 for architecture x86_64-intel-broadwell in job dir /cluster/projects/nn9992k/pilot.nessi/PR62/jobs/2023.01/pr_52/4929994

date	job status	comment
Jan 15 11:29:04 UTC 2023	submitted	job id `4929994` awaits release by job manager
Jan 15 11:29:23 UTC 2023	released	job awaits launch by Slurm scheduler
Jan 15 11:30:28 UTC 2023	running	job 4929994 is running
Jan 15 11:31:30 UTC 2023	finished	😢 FAILURE Found slurm output `slurm-4929994.out` in job dir Slurm output lacks message "No missing modules!". Slurm output lacks message about created tarball. No tarball matching `eessi-software-.tar.gz` found in job dir.

trz42 · 2023-01-15T11:47:56Z

Resending event after fixing NESSI vs EESSI setup.

eessi-bot-devel-trz42 · 2023-01-15T11:50:17Z

New job on instance Fram-PR141 for architecture x86_64-generic in job dir /cluster/projects/nn9992k/pilot.nessi/PR62/jobs/2023.01/pr_52/4930001

date	job status	comment
Jan 15 11:50:16 UTC 2023	submitted	job id `4930001` awaits release by job manager
Jan 15 11:50:42 UTC 2023	released	job awaits launch by Slurm scheduler
Jan 15 11:51:47 UTC 2023	running	job 4930001 is running
Jan 15 12:06:19 UTC 2023	finished	😢 FAILURE Found slurm output `slurm-4930001.out` in job dir Slurm output lacks message about created tarball. No tarball matching `eessi-software-.tar.gz` found in job dir.

eessi-bot-devel-trz42 · 2023-01-15T11:50:18Z

New job on instance Fram-PR141 for architecture x86_64-intel-broadwell in job dir /cluster/projects/nn9992k/pilot.nessi/PR62/jobs/2023.01/pr_52/4930002

date	job status	comment
Jan 15 11:50:18 UTC 2023	submitted	job id `4930002` awaits release by job manager
Jan 15 11:50:40 UTC 2023	released	job awaits launch by Slurm scheduler
Jan 15 11:51:49 UTC 2023	running	job 4930002 is running
Jan 15 12:02:15 UTC 2023	finished	😢 FAILURE Found slurm output `slurm-4930002.out` in job dir Slurm output lacks message "No missing modules!". Slurm output lacks message about created tarball. No tarball matching `eessi-software-.tar.gz` found in job dir.

boegel · 2023-01-15T12:34:52Z

@trz42 Not working as expected?

make sure separate cache dirs used for each CPU family

poksumdo added 30 commits June 30, 2022 13:48

Branch to build stack for nessi.uiocloud.no

8e78694

Changed connection mode

a97af5b

DIRECT is the correct value

11563e2

Updated easystack file

272f896

Disabled easystack file check

90c61c1

Added a bit more debug output

2e9874a

Moved determination of software subdir into create_tarball.sh

e66f8d1

Removed one parameter from create_tarball.sh

fb74340

EESSI_PILOT_VERSION is not available before a script is sourced.

Removed additional 'then'

443ec75

Added setting of pilot_version

88c6eb7

Convert '/' to '_' in tgz filename

d8db57a

Separate between software subdir use (dir or tgz)

daaaf66

Add GCC 9.3.0 to repo

1c1efec

artificial change to trigger event

61ab4ff

fake change to trigger new pull_request create event

93828b8

added missing exclamation mark in success message

f37ba72

Addding CaDiCaL 1.3.0 to pilot.nessi

7daf78b

PR for building Java 11.0.2 for generic arch

fe15d07

Added customized startprefix for retaining EASYBUILD_OPTARCH

8415e2e

Otherwise there seems to be no other way currently to tell the EESSI install script to build for the generic architecture.

Revert "Added customized startprefix for retaining EASYBUILD_OPTARCH"

0ce75aa

This reverts commit 8415e2e. Reverting because it didn't work.

Adding handling of arguments

8e3eca6

`install_software_layer.sh` now passes command line arguments to `EESSI-pilot-install-software.sh` (attempt to build stack by bot for architecture `generic`).

Making create_tarball.sh aware of --generic

fa78dae

Added a 4th parameter. If it is set to "--generic", the variable EESSI_SOFTWARE_SUBDIR_OVERRIDE will be set to EESSI_OS_TYPE/EESSI_CPU_FAMILY/generic.

Adding more debug output for software override

e528056

Export override variable

67c154b

Otherwise it would not be visible to the .py script determining the target.

Removing OS_TYPE from orverride variable

ffc6d9e

Put comparison operands in double quotes

9726a3f

Fixing bug in comparison: -le vs -lt

e858cfb

Polished code

57d6587

Removed unneccessary code (echos etc)

Removed debugging output

8f9a8c1

Adding a bit more debug output

0af6437

poksumdo and others added 17 commits August 23, 2022 12:31

More debug output (http*)

5dce8d4

More command line arguments

b4f78b4

Added command line arguments for setting http(s)_proxy. Added parsing of command line arguments.

Added a bit more debug output

6af6fb1

Improved command line parsing

d04bf15

Adding more debug output

602cef6

Verifying if pypi.org can be accessed.

Attempt to fix patch issue with trz42/PR11

beeb927

Started from commit that was patchable and added changes that were made to poksumdo/software-layer/add-Java-11.0.2-generic-nessi.

Improved handling of command line parameters

6090cfe

Fixed order of scripts to set up env vars

4242150

Removed --http(s)-proxy parameters

4bd3af7

Create ebtmp directory explicitly

4d431fb

Last commit was to wrong branch

60246e8

Revert "Create ebtmp directory explicitly"

a8564ad

This reverts commit 4d431fb.

Create $EB_TMPDIR explicitly

527a3bf

Merge pull request trz42#13 from poksumdo/add-Java-11.0.2-nessi-new

4c7dab2

Branch add-Java-11.0.2-nessi-new

Merge remote-tracking branch 'upstream/main' into main

467272a

always exclude '.wh.*' files when creating tarball in overlay

7eba3bf

Merge branch 'fix_create_tarball' of https://github.com/boegel/softwa…

3874c84

…re-layer into test_eessi_software-layer Pulled in recent changes for testing PR 221.

trz42 added the bot:build Instruct bot to build software stack label Jan 15, 2023

Changed nessi to eessi, removed unneeded files

724ffe4

poksumdo closed this Jan 15, 2023

poksumdo deleted the test_eessi_software-layer branch January 15, 2023 20:41

trz42 added a commit that referenced this pull request Mar 16, 2023

Merge pull request #52 from trz42/ensure_separate_cache_dir_per_arch

0e7e1f9

make sure separate cache dirs used for each CPU family

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Testing PRs to EESSI/software layer#52

Testing PRs to EESSI/software layer#52
poksumdo wants to merge 48 commits into
trz42:mainfrom
poksumdo:test_eessi_software-layer

poksumdo commented Jan 15, 2023

Uh oh!

eessi-bot-devel-trz42 Bot commented Jan 15, 2023 •

edited

Loading

Uh oh!

eessi-bot-devel-trz42 Bot commented Jan 15, 2023 •

edited

Loading

Uh oh!

trz42 commented Jan 15, 2023

Uh oh!

eessi-bot-devel-trz42 Bot commented Jan 15, 2023 •

edited

Loading

Uh oh!

eessi-bot-devel-trz42 Bot commented Jan 15, 2023 •

edited

Loading

Uh oh!

boegel commented Jan 15, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

poksumdo commented Jan 15, 2023

Uh oh!

eessi-bot-devel-trz42 Bot commented Jan 15, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Jan 15, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Jan 15, 2023

Uh oh!

eessi-bot-devel-trz42 Bot commented Jan 15, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-devel-trz42 Bot commented Jan 15, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

boegel commented Jan 15, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

eessi-bot-devel-trz42 Bot commented Jan 15, 2023 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Jan 15, 2023 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Jan 15, 2023 •

edited

Loading

eessi-bot-devel-trz42 Bot commented Jan 15, 2023 •

edited

Loading