You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
it would be great if we could find a way not to have to cd in a different folder (jobqueue scheduler-specific, mostly PBS and SLURM). In an ideal world the /dask-jobqueue volumes would be mounted on the worker images I think but also pbsuser would have the right to write into /dask-jobqueue. Not sure how easy it is to do the second part in docker
if you run sbatch /tmp/test.sh from a folder that does not exist in the worker node (e.g. /dask-jobqueue), the job terminates instantly. Somehow this seems related to the SLURM logging mechanism because if I set -e and -o to a folder that exists on the worker node the job runs fine. Maybe fixable in the docker images of the SLURM slaves.
PBS: we run as pbsuser so we have to cd somewhere where we can write (logs + local dask files). Here we cd into the pbsuser HOME directory. Reminder: you need to be root to write in /dask-jobqueue. Maybe fixable inside docker.
Left-over from #307. From #307 (comment):
/(i.e. nocd). Reason from Rewrite dask-jobqueue with SpecCluster #307 (comment)pbsuserso we have to cd somewhere where we can write (logs + local dask files). Here wecdinto thepbsuserHOME directory. Reminder: you need to be root to write in/dask-jobqueue. Maybe fixable inside docker.