[slurm-users] Slurp for sw builds

[Duane Ellis]

In my case I would like to use a slurm cluster for a sw ci/cd like solution for building sw images

My current scripted full system build  takes 3-5 hours and is done serially we could easily find places where we can choose to build things in parallel hence the idea is to spawn parallel builds on the Linux slurm cluster

example: we have a list of images we iterate over in a for loop to build each thing the steps are: cd somedir then type make or run a shell script in that directory

The last step after the for loop would be wait for all of the child builds to complete

Once all child jobs are done we have a single job that combines or packages all the intermediate images

Really want to use slurm because our FPGA team will have a giant slurm linux cluster for Xilinix FPGA builds and those nodes can do what we need for sw purposes (reusing the existing cluster is a huge win for us)

My question is this:

Can somebody point me to some sw build examples for or using slurm? All I can seem to find is how to install 

I see the srun and sbatch command man pages but no good examples

Bonus would be something that integrates into a gitlab runner example or Jenkins in some way

All I can seem to find is how to install and administer slurm not a how to use slurm


Sent from my iPhone