For testing purposes I am using SLURM installed in a lenovo laptop running ubuntu 24-04. I am trying this configuration as part of my slurm learning process before using a real HPC facility.
In my trial I want to submit an array of 9 independent processes.
The CPU information of such machine is: Total Logical CPUs: 16 Physical Cores: 12 Threads per Core: 2 ================================= and the slurm script (attached) that I am using contain the sentences :
#SBATCH --job-name=process_pkl #SBATCH --array=1-9 #SBATCH --output=/tmp/process_pkl_%A_%a.out #SBATCH --error=/tmp/process_pkl_%A_%a.err #SBATCH --ntasks=1 #SBATCH --cpus-per-task=1 #SBATCH --mem=2G =================================== but in practice, using htop, only 4 processes are running concurrently, and there are other 12 CPUs without activity. My question is: What am I missing in my setup?
How much RAM does your laptop have? How much have you told slurm it has? How much is needed by the system? Does your task actually need 2GB?
Also your CPU/cores/threads counts don't appear to make sense.
The node/partition info from slurm.conf might help. What does `slurmd -C` say on your laptop?
Cheers,
Luke
-- Luke Sudbery Principal Engineer (HPC and Storage). Architecture, Infrastructure and Systems Advanced Research Computing, IT Services Room 132, Computer Centre G5, Elms Road
Please note I don’t work on Monday.
From: Antonio Rius via slurm-users slurm-users@lists.schedmd.com Sent: 19 February 2025 05:46 To: slurm-users@lists.schedmd.com Subject: [slurm-users] Running SLURM in a laptop
CAUTION: This email originated from outside the organisation. Do not click links or open attachments unless you recognise the sender and know the content is safe.
For testing purposes I am using SLURM installed in a lenovo laptop running ubuntu 24-04. I am trying this configuration as part of my slurm learning process before using a real HPC facility.
In my trial I want to submit an array of 9 independent processes.
The CPU information of such machine is: Total Logical CPUs: 16 Physical Cores: 12 Threads per Core: 2 ================================= and the slurm script (attached) that I am using contain the sentences :
#SBATCH --job-name=process_pkl #SBATCH --array=1-9 #SBATCH --output=/tmp/process_pkl_%A_%a.out #SBATCH --error=/tmp/process_pkl_%A_%a.err #SBATCH --ntasks=1 #SBATCH --cpus-per-task=1 #SBATCH --mem=2G =================================== but in practice, using htop, only 4 processes are running concurrently, and there are other 12 CPUs without activity. My question is: What am I missing in my setup?
On 19.02.2025 14:06, Luke Sudbery via slurm-users wrote:
How much RAM does your laptop have? How much have you told slurm it has? How much is needed by the system? Does your task actually need 2GB?
Also your CPU/cores/threads counts don't appear to make sense.
It's probably one of those newer Intel CPUs, with BIGlittle cores, where only the big cores have hyper threading. It's not possible to represent those CPUs with SLURM, so you'll probably need to turn off hyper threading.
How about using cpusets Create a boot cpusets with the e cores and start slurm in the p cores
Yeah showing my age by talking about cpusets
On Wed, Feb 19, 2025, 6:05 PM Timo Rothenpieler via slurm-users < slurm-users@lists.schedmd.com> wrote:
On 19.02.2025 14:06, Luke Sudbery via slurm-users wrote:
How much RAM does your laptop have? How much have you told slurm it has? How much is needed by the system? Does your task actually need 2GB?
Also your CPU/cores/threads counts don't appear to make sense.
It's probably one of those newer Intel CPUs, with BIGlittle cores, where only the big cores have hyper threading. It's not possible to represent those CPUs with SLURM, so you'll probably need to turn off hyper threading.
-- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-leave@lists.schedmd.com
-
Antonio Rius -
John Hearns -
Luke Sudbery -
Timo Rothenpieler