Hi,
Environment: Slurm 23.11.5, Ubuntu Linux 22.04
I'm attempting to setup accounting of job energy data, collected from IPMI (with acct_gather_energy/ipmi) and then written to InfluxDB (with acct_gather_profile/influxdb), using this documentation:
https://slurm.schedmd.com/acct_gather.conf.html This is successfully working for non-energy data. However, no Energy data appears in the InfluxDB. If I switch to using HDF5 instead, there is also no Energy data recorded there. Here's the config being used:
root@erc-hpc-comp06t:/etc/slurm# grep Acct /etc/slurm/slurm.conf
JobAcctGatherFrequency=30
JobAcctGatherType=jobacct_gather/cgroup
AcctGatherEnergyType=acct_gather_energy/ipmi
AcctGatherProfileType=acct_gather_profile/influxdb
root@erc-hpc-comp06t:/etc/slurm# cat acct_gather.conf
# Energy accounting gatherer configuration
EnergyIPMIFrequency=60
EnergyIPMICalcAdjustment=yes
EnergyIPMIUsername=xx
EnergyIPMIPassword=xxxxx
# InfluxDB configuration - record Energy and Task data by default
ProfileInfluxDBDefault=Energy,Task
# Using stunnel to reach InfluxDB over TLS
ProfileInfluxDBHost=localhost:8086
ProfileInfluxDBDatabase=slurmpr_hpc_test
ProfileInfluxDBUser=slurmpr_hpc_test_rw
ProfileInfluxDBPass=xx
ProfileInfluxDBRTPolicy=autogen
The Task data is recorded just fine. And I can see that the IPMI plugin is working:
root@erc-hpc-comp06t:/etc/slurm# scontrol show node erc-hpc-comp06t | grep CurrentWatts
CurrentWatts=85 AveWatts=84
Does anyone have this working? I really hope I'm missing something obvious here!
Thanks,
Xand
--
Xand Meaden | Principal Research Infrastructure Engineer
e-Research | King's College London