UCT High Performance Computing Facility
Home        About us       Documentation        Support and Capabilities       Policies        Apply for account

Sun Jun 1 10:40:26 SAST 2025

Users logged in: brtben004 chwsom002 prktha005 skscla001
Head Node load: 0.23 0.20 0.18 (0.18)     Head Node RAM free: 87%
Currently computing: 6224 hours     Jobs running: 25     Jobs queued: 3
Efficiency: 65%   System overview    System config    Summary    Queue accounting    Graphs

JOBS RUNNING
#    JOBID      PRTTN   NAME                USER      ACCOUNT      STATE      Q\R-TIME CORES NODES  NODES\REASON           QOS        PRIORITY     CPUTIME    RAM
------------------------------------------------------------------------------------------------------------------------------------------------------------------
1    151113     a100    Pn33A_6RU_run2      ctzcar020 vaccine      RUNNING  1-13:26:02   2(1)  1    gpu009                 vaccine    8634      3-02:52:02    5.1G
2    152977     a100    SB_Transform_Model  skscla001 nlpgroup80   RUNNING       49:38   4(1)  1    gpu011                 nlpgroup80 7890         3:18:28    4.5G
3    152938     a100    SB_S2S_Model        skscla001 nlpgroup80   RUNNING    17:33:44   4(1)  1    gpu011                 nlpgroup80 7890      2-22:14:52   17.2G
4    151069     a100    Pn18B_6RU_R6        yrlnic001 vaccine      RUNNING  1-11:20:53   2(1)  1    gpu009                 vaccine    7797      2-22:41:44    5.1G
5    151072     a100    Pn18C_6RU_R6        yrlnic001 vaccine      RUNNING  1-12:16:47   2(1)  1    gpu009                 vaccine    7797      3-00:33:32    5.1G
6    152819     a100    Pn18A_6RU_R5        yrlnic001 a100free     RUNNING     2:12:03   2(1)  1    gpu010                 a100free   7696         4:24:04    5.1G
7    152822     a100    Pn18F_6RU_R4        yrlnic001 a100free     RUNNING  1-18:48:42   2(1)  1    gpu010                 a100free   7665      3-13:37:22    5.1G
8    152971     a100    Pn18C_6RU_R7        yrlnic001 vaccine      PENDING     3:16:58   2(1)  1    Dependency             vaccine    7797                        
9    152968     a100    Pn18B_6RU_R7        yrlnic001 vaccine      PENDING     3:22:00   2(1)  1    Dependency             vaccine    7797                        
10   152973     a100    Pn18F_6RU_R5        yrlnic001 a100free     PENDING     3:09:26   2(1)  1    Dependency             a100free   7696                        
11   152934     ada     snmf-serial         prktha005 biosci       RUNNING    21:36:19   40    1    hpc103                 normal     7467     36-00:12:00   85.1G
12   150974     ada     LCA_Method          mkkjua001 ibms         RUNNING  4-12:18:32   5     1    hpc103                 normal     7361     22-13:32:35    8.6G
13   146059     ada     GPSC205             lrnant004 mcb          RUNNING  5-15:44:51   10    1    hpc102                 normal     7106     56-13:28:20   19.3G
14   152976     ada     pions3              brtben004 physics      RUNNING     2:42:35   40    1    hpc106                 normal     6919      4-12:22:40   95.1G
15   152970     ada     pions2              brtben004 physics      RUNNING     3:17:51   40    1    hpc105                 normal     6919      5-11:53:20   20.5G
16   152969     ada     pions               brtben004 physics      RUNNING     3:18:43   40    1    hpc104                 normal     6919      5-12:28:00   22.6G
17   152939     ada     Nrb_Matsim_Job      mwrowe001 civeng       RUNNING    17:23:29   40    1    hpc101                 normal     6890     28-23:38:40   83.5G
18   152907     ada     chtMulti2PEuler     mzvchr002 civeng       RUNNING  1-18:00:56   1     1    hpc101                 normal     6846      1-18:00:55    1.6G
19   152964     ada     Mn12O12_Co_0001_R5  hffjul001 chemeng      RUNNING    13:57:52   2     1    hpc102                 normal     6686      1-03:55:42    4.8G
20   152963     ada     Mn12O12_Co_0001_R4  hffjul001 chemeng      RUNNING    13:58:44   2     1    hpc101                 normal     6686      1-03:57:26    4.5G
21   152962     ada     Mn12_Co_0001_R5     hffjul001 chemeng      RUNNING    14:00:12   2     1    hpc101                 normal     6686      1-04:00:22    4.6G
22   152961     ada     Mn12_Co_0001­_R4    hffjul001 chemeng      RUNNING    14:01:09   2     1    hpc101                 normal     6686      1-04:02:16        
23   143170     ada     GA_Co38_20OH_v2     rgxyat001 chemeng      RUNNING  6-09:38:20   2     1    hpc100                 normal     6684     12-19:16:38    6.6G
24   143169     ada     GA_Co19_20OH_v1_re  rgxyat001 chemeng      RUNNING  6-10:00:47   2     1    hpc100                 normal     6684     12-20:01:32    8.6G
25   143168     ada     GA_Co19_20OH_v1_re  rgxyat001 chemeng      RUNNING  6-10:03:28   2     1    hpc100                 normal     6684     12-20:06:54    6.3G
26   143167     ada     GA_Co38_20OH_v2     rgxyat001 chemeng      RUNNING  6-11:29:36   2     1    hpc100                 normal     6684     12-22:59:10    6.0G
27   143164     ada     GA_Co19_20OH_v2     rgxyat001 chemeng      RUNNING  6-11:40:53   2     1    hpc100                 normal     6684     12-23:21:44    6.3G
28   143163     ada     GA_Co19_20OH_v2     rgxyat001 chemeng      RUNNING  6-12:12:23   2     1    hpc100                 normal     6684     13-00:24:44    5.9G

CLUSTER STATUS
PARTITION AVAIL   NODES  STATE NODELIST
ada*         up       1   drng srvrochpc100
ada*         up       6    mix srvrochpc[101-106]
ada*         up      34   idle srvrochpc[107-115,200-208,213-226,228-229]
swan         up       6   idle srvrochpc[221-226]
sadacc       up       8   idle srvrochpc[228-235]
curie        up       5   idle srvrochpc[602,604-607]
gpumk        up       4   idle srvrocgpu[005-008]
a100         up       3    mix srvrocgpu[009-011]
l40s         up       4   idle srvrocgpu[012-015]

PartitionName=ada
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=YES QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrochpc[100-115,200-208,213-226,228-229]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=1776 TotalNodes=41 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=8000 MaxMemPerCPU=8000
    TRES=cpu=1776,mem=15375G,node=41,billing=3313
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=swan
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrochpc[221-226]
    PriorityJobFactor=30 PriorityTier=30 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=240 TotalNodes=6 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=8000 MaxMemPerCPU=8000
    TRES=cpu=240,mem=2250G,node=6,billing=465
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=sadacc
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrochpc[228-235]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=352 TotalNodes=8 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=8000 MaxMemPerCPU=8000
    TRES=cpu=352,mem=3000G,node=8,billing=652
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=curie
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrochpc[602,604-607]
    PriorityJobFactor=30 PriorityTier=30 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=320 TotalNodes=5 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=2000 MaxMemPerCPU=2000
    TRES=cpu=320,mem=625G,node=5,billing=382
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=gpumk
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrocgpu[005-008]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=128 TotalNodes=4 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=4000 MaxMemPerCPU=4000
    TRES=cpu=128,mem=500G,node=4,billing=194,gres/gpu=16,gres/gpu:pascal=16
    TRESBillingWeights=CPU=1.0,Mem=0.1G,GRES/gpu=1.0
 
 PartitionName=a100
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrocgpu[009-011]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=168 TotalNodes=3 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=9142 MaxMemPerCPU=9142
    TRES=cpu=168,mem=1500G,node=3,billing=330,gres/gpu=12,gres/gpu:ampere=4,gres/gpu:ampere80=4,gres/gpu:amperemk=4
    TRESBillingWeights=CPU=1.0,Mem=0.1G,GRES/gpu=1.0
 
 PartitionName=l40s
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrocgpu[012-015]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=192 TotalNodes=4 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=10000 MaxMemPerCPU=10000
    TRES=cpu=192,mem=2000G,node=4,billing=392,gres/gpu=16,gres/gpu:l40s=16
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 


WORKER NODE STATUS
NodeName=srvrochpc100 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=12 CPUEfctv=48 CPUTot=48 CPULoad=6.01
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc100 NodeHostName=srvrochpc100 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=96000 FreeMem=98540 Sockets=2 Boards=1
   State=mixed+draining  ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:19:48 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:04 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=12,mem=96000M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   Reason=Update firmware, OS.  [root@2025-05-26T10:47:31]
   CORE USAGE
      143170 rgxyat001 'GA_Co38_20OH_v2' hpc100   
      143169 rgxyat001 'GA_Co19_20OH_v1_repeat' hpc100   
      143168 rgxyat001 'GA_Co19_20OH_v1_repeat' hpc100   
      143167 rgxyat001 'GA_Co38_20OH_v2' hpc100   
      143164 rgxyat001 'GA_Co19_20OH_v2' hpc100   
      143163 rgxyat001 'GA_Co19_20OH_v2' hpc100   

NodeName=srvrochpc101 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=47 CPUEfctv=48 CPUTot=48 CPULoad=6.43
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc101 NodeHostName=srvrochpc101 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=355648 FreeMem=73531 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T12:00:51 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:04 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=47,mem=355648M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      152939 mwrowe001 'Nrb_Matsim_Job' hpc101   
      152907 mzvchr002 'chtMulti2PEuler' hpc101   
      152963 hffjul001 'Mn12O12_Co_0001_R4' hpc101   
      152962 hffjul001 'Mn12_Co_0001_R5' hpc101   

NodeName=srvrochpc102 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=12 CPUEfctv=48 CPUTot=48 CPULoad=4.08
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc102 NodeHostName=srvrochpc102 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=91136 FreeMem=26136 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-02-25T13:23:21 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:04 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=12,mem=89G
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      146059 lrnant004 'GPSC205' hpc102   
      152964 hffjul001 'Mn12O12_Co_0001_R5' hpc102   

NodeName=srvrochpc103 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=45 CPUEfctv=48 CPUTot=48 CPULoad=12.40
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc103 NodeHostName=srvrochpc103 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=360000 FreeMem=22430 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T12:04:10 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:04 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=45,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      152934 prktha005 'snmf-serial' hpc103   
      150974 mkkjua001 'LCA_Method' hpc103   

NodeName=srvrochpc104 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=40 CPUEfctv=48 CPUTot=48 CPULoad=40.82
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc104 NodeHostName=srvrochpc104 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=320000 FreeMem=250510 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T12:07:47 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-06-01T07:10:04 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=40,mem=312.50G
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      152969 brtben004 'pions' hpc104   

NodeName=srvrochpc105 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=40 CPUEfctv=48 CPUTot=48 CPULoad=42.77
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc105 NodeHostName=srvrochpc105 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=320000 FreeMem=148451 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T12:07:50 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-31T11:18:02 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=40,mem=312.50G
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      152970 brtben004 'pions2' hpc105   

NodeName=srvrochpc106 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=40 CPUEfctv=48 CPUTot=48 CPULoad=40.38
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc106 NodeHostName=srvrochpc106 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=320000 FreeMem=114069 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T12:11:18 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-06-01T07:46:48 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=40,mem=312.50G
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      152976 brtben004 'pions3' hpc106   

NodeName=srvrochpc107 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc107 NodeHostName=srvrochpc107 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=258160 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T12:27:23 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-31T03:05:00 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc108 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.03
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc108 NodeHostName=srvrochpc108 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=307416 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T12:14:37 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-30T19:21:41 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc109 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.01
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc109 NodeHostName=srvrochpc109 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=314949 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T12:14:39 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-30T19:25:10 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc110 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc110 NodeHostName=srvrochpc110 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=253328 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:05:25 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-30T19:27:10 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc111 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.01
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc111 NodeHostName=srvrochpc111 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=305301 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T12:37:52 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-31T02:51:50 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc112 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.01
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc112 NodeHostName=srvrochpc112 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=361195 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T12:37:43 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-30T19:58:47 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc113 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc113 NodeHostName=srvrochpc113 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=365529 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:40:51 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-30T19:49:29 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc114 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc114 NodeHostName=srvrochpc114 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=367102 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:40:51 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-30T19:35:10 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc115 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.07
   AvailableFeatures=large
   ActiveFeatures=large
   Gres=(null)
   NodeAddr=srvrochpc115 NodeHostName=srvrochpc115 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=297278 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=10 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:41:02 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-06-01T05:28:52 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc200 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.07
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc200 NodeHostName=srvrochpc200 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=46783 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T13:56:56 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-30T15:03:58 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc201 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.02
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc201 NodeHostName=srvrochpc201 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=370661 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T13:57:20 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-30T08:25:16 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc202 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.02
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc202 NodeHostName=srvrochpc202 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=380286 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T13:56:35 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T18:19:19 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc203 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.05
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc203 NodeHostName=srvrochpc203 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=380433 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T16:06:16 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T17:30:48 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc204 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.02
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc204 NodeHostName=srvrochpc204 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=380656 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T13:57:05 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T18:27:26 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc205 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.02
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc205 NodeHostName=srvrochpc205 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=380942 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:08:55 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T18:27:00 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc206 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.00
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc206 NodeHostName=srvrochpc206 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=380993 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:08:52 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T18:30:09 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc207 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.00
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc207 NodeHostName=srvrochpc207 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381006 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:08:52 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T18:40:07 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc208 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.02
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc208 NodeHostName=srvrochpc208 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=373307 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-13T11:07:41 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T18:16:45 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc213 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.02
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc213 NodeHostName=srvrochpc213 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381014 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:11:10 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T18:28:51 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc214 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.00
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc214 NodeHostName=srvrochpc214 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381010 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:11:07 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T18:29:08 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc215 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.08
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc215 NodeHostName=srvrochpc215 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=374359 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:11:07 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T11:40:42 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc216 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.08
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc216 NodeHostName=srvrochpc216 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=380410 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:11:09 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T11:34:55 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc217 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.12
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc217 NodeHostName=srvrochpc217 Version=23.11.5
   OS=Linux 5.14.0-503.34.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Apr 1 17:56:49 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=329023 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T12:58:37 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T11:53:18 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc218 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.05
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc218 NodeHostName=srvrochpc218 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=375048 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:23:09 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T00:43:44 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc219 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.04
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc219 NodeHostName=srvrochpc219 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381043 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:23:16 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T07:50:41 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc220 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.08
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc220 NodeHostName=srvrochpc220 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=354582 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2025-05-25T14:23:44 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T22:12:47 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc221 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.03
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc221 NodeHostName=srvrochpc221 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=375156 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada,swan 
   BootTime=2025-05-25T14:23:34 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T23:55:02 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc222 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.04
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc222 NodeHostName=srvrochpc222 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=375098 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada,swan 
   BootTime=2025-05-25T14:24:24 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T00:01:36 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc223 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.06
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc223 NodeHostName=srvrochpc223 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=375230 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada,swan 
   BootTime=2025-05-25T14:24:15 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T18:07:00 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc224 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.05
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc224 NodeHostName=srvrochpc224 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=375409 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada,swan 
   BootTime=2025-05-25T14:40:28 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T18:00:37 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc225 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.04
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc225 NodeHostName=srvrochpc225 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381594 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada,swan 
   BootTime=2025-05-25T16:00:47 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc226 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.00
   AvailableFeatures=small
   ActiveFeatures=small
   Gres=(null)
   NodeAddr=srvrochpc226 NodeHostName=srvrochpc226 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381511 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=100 Owner=N/A MCS_label=N/A
   Partitions=ada,swan 
   BootTime=2025-05-25T16:01:03 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc228 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc228 NodeHostName=srvrochpc228 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381652 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=150 Owner=N/A MCS_label=N/A
   Partitions=ada,sadacc 
   BootTime=2025-05-25T16:01:12 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc229 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc229 NodeHostName=srvrochpc229 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381813 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=150 Owner=N/A MCS_label=N/A
   Partitions=ada,sadacc 
   BootTime=2025-05-25T16:03:15 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc230 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.07
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc230 NodeHostName=srvrochpc230 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381748 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=150 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2025-05-25T16:03:15 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc231 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc231 NodeHostName=srvrochpc231 Version=23.11.5
   OS=Linux 5.14.0-503.34.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Apr 1 17:56:49 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=378053 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=150 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2025-05-30T09:55:38 SlurmdStartTime=2025-05-30T11:26:52
   LastBusyTime=2025-05-30T11:40:06 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc232 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc232 NodeHostName=srvrochpc232 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381872 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=150 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2025-05-25T16:03:36 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc233 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc233 NodeHostName=srvrochpc233 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381832 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=150 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2025-05-25T16:03:25 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc234 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc234 NodeHostName=srvrochpc234 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381833 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=150 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2025-05-25T16:03:30 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc235 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc235 NodeHostName=srvrochpc235 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=384000 AllocMem=0 FreeMem=381829 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=150 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2025-05-25T16:04:04 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc602 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=64 CPUTot=64 CPULoad=0.05
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc602 NodeHostName=srvrochpc602 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=124606 Sockets=4 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2025-05-16T12:49:47 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T20:40:42 ResumeAfterTime=None
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc604 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=64 CPUTot=64 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc604 NodeHostName=srvrochpc604 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=124960 Sockets=4 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2025-05-16T12:49:50 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-29T20:27:21 ResumeAfterTime=None
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc605 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=64 CPUTot=64 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc605 NodeHostName=srvrochpc605 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=126812 Sockets=4 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2025-05-16T12:50:05 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc606 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=64 CPUTot=64 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc606 NodeHostName=srvrochpc606 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=126819 Sockets=4 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2025-05-16T12:50:05 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc607 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=64 CPUTot=64 CPULoad=0.07
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc607 NodeHostName=srvrochpc607 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=126770 Sockets=4 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2025-05-16T12:50:09 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu005 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=32 CPUTot=32 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:pascal:4
   NodeAddr=srvrocgpu005 NodeHostName=srvrocgpu005 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=128000 AllocMem=0 FreeMem=107377 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpumk 
   BootTime=2025-05-25T11:09:39 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=32,mem=125G,billing=48,gres/gpu=4,gres/gpu:pascal=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu006 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=32 CPUTot=32 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:pascal:4
   NodeAddr=srvrocgpu006 NodeHostName=srvrocgpu006 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=128000 AllocMem=0 FreeMem=107583 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpumk 
   BootTime=2025-05-25T11:18:03 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=32,mem=125G,billing=48,gres/gpu=4,gres/gpu:pascal=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu007 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=32 CPUTot=32 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:pascal:4
   NodeAddr=srvrocgpu007 NodeHostName=srvrocgpu007 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=128000 AllocMem=0 FreeMem=107554 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpumk 
   BootTime=2025-05-25T11:18:04 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=32,mem=125G,billing=48,gres/gpu=4,gres/gpu:pascal=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu008 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=32 CPUTot=32 CPULoad=0.29
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:pascal:4
   NodeAddr=srvrocgpu008 NodeHostName=srvrocgpu008 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=128000 AllocMem=0 FreeMem=107544 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpumk 
   BootTime=2025-05-25T11:18:06 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=32,mem=125G,billing=48,gres/gpu=4,gres/gpu:pascal=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu009 Arch=x86_64 CoresPerSocket=28 
   CPUAlloc=6 CPUEfctv=56 CPUTot=56 CPULoad=6.14
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:amperemk:4
   NodeAddr=srvrocgpu009 NodeHostName=srvrocgpu009 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=512000 AllocMem=15000 FreeMem=448388 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=a100 
   BootTime=2025-05-25T11:31:25 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:04 ResumeAfterTime=None
   CfgTRES=cpu=56,mem=500G,billing=110,gres/gpu=4,gres/gpu:amperemk=4
   AllocTRES=cpu=6,mem=15000M,gres/gpu=3,gres/gpu:amperemk=3
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      151113 ctzcar020 'Pn33A_6RU_run2' gpu009   
      151069 yrlnic001 'Pn18B_6RU_R6' gpu009   
      151072 yrlnic001 'Pn18C_6RU_R6' gpu009   

NodeName=srvrocgpu010 Arch=x86_64 CoresPerSocket=28 
   CPUAlloc=4 CPUEfctv=56 CPUTot=56 CPULoad=4.31
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:ampere:4
   NodeAddr=srvrocgpu010 NodeHostName=srvrocgpu010 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=512000 AllocMem=10000 FreeMem=474594 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=a100 
   BootTime=2025-05-28T15:45:22 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:04 ResumeAfterTime=None
   CfgTRES=cpu=56,mem=500G,billing=110,gres/gpu=4,gres/gpu:ampere=4
   AllocTRES=cpu=4,mem=10000M,gres/gpu=2,gres/gpu:ampere=2
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      152819 yrlnic001 'Pn18A_6RU_R5' gpu010   
      152822 yrlnic001 'Pn18F_6RU_R4' gpu010   

NodeName=srvrocgpu011 Arch=x86_64 CoresPerSocket=28 
   CPUAlloc=8 CPUEfctv=56 CPUTot=56 CPULoad=2.67
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:ampere80:4
   NodeAddr=srvrocgpu011 NodeHostName=srvrocgpu011 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=512000 AllocMem=73136 FreeMem=269161 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=a100 
   BootTime=2025-05-25T11:09:24 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-31T17:04:46 ResumeAfterTime=None
   CfgTRES=cpu=56,mem=500G,billing=110,gres/gpu=4,gres/gpu:ampere80=4
   AllocTRES=cpu=8,mem=73136M,gres/gpu=2,gres/gpu:ampere80=2
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      152977 skscla001 'SB_Transform_Model' gpu011   
      152938 skscla001 'SB_S2S_Model' gpu011   

NodeName=srvrocgpu012 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.36
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu012 NodeHostName=srvrocgpu012 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=512000 AllocMem=0 FreeMem=385595 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2025-05-25T10:23:30 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-31T20:10:04 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu013 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu013 NodeHostName=srvrocgpu013 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=512000 AllocMem=0 FreeMem=438410 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2025-05-25T10:32:09 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-30T20:02:50 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu014 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.43
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu014 NodeHostName=srvrocgpu014 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=512000 AllocMem=0 FreeMem=487855 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2025-05-25T10:42:22 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu015 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu015 NodeHostName=srvrocgpu015 Version=23.11.5
   OS=Linux 5.14.0-503.40.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Apr 30 17:38:54 UTC 2025 
   RealMemory=512000 AllocMem=0 FreeMem=487853 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2025-05-25T10:42:24 SlurmdStartTime=2025-05-28T17:35:05
   LastBusyTime=2025-05-28T17:35:05 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE