UCT High Performance Computing Facility
Home        About us       Documentation        Support and Capabilities       Policies        Apply for account

Sun Dec 22 08:30:50 SAST 2024

Users logged in: 01481067 t0087231
Head Node load: 0.37 0.59 0.62 (0.66)     Head Node RAM free: 84%
Currently computing: 14040 hours     Jobs running: 21     Jobs queued: 10
Efficiency: 69%   System overview    System config    Summary    Queue accounting    Graphs

JOBS RUNNING
#    JOBID      PRTTN   NAME                USER      ACCOUNT      STATE      Q\R-TIME CORES NODES  NODES\REASON           QOS     PRIORITY     CPUTIME
-------------------------------------------------------------------------------------------------------------------------------------------------------
1    59081      a100    esg_train           ntnlek001 acsl         RUNNING    21:19:55   8(1)  1    gpu011                 acsl    7926      7-02:39:20
2    58990      a100    r1_GBS_Ib_9RU       rchnic009 vaccine      RUNNING  1-19:48:08   2(1)  1    gpu009                 vaccine 7458      3-15:36:16
3    58987      a100    r1_GBS_Ia_9RU       rchnic009 vaccine      RUNNING  1-19:48:29   2(1)  1    gpu009                 vaccine 7458      3-15:36:58
4    58435      a100    r4_Sf1b_6RU         rchnic009 vaccine      RUNNING  1-20:17:23   2(1)  1    gpu009                 vaccine 7458      3-16:34:46
5    58437      a100    r4_SfY2_6RU         rchnic009 vaccine      RUNNING  1-21:12:21   2(1)  1    gpu009                 vaccine 7458      3-18:24:42
6    58433      a100    r4_Sf1a_6RU         rchnic009 vaccine      RUNNING  1-21:55:55   2(1)  1    gpu010                 vaccine 7458      3-19:51:50
7    58440      a100    r4_Sf4a_6RU         rchnic009 vaccine      RUNNING  1-21:55:55   2(1)  1    gpu010                 vaccine 7458      3-19:51:50
8    59068      a100    r6_Sf1b_6RU         rchnic009 vaccine      PENDING   1-0:31:16   2(1)  1    Dependency             vaccine 7402                
9    59067      a100    r6_Sf1a_6RU         rchnic009 vaccine      PENDING   1-0:32:17   2(1)  1    Dependency             vaccine 7402                
10   59066      a100    r6_Sf4a_6RU         rchnic009 vaccine      PENDING   1-0:34:34   2(1)  1    Dependency             vaccine 7402                
11   59065      a100    r6_SfY2_6RU         rchnic009 vaccine      PENDING   1-0:37:35   2(1)  1    Dependency             vaccine 7402                
12   59013      a100    r2_GBS_Ib_9RU       rchnic009 vaccine      PENDING  1-18:36:16   2(1)  1    Dependency             vaccine 7402                
13   59011      a100    r2_GBS_Ia_9RU       rchnic009 vaccine      PENDING  1-18:38:10   2(1)  1    Dependency             vaccine 7402                
14   58441      a100    r5_Sf4a_6RU         rchnic009 vaccine      PENDING  2-21:30:14   2(1)  1    Dependency             vaccine 7402                
15   58438      a100    r5_SfY2_6RU         rchnic009 vaccine      PENDING  2-21:40:14   2(1)  1    Dependency             vaccine 7402                
16   58436      a100    r5_Sf1b_6RU         rchnic009 vaccine      PENDING  2-21:46:04   2(1)  1    Dependency             vaccine 7402                
17   58434      a100    r5_Sf1a_6RU         rchnic009 vaccine      PENDING  2-21:52:27   2(1)  1    Dependency             vaccine 7402                
18   58371      ada     pions_alpha_055     frdcol002 physics      RUNNING  3-16:19:20   40    1    hpc112                 normal  7561    147-04:53:20
19   58369      ada     pions_alpha_025     frdcol002 physics      RUNNING  3-16:19:53   40    1    hpc111                 normal  7561    147-05:15:20
20   58368      ada     pions_alpha_020     frdcol002 physics      RUNNING  3-16:22:37   40    1    hpc110                 normal  7561    147-07:04:40
21   58980      ada     bash                t0087231  icgeb        RUNNING  1-23:02:55   1     1    hpc100                 normal  7285      1-23:02:55
22   58169      ada     covalent_dockin     chdbha001 h3d          RUNNING  3-21:41:05   1     1    hpc102                 normal  7129      3-21:41:05
23   58153      ada     covalent_dockin     chdbha001 h3d          RUNNING  3-21:46:30   1     1    hpc100                 normal  7129      3-21:46:30
24   59078      ada     NeatSweep-7         hsmsia001 compsci      RUNNING    22:32:26   20    1    hpc102                 normal  6829     18-18:48:40
25   59077      ada     NeatSweep-6         hsmsia001 compsci      RUNNING    22:34:03   20    1    hpc102                 normal  6829     18-19:21:00
26   59076      ada     NeatSweep-5         hsmsia001 compsci      RUNNING    22:35:18   20    1    hpc101                 normal  6829     18-19:46:00
27   59075      ada     NeatSweep-4         hsmsia001 compsci      RUNNING    22:39:47   10    1    hpc101                 normal  6801      9-10:37:50
28   59074      ada     NeatSweep-3         hsmsia001 compsci      RUNNING    22:40:51   10    1    hpc100                 normal  6801      9-10:48:30
29   59073      ada     NeatSweep-2         hsmsia001 compsci      RUNNING    22:42:16   10    1    hpc100                 normal  6801      9-11:02:40
30   59072      ada     NeatSweep-1         hsmsia001 compsci      RUNNING    22:47:15   10    1    hpc100                 normal  6801      9-11:52:30
31   58378      gpumk   r17_GBSII_6RU       01284649  gpumk        RUNNING     7:24:05   32(4) 1    gpu005                 gpumk   7533      9-20:50:40

CLUSTER STATUS
PARTITION AVAIL   NODES  STATE NODELIST
ada*         up       6    mix srvrochpc[100-102,110-112]
ada*         up      10   idle srvrochpc[103-109,113-115]
l40s         up       4   idle srvrocgpu[012-015]
swan         up      15   idle srvrochpc[207,213-226]
sadacc       up       8   idle srvrochpc[228-235]
curie        up       5   idle srvrochpc[602,604-607]
gpumk        up       1  alloc srvrocgpu005
gpumk        up       3   idle srvrocgpu[006-008]
a100         up       3    mix srvrocgpu[009-011]

PartitionName=ada
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=YES QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrochpc[100-115]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=768 TotalNodes=16 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=8000 MaxMemPerCPU=8000
    TRES=cpu=768,mem=6000G,node=16,billing=1368
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=l40s
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrocgpu[012-015]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=192 TotalNodes=4 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=10000 MaxMemPerCPU=10000
    TRES=cpu=192,mem=2000G,node=4,billing=392,gres/gpu=16,gres/gpu:l40s=16
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=swan
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrochpc[207,213-226]
    PriorityJobFactor=30 PriorityTier=30 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=600 TotalNodes=15 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=9000 MaxMemPerCPU=9000
    TRES=cpu=600,mem=5625G,node=15,billing=1162
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=sadacc
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrochpc[228-235]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=352 TotalNodes=8 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=8000 MaxMemPerCPU=8000
    TRES=cpu=352,mem=3000G,node=8,billing=652
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=curie
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrochpc[602,604-607]
    PriorityJobFactor=30 PriorityTier=30 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=320 TotalNodes=5 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=2000 MaxMemPerCPU=2000
    TRES=cpu=320,mem=625G,node=5,billing=382
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=gpumk
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrocgpu[005-008]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=128 TotalNodes=4 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=4000 MaxMemPerCPU=4000
    TRES=cpu=128,mem=500G,node=4,billing=194,gres/gpu=16,gres/gpu:pascal=16
    TRESBillingWeights=CPU=1.0,Mem=0.1G,GRES/gpu=1.0
 
 PartitionName=a100
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrocgpu[009-011]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=168 TotalNodes=3 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=9142 MaxMemPerCPU=9142
    TRES=cpu=168,mem=1500G,node=3,billing=330,gres/gpu=12,gres/gpu:ampere=2,gres/gpu:ampere80=4,gres/gpu:amperemk=6
    TRESBillingWeights=CPU=1.0,Mem=0.1G,GRES/gpu=1.0
 


WORKER NODE STATUS
NodeName=srvrochpc100 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=32 CPUEfctv=48 CPUTot=48 CPULoad=10.35
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc100 NodeHostName=srvrochpc100 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=256000 FreeMem=60707 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:19:48 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=32,mem=250G
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      58980 t0087231 'bash' hpc100   
      58153 chdbha001 'covalent_dockin' hpc100   
      59074 hsmsia001 'NeatSweep-3' hpc100   
      59073 hsmsia001 'NeatSweep-2' hpc100   
      59072 hsmsia001 'NeatSweep-1' hpc100   

NodeName=srvrochpc101 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=30 CPUEfctv=48 CPUTot=48 CPULoad=10.65
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc101 NodeHostName=srvrochpc101 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=240000 FreeMem=215928 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:21:51 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=30,mem=240000M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      59076 hsmsia001 'NeatSweep-5' hpc101   
      59075 hsmsia001 'NeatSweep-4' hpc101   

NodeName=srvrochpc102 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=41 CPUEfctv=48 CPUTot=48 CPULoad=13.23
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc102 NodeHostName=srvrochpc102 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=328000 FreeMem=194154 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:31:42 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=41,mem=328000M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      58169 chdbha001 'covalent_dockin' hpc102   
      59078 hsmsia001 'NeatSweep-7' hpc102   
      59077 hsmsia001 'NeatSweep-6' hpc102   

NodeName=srvrochpc103 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc103 NodeHostName=srvrochpc103 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=110554 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:31:40 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T21:29:58 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc104 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc104 NodeHostName=srvrochpc104 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=138108 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:42:25 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T15:51:41 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc105 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc105 NodeHostName=srvrochpc105 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=195811 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:28:41 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T02:29:56 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc106 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc106 NodeHostName=srvrochpc106 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=135224 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:27:19 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T23:50:09 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc107 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc107 NodeHostName=srvrochpc107 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=150807 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:27:12 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T00:23:50 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc108 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc108 NodeHostName=srvrochpc108 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=200943 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:19:21 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T14:52:49 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc109 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc109 NodeHostName=srvrochpc109 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=181901 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:19:09 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T11:03:53 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc110 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=40 CPUEfctv=48 CPUTot=48 CPULoad=41.07
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc110 NodeHostName=srvrochpc110 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=320000 FreeMem=73985 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:05:25 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=40,mem=312.50G
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      58368 frdcol002 'pions_alpha_020' hpc110   

NodeName=srvrochpc111 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=40 CPUEfctv=48 CPUTot=48 CPULoad=41.23
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc111 NodeHostName=srvrochpc111 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=320000 FreeMem=189360 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:05:01 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=40,mem=312.50G
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      58369 frdcol002 'pions_alpha_025' hpc111   

NodeName=srvrochpc112 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=40 CPUEfctv=48 CPUTot=48 CPULoad=40.54
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc112 NodeHostName=srvrochpc112 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=320000 FreeMem=212991 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:03:49 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=40,mem=312.50G
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      58371 frdcol002 'pions_alpha_055' hpc112   

NodeName=srvrochpc113 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc113 NodeHostName=srvrochpc113 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=289886 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:02:56 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc114 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc114 NodeHostName=srvrochpc114 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=285641 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T13:52:51 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc115 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc115 NodeHostName=srvrochpc115 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=285283 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T13:45:20 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T11:01:48 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc207 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc207 NodeHostName=srvrochpc207 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=379807 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:16:51 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T18:10:02 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc213 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc213 NodeHostName=srvrochpc213 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=377267 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:15:44 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T18:17:49 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc214 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc214 NodeHostName=srvrochpc214 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=375109 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:15:34 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T18:15:24 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc215 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.12
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc215 NodeHostName=srvrochpc215 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=379552 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:15:38 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T17:51:10 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc216 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.10
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc216 NodeHostName=srvrochpc216 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=374294 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:15:38 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T18:00:14 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc217 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.11
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc217 NodeHostName=srvrochpc217 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=375607 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:15:33 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T18:39:30 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc218 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.07
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc218 NodeHostName=srvrochpc218 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=378805 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:15:43 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T18:38:00 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc219 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc219 NodeHostName=srvrochpc219 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=377406 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:15:35 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T18:15:23 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc220 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc220 NodeHostName=srvrochpc220 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=380132 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:15:50 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T18:51:06 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc221 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc221 NodeHostName=srvrochpc221 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=372257 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:15:39 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc222 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc222 NodeHostName=srvrochpc222 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=373658 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:15:36 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc223 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc223 NodeHostName=srvrochpc223 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=379614 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:15:43 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc224 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.05
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc224 NodeHostName=srvrochpc224 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=381083 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-03T15:15:33 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc225 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc225 NodeHostName=srvrochpc225 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=372421 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-10T16:49:39 SlurmdStartTime=2024-12-20T10:30:33
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc226 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc226 NodeHostName=srvrochpc226 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=372278 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-12-10T16:50:07 SlurmdStartTime=2024-12-20T10:30:33
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc228 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc228 NodeHostName=srvrochpc228 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=358940 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2024-12-10T15:19:17 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc229 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.06
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc229 NodeHostName=srvrochpc229 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371921 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2024-12-10T16:46:40 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc230 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc230 NodeHostName=srvrochpc230 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371222 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2024-12-13T14:12:59 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc231 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc231 NodeHostName=srvrochpc231 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371717 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2024-12-04T12:31:36 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc232 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc232 NodeHostName=srvrochpc232 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371784 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2024-12-04T12:32:07 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc233 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc233 NodeHostName=srvrochpc233 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371701 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2024-12-04T12:32:36 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc234 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc234 NodeHostName=srvrochpc234 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371770 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2024-12-04T12:33:10 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc235 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUEfctv=44 CPUTot=44 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc235 NodeHostName=srvrochpc235 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=372262 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc 
   BootTime=2024-12-10T16:47:13 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc602 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=64 CPUTot=64 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc602 NodeHostName=srvrochpc602 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=126305 Sockets=4 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2024-12-03T14:58:56 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc604 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=64 CPUTot=64 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc604 NodeHostName=srvrochpc604 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=126057 Sockets=4 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2024-12-03T14:58:19 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc605 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=64 CPUTot=64 CPULoad=0.09
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc605 NodeHostName=srvrochpc605 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=125966 Sockets=4 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2024-12-03T14:58:02 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc606 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=64 CPUTot=64 CPULoad=0.07
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc606 NodeHostName=srvrochpc606 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=126082 Sockets=4 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2024-12-03T14:57:43 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc607 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=64 CPUTot=64 CPULoad=0.06
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc607 NodeHostName=srvrochpc607 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=125976 Sockets=4 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2024-12-03T15:04:53 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu005 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=32 CPUEfctv=32 CPUTot=32 CPULoad=32.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:pascal:4
   NodeAddr=srvrocgpu005 NodeHostName=srvrocgpu005 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=64000 FreeMem=787 Sockets=2 Boards=1
   State=allocated  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpumk 
   BootTime=2024-12-12T16:20:50 SlurmdStartTime=2024-12-20T10:30:33
   LastBusyTime=2024-12-22T01:06:45 ResumeAfterTime=None
   CfgTRES=cpu=32,mem=125G,billing=48,gres/gpu=4,gres/gpu:pascal=4
   AllocTRES=cpu=32,mem=62.50G,gres/gpu=4,gres/gpu:pascal=4
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      58378 01284649 'r17_GBSII_6RU' gpu005   

NodeName=srvrocgpu006 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=32 CPUTot=32 CPULoad=0.27
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:pascal:4
   NodeAddr=srvrocgpu006 NodeHostName=srvrocgpu006 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=110804 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpumk 
   BootTime=2024-12-12T16:21:15 SlurmdStartTime=2024-12-20T10:30:33
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=32,mem=125G,billing=48,gres/gpu=4,gres/gpu:pascal=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu007 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=32 CPUTot=32 CPULoad=0.26
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:pascal:4
   NodeAddr=srvrocgpu007 NodeHostName=srvrocgpu007 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=108409 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpumk 
   BootTime=2024-12-03T21:08:57 SlurmdStartTime=2024-12-20T10:30:33
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=32,mem=125G,billing=48,gres/gpu=4,gres/gpu:pascal=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu008 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUEfctv=32 CPUTot=32 CPULoad=0.22
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:pascal:4
   NodeAddr=srvrocgpu008 NodeHostName=srvrocgpu008 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=128000 AllocMem=0 FreeMem=44475 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpumk 
   BootTime=2024-12-03T21:09:38 SlurmdStartTime=2024-12-20T10:30:33
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=32,mem=125G,billing=48,gres/gpu=4,gres/gpu:pascal=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu009 Arch=x86_64 CoresPerSocket=28 
   CPUAlloc=8 CPUEfctv=56 CPUTot=56 CPULoad=8.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:amperemk:4
   NodeAddr=srvrocgpu009 NodeHostName=srvrocgpu009 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=512000 AllocMem=20000 FreeMem=370343 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=a100 
   BootTime=2024-12-10T15:09:38 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=56,mem=500G,billing=110,gres/gpu=4,gres/gpu:amperemk=4
   AllocTRES=cpu=8,mem=20000M,gres/gpu=4,gres/gpu:amperemk=4
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      58990 rchnic009 'r1_GBS_Ib_9RU' gpu009   
      58987 rchnic009 'r1_GBS_Ia_9RU' gpu009   
      58435 rchnic009 'r4_Sf1b_6RU' gpu009   
      58437 rchnic009 'r4_SfY2_6RU' gpu009   

NodeName=srvrocgpu010 Arch=x86_64 CoresPerSocket=28 
   CPUAlloc=4 CPUEfctv=56 CPUTot=56 CPULoad=4.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:ampere:2,gpu:amperemk:2
   NodeAddr=srvrocgpu010 NodeHostName=srvrocgpu010 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=512000 AllocMem=10000 FreeMem=192896 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=a100 
   BootTime=2024-12-04T09:08:59 SlurmdStartTime=2024-12-20T10:31:08
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=56,mem=500G,billing=110,gres/gpu=4,gres/gpu:ampere=2,gres/gpu:amperemk=2
   AllocTRES=cpu=4,mem=10000M,gres/gpu=2,gres/gpu:amperemk=2
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      58433 rchnic009 'r4_Sf1a_6RU' gpu010   
      58440 rchnic009 'r4_Sf4a_6RU' gpu010   

NodeName=srvrocgpu011 Arch=x86_64 CoresPerSocket=28 
   CPUAlloc=8 CPUEfctv=56 CPUTot=56 CPULoad=1.10
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:ampere80:4
   NodeAddr=srvrocgpu011 NodeHostName=srvrocgpu011 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=512000 AllocMem=73136 FreeMem=157227 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=a100 
   BootTime=2024-12-13T14:12:08 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-21T10:55:50 ResumeAfterTime=None
   CfgTRES=cpu=56,mem=500G,billing=110,gres/gpu=4,gres/gpu:ampere80=4
   AllocTRES=cpu=8,mem=73136M,gres/gpu=1,gres/gpu:ampere80=1
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      59081 ntnlek001 'esg_train' gpu011   

NodeName=srvrocgpu012 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.33
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu012 NodeHostName=srvrocgpu012 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=512000 AllocMem=0 FreeMem=506255 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2024-12-19T15:02:59 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu013 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.32
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu013 NodeHostName=srvrocgpu013 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=512000 AllocMem=0 FreeMem=497655 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2024-12-03T15:00:44 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu014 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu014 NodeHostName=srvrocgpu014 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=512000 AllocMem=0 FreeMem=498242 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2024-12-03T15:00:31 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu015 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.19
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu015 NodeHostName=srvrocgpu015 Version=23.11.5
   OS=Linux 5.14.0-503.15.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 26 17:24:29 UTC 2024 
   RealMemory=512000 AllocMem=0 FreeMem=487916 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2024-12-03T14:54:02 SlurmdStartTime=2024-12-20T10:30:32
   LastBusyTime=2024-12-20T10:30:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE