UCT High Performance Computing Facility
Home        About us       Documentation        Support and Capabilities       Policies        Apply for account

Thu Nov 21 10:29:50 SAST 2024

Users logged in: 01464448 anxtem001 bndlev001 chdbha001 chwsom002 gmdsbo006 hsmsia001 mkkjua001 nvcela001 t0087231 thnthi002 vhrdew002
Head Node load: 0.51 0.46 0.46 (0.47)     Head Node RAM free: 87%
Currently computing: 3086 hours     Jobs running: 131     Jobs queued: 1
Efficiency: 68%   System overview    System config    Summary    Queue accounting    Graphs

JOBS RUNNING
#    JOBID      PRTTN   NAME                USER      ACCOUNT      STATE      Q\R-TIME CORES NODES  NODES\REASON           QOS     PRIORITY     CPUTIME
-------------------------------------------------------------------------------------------------------------------------------------------------------
1    52647      ada     I_v1_comp           chwsom002 humbio       RUNNING     1:42:33   10    1    hpc102                 normal  7426        17:05:30
2    52692      ada     bash                anxtem001 compsci      RUNNING       25:05   1     1    hpc101                 normal  7423         0:25:05
3    52676      ada     bash                nvcela001 compsci      RUNNING       41:56   1     1    hpc101                 normal  7417         0:41:56
4    52667      ada     Opt_A               vhrdew002 chemistry    RUNNING       55:58   10    1    hpc103                 normal  7363         9:19:40
5    52662      ada     Opt_P               vhrdew002 chemistry    RUNNING       58:02   10    1    hpc103                 normal  7363         9:40:20
6    52687      ada     Alignment           thnthi002 pathology    RUNNING       29:27   4     1    hpc103                 normal  7258         1:57:48
7    52660      ada     Alignment           thnthi002 pathology    RUNNING       59:38   4     1    hpc102                 normal  7258         3:58:32
8    52658      ada     Alignment           thnthi002 pathology    RUNNING     1:01:29   4     1    hpc102                 normal  7258         4:05:56
9    52708      ada     checking            thnthi002 pathology    RUNNING        1:03   4     1    hpc102                 normal  7252         0:04:12
10   52706      ada     PPO_Training_Simpl  bndlev001 stats        RUNNING        7:14   10    1    hpc104                 normal  7103         1:12:20
11   52702      ada     PPO_Training_Simpl  bndlev001 stats        RUNNING       13:31   10    1    hpc104                 normal  7103         2:15:10
12   52693      ada     PPO_Training_Simpl  bndlev001 stats        RUNNING       20:28   10    1    hpc103                 normal  7103         3:24:40
13   52704      ada     BA_Seed_214_63d1f7  bnseve001 neuroscience RUNNING       10:07   1     1    hpc101                 normal  6692         0:10:07
14   52700      ada     BA_Seed_213_63d1f7  bnseve001 neuroscience RUNNING       15:15   1     1    hpc101                 normal  6692         0:15:15
15   52695      ada     BA_Seed_212_63d1f7  bnseve001 neuroscience RUNNING       20:22   1     1    hpc101                 normal  6692         0:20:22
16   52694      ada     BA_Seed_211_63d1f7  bnseve001 neuroscience RUNNING       20:25   1     1    hpc100                 normal  6692         0:20:25
17   52691      ada     BA_Seed_210_63d1f7  bnseve001 neuroscience RUNNING       25:33   1     1    hpc102                 normal  6692         0:25:33
18   52684      ada     BA_Seed_207_63d1f7  bnseve001 neuroscience RUNNING       30:43   1     1    hpc100                 normal  6692         0:30:43
19   52685      ada     BA_Seed_208_63d1f7  bnseve001 neuroscience RUNNING       30:43   1     1    hpc100                 normal  6692         0:30:43
20   52686      ada     BA_Seed_209_63d1f7  bnseve001 neuroscience RUNNING       30:43   1     1    hpc101                 normal  6692         0:30:43
21   52680      ada     BA_Seed_205_63d1f7  bnseve001 neuroscience RUNNING       35:51   1     1    hpc100                 normal  6692         0:35:51
22   52681      ada     BA_Seed_206_63d1f7  bnseve001 neuroscience RUNNING       35:51   1     1    hpc101                 normal  6692         0:35:51
23   52678      ada     BA_Seed_203_63d1f7  bnseve001 neuroscience RUNNING       40:59   1     1    hpc102                 normal  6692         0:40:59
24   52679      ada     BA_Seed_204_63d1f7  bnseve001 neuroscience RUNNING       40:59   1     1    hpc102                 normal  6692         0:40:59
25   52674      ada     BA_Seed_202_63d1f7  bnseve001 neuroscience RUNNING       46:07   1     1    hpc102                 normal  6692         0:46:07
26   52669      ada     BAUCB_Seed_399_223  bnseve001 neuroscience RUNNING       51:15   1     1    hpc101                 normal  6692         0:51:15
27   52670      ada     BAUCB_Seed_400_223  bnseve001 neuroscience RUNNING       51:15   1     1    hpc102                 normal  6692         0:51:15
28   52668      ada     BAUCB_Seed_398_223  bnseve001 neuroscience RUNNING       51:16   1     1    hpc100                 normal  6692         0:51:16
29   52666      ada     BAUCB_Seed_397_223  bnseve001 neuroscience RUNNING       56:50   1     1    hpc102                 normal  6692         0:56:50
30   52665      ada     BAUCB_Seed_396_223  bnseve001 neuroscience RUNNING       56:51   1     1    hpc101                 normal  6692         0:56:51
31   52657      ada     BAUCB_Seed_395_223  bnseve001 neuroscience RUNNING     1:07:00   1     1    hpc100                 normal  6692         1:07:00
32   52656      ada     BAUCB_Seed_394_223  bnseve001 neuroscience RUNNING     1:17:09   1     1    hpc100                 normal  6692         1:17:09
33   52653      ada     BAUCB_Seed_393_223  bnseve001 neuroscience RUNNING     1:22:17   1     1    hpc100                 normal  6692         1:22:17
34   52652      ada     BAUCB_Seed_392_223  bnseve001 neuroscience RUNNING     1:27:26   1     1    hpc101                 normal  6692         1:27:26
35   52651      ada     BAUCB_Seed_391_223  bnseve001 neuroscience RUNNING     1:32:34   1     1    hpc101                 normal  6692         1:32:34
36   52648      ada     BAUCB_Seed_388_223  bnseve001 neuroscience RUNNING     1:37:43   1     1    hpc100                 normal  6692         1:37:43
37   52649      ada     BAUCB_Seed_389_223  bnseve001 neuroscience RUNNING     1:37:43   1     1    hpc101                 normal  6692         1:37:43
38   52650      ada     BAUCB_Seed_390_223  bnseve001 neuroscience RUNNING     1:37:43   1     1    hpc101                 normal  6692         1:37:43
39   52645      ada     BAUCB_Seed_386_223  bnseve001 neuroscience RUNNING     1:42:51   1     1    hpc101                 normal  6692         1:42:51
40   52646      ada     BAUCB_Seed_387_223  bnseve001 neuroscience RUNNING     1:42:51   1     1    hpc102                 normal  6692         1:42:51
41   52643      ada     BAUCB_Seed_384_223  bnseve001 neuroscience RUNNING     1:42:52   1     1    hpc100                 normal  6692         1:42:52
42   52644      ada     BAUCB_Seed_385_223  bnseve001 neuroscience RUNNING     1:42:52   1     1    hpc100                 normal  6692         1:42:52
43   52641      ada     BAUCB_Seed_383_223  bnseve001 neuroscience RUNNING     1:47:59   1     1    hpc101                 normal  6692         1:47:59
44   52639      ada     BAUCB_Seed_381_223  bnseve001 neuroscience RUNNING     1:48:00   1     1    hpc100                 normal  6692         1:48:00
45   52640      ada     BAUCB_Seed_382_223  bnseve001 neuroscience RUNNING     1:48:00   1     1    hpc100                 normal  6692         1:48:00
46   52637      ada     BAUCB_Seed_380_223  bnseve001 neuroscience RUNNING     1:53:09   1     1    hpc100                 normal  6692         1:53:09
47   52636      ada     BAUCB_Seed_379_223  bnseve001 neuroscience RUNNING     1:58:17   1     1    hpc101                 normal  6692         1:58:17
48   52635      ada     BAUCB_Seed_378_223  bnseve001 neuroscience RUNNING     2:08:26   1     1    hpc100                 normal  6692         2:08:26
49   52633      ada     BAUCB_Seed_376_223  bnseve001 neuroscience RUNNING     2:13:35   1     1    hpc101                 normal  6692         2:13:35
50   52634      ada     BAUCB_Seed_377_223  bnseve001 neuroscience RUNNING     2:13:35   1     1    hpc102                 normal  6692         2:13:35
51   52631      ada     BAUCB_Seed_374_223  bnseve001 neuroscience RUNNING     2:18:45   1     1    hpc100                 normal  6692         2:18:45
52   52632      ada     BAUCB_Seed_375_223  bnseve001 neuroscience RUNNING     2:18:45   1     1    hpc100                 normal  6692         2:18:45
53   52630      ada     BAUCB_Seed_373_223  bnseve001 neuroscience RUNNING     2:23:54   1     1    hpc100                 normal  6692         2:23:54
54   52628      ada     BAUCB_Seed_371_223  bnseve001 neuroscience RUNNING     2:29:02   1     1    hpc100                 normal  6692         2:29:02
55   52629      ada     BAUCB_Seed_372_223  bnseve001 neuroscience RUNNING     2:29:02   1     1    hpc101                 normal  6692         2:29:02
56   52625      ada     BAUCB_Seed_368_223  bnseve001 neuroscience RUNNING     2:34:11   1     1    hpc100                 normal  6692         2:34:11
57   52626      ada     BAUCB_Seed_369_223  bnseve001 neuroscience RUNNING     2:34:11   1     1    hpc100                 normal  6692         2:34:11
58   52627      ada     BAUCB_Seed_370_223  bnseve001 neuroscience RUNNING     2:34:11   1     1    hpc102                 normal  6692         2:34:11
59   52624      ada     BAUCB_Seed_367_223  bnseve001 neuroscience RUNNING     2:34:12   1     1    hpc100                 normal  6692         2:34:12
60   52622      ada     BAUCB_Seed_365_223  bnseve001 neuroscience RUNNING     2:39:20   1     1    hpc101                 normal  6692         2:39:20
61   52623      ada     BAUCB_Seed_366_223  bnseve001 neuroscience RUNNING     2:39:20   1     1    hpc101                 normal  6692         2:39:20
62   52621      ada     BAUCB_Seed_364_223  bnseve001 neuroscience RUNNING     2:39:21   1     1    hpc100                 normal  6692         2:39:21
63   52620      ada     BAUCB_Seed_363_223  bnseve001 neuroscience RUNNING     2:44:30   1     1    hpc101                 normal  6692         2:44:30
64   52619      ada     BAUCB_Seed_362_223  bnseve001 neuroscience RUNNING     2:44:31   1     1    hpc101                 normal  6692         2:44:31
65   52618      ada     BAUCB_Seed_361_223  bnseve001 neuroscience RUNNING     2:49:40   1     1    hpc101                 normal  6692         2:49:40
66   52615      ada     BAUCB_Seed_358_223  bnseve001 neuroscience RUNNING     2:54:49   1     1    hpc101                 normal  6692         2:54:49
67   52616      ada     BAUCB_Seed_359_223  bnseve001 neuroscience RUNNING     2:54:49   1     1    hpc101                 normal  6692         2:54:49
68   52617      ada     BAUCB_Seed_360_223  bnseve001 neuroscience RUNNING     2:54:49   1     1    hpc101                 normal  6692         2:54:49
69   52614      ada     BAUCB_Seed_357_223  bnseve001 neuroscience RUNNING     2:54:50   1     1    hpc101                 normal  6692         2:54:50
70   52613      ada     BAUCB_Seed_356_223  bnseve001 neuroscience RUNNING     3:00:00   1     1    hpc102                 normal  6692         3:00:00
71   52611      ada     BAUCB_Seed_355_223  bnseve001 neuroscience RUNNING     3:05:08   1     1    hpc102                 normal  6692         3:05:08
72   52609      ada     BAUCB_Seed_353_223  bnseve001 neuroscience RUNNING     3:05:09   1     1    hpc100                 normal  6692         3:05:09
73   52610      ada     BAUCB_Seed_354_223  bnseve001 neuroscience RUNNING     3:05:09   1     1    hpc102                 normal  6692         3:05:09
74   52607      ada     BAUCB_Seed_352_223  bnseve001 neuroscience RUNNING     3:10:19   1     1    hpc101                 normal  6692         3:10:19
75   52605      ada     BAUCB_Seed_351_223  bnseve001 neuroscience RUNNING     3:15:28   1     1    hpc101                 normal  6692         3:15:28
76   52604      ada     BAUCB_Seed_350_223  bnseve001 neuroscience RUNNING     3:15:29   1     1    hpc100                 normal  6692         3:15:29
77   52603      ada     BAUCB_Seed_349_223  bnseve001 neuroscience RUNNING     3:20:35   1     1    hpc102                 normal  6692         3:20:35
78   52602      ada     BAUCB_Seed_348_223  bnseve001 neuroscience RUNNING     3:20:37   1     1    hpc102                 normal  6692         3:20:37
79   52600      ada     BAUCB_Seed_346_223  bnseve001 neuroscience RUNNING     3:20:38   1     1    hpc100                 normal  6692         3:20:38
80   52601      ada     BAUCB_Seed_347_223  bnseve001 neuroscience RUNNING     3:20:38   1     1    hpc101                 normal  6692         3:20:38
81   52599      ada     BAUCB_Seed_345_223  bnseve001 neuroscience RUNNING     3:25:45   1     1    hpc102                 normal  6692         3:25:45
82   52595      ada     BAUCB_Seed_343_223  bnseve001 neuroscience RUNNING     3:50:55   1     1    hpc100                 normal  6692         3:50:55
83   52596      ada     BAUCB_Seed_344_223  bnseve001 neuroscience RUNNING     3:50:55   1     1    hpc102                 normal  6692         3:50:55
84   52593      ada     BAUCB_Seed_342_223  bnseve001 neuroscience RUNNING     4:01:03   1     1    hpc102                 normal  6692         4:01:03
85   52591      ada     BAUCB_Seed_340_223  bnseve001 neuroscience RUNNING     4:06:12   1     1    hpc102                 normal  6692         4:06:12
86   52592      ada     BAUCB_Seed_341_223  bnseve001 neuroscience RUNNING     4:06:12   1     1    hpc102                 normal  6692         4:06:12
87   52589      ada     BAUCB_Seed_339_223  bnseve001 neuroscience RUNNING     4:11:20   1     1    hpc100                 normal  6692         4:11:20
88   52586      ada     BAUCB_Seed_337_223  bnseve001 neuroscience RUNNING     4:16:28   1     1    hpc101                 normal  6692         4:16:28
89   52587      ada     BAUCB_Seed_338_223  bnseve001 neuroscience RUNNING     4:16:28   1     1    hpc102                 normal  6692         4:16:28
90   52585      ada     BAUCB_Seed_336_223  bnseve001 neuroscience RUNNING     4:21:35   1     1    hpc102                 normal  6692         4:21:35
91   52584      ada     BAUCB_Seed_335_223  bnseve001 neuroscience RUNNING     4:21:36   1     1    hpc101                 normal  6692         4:21:36
92   52581      ada     BAUCB_Seed_334_223  bnseve001 neuroscience RUNNING     4:26:44   1     1    hpc102                 normal  6692         4:26:44
93   52580      ada     BAUCB_Seed_333_223  bnseve001 neuroscience RUNNING     4:31:52   1     1    hpc101                 normal  6692         4:31:52
94   52578      ada     BAUCB_Seed_331_223  bnseve001 neuroscience RUNNING     4:42:00   1     1    hpc100                 normal  6692         4:42:00
95   52579      ada     BAUCB_Seed_332_223  bnseve001 neuroscience RUNNING     4:42:00   1     1    hpc102                 normal  6692         4:42:00
96   52577      ada     BAUCB_Seed_330_223  bnseve001 neuroscience RUNNING     4:47:08   1     1    hpc100                 normal  6692         4:47:08
97   52575      ada     BAUCB_Seed_328_223  bnseve001 neuroscience RUNNING     4:52:16   1     1    hpc101                 normal  6692         4:52:16
98   52576      ada     BAUCB_Seed_329_223  bnseve001 neuroscience RUNNING     4:52:16   1     1    hpc102                 normal  6692         4:52:16
99   52574      ada     BAUCB_Seed_327_223  bnseve001 neuroscience RUNNING     4:57:23   1     1    hpc101                 normal  6692         4:57:23
100  52573      ada     BAUCB_Seed_326_223  bnseve001 neuroscience RUNNING     4:57:24   1     1    hpc100                 normal  6692         4:57:24
101  52571      ada     BAUCB_Seed_324_223  bnseve001 neuroscience RUNNING     5:02:33   1     1    hpc101                 normal  6692         5:02:33
102  52572      ada     BAUCB_Seed_325_223  bnseve001 neuroscience RUNNING     5:02:33   1     1    hpc102                 normal  6692         5:02:33
103  52570      ada     BAUCB_Seed_323_223  bnseve001 neuroscience RUNNING     5:07:41   1     1    hpc102                 normal  6692         5:07:41
104  52569      ada     BAUCB_Seed_322_223  bnseve001 neuroscience RUNNING     5:27:49   1     1    hpc101                 normal  6692         5:27:49
105  52568      ada     BAUCB_Seed_321_223  bnseve001 neuroscience RUNNING     6:57:58   1     1    hpc100                 normal  6692         6:57:58
106  52567      ada     BAUCB_Seed_320_223  bnseve001 neuroscience RUNNING     8:58:08   1     1    hpc100                 normal  6692         8:58:08
107  52566      ada     BAUCB_Seed_319_223  bnseve001 neuroscience RUNNING     9:08:16   1     1    hpc101                 normal  6692         9:08:16
108  52552      ada     BAUCB_Seed_312_223  bnseve001 neuroscience RUNNING    10:08:49   1     1    hpc100                 normal  6692        10:08:49
109  52553      ada     BAUCB_Seed_313_223  bnseve001 neuroscience RUNNING    10:08:49   1     1    hpc100                 normal  6692        10:08:49
110  52547      ada     BAUCB_Seed_307_223  bnseve001 neuroscience RUNNING    10:29:15   1     1    hpc101                 normal  6692        10:29:15
111  52540      ada     BAUCB_Seed_302_223  bnseve001 neuroscience RUNNING    10:49:39   1     1    hpc101                 normal  6692        10:49:39
112  52539      ada     BAUCB_Seed_301_223  bnseve001 neuroscience RUNNING    10:49:40   1     1    hpc100                 normal  6692        10:49:40
113  52535      ada     BAUCB_Seed_297_223  bnseve001 neuroscience RUNNING    10:54:46   1     1    hpc100                 normal  6692        10:54:46
114  52538      ada     BAUCB_Seed_300_223  bnseve001 neuroscience RUNNING    10:54:46   1     1    hpc101                 normal  6692        10:54:46
115  52524      ada     BAUCB_Seed_286_223  bnseve001 neuroscience RUNNING    11:15:20   1     1    hpc100                 normal  6692        11:15:20
116  52520      ada     BAUCB_Seed_282_223  bnseve001 neuroscience RUNNING    11:20:29   1     1    hpc100                 normal  6692        11:20:29
117  52516      ada     BAUCB_Seed_278_223  bnseve001 neuroscience RUNNING    11:25:37   1     1    hpc101                 normal  6692        11:25:37
118  52512      ada     BAUCB_Seed_275_223  bnseve001 neuroscience RUNNING    11:35:45   1     1    hpc100                 normal  6692        11:35:45
119  52495      ada     BAUCB_Seed_263_223  bnseve001 neuroscience RUNNING    11:46:02   1     1    hpc100                 normal  6692        11:46:02
120  52496      ada     BAUCB_Seed_264_223  bnseve001 neuroscience RUNNING    11:46:02   1     1    hpc101                 normal  6692        11:46:02
121  52492      ada     BAUCB_Seed_261_223  bnseve001 neuroscience RUNNING    11:51:11   1     1    hpc100                 normal  6692        11:51:11
122  52490      ada     BAUCB_Seed_259_223  bnseve001 neuroscience RUNNING    11:56:19   1     1    hpc101                 normal  6692        11:56:19
123  52491      ada     BAUCB_Seed_260_223  bnseve001 neuroscience RUNNING    11:56:19   1     1    hpc101                 normal  6692        11:56:19
124  52474      ada     BAUCB_Seed_244_223  bnseve001 neuroscience RUNNING    12:06:34   1     1    hpc100                 normal  6692        12:06:34
125  52475      ada     BAUCB_Seed_245_223  bnseve001 neuroscience RUNNING    12:06:34   1     1    hpc100                 normal  6692        12:06:34
126  52477      ada     BAUCB_Seed_247_223  bnseve001 neuroscience RUNNING    12:06:34   1     1    hpc101                 normal  6692        12:06:34
127  52455      ada     BAUCB_Seed_228_223  bnseve001 neuroscience RUNNING    12:32:17   1     1    hpc100                 normal  6692        12:32:17
128  52445      ada     BAUCB_Seed_219_223  bnseve001 neuroscience RUNNING    12:42:34   1     1    hpc100                 normal  6692        12:42:34
129  52437      ada     BAUCB_Seed_213_223  bnseve001 neuroscience RUNNING    12:52:52   1     1    hpc101                 normal  6692        12:52:52
130  52298      ada     I_v1_comp           chwsom002 humbio       PENDING    15:17:23   10    1    AssocMaxCpuPerJobLimit normal  7701                
131  51651      l40s    TinySTorY           nvcela001 l40sfree     RUNNING    23:26:43   10(4) 1    gpu012                 l40sfree7582      9-18:27:10
132  51035      swan    cyl                 iklray001 mecheng      RUNNING  2-09:04:18   40    1    hpc207                 normal  10502     95-02:52:00

CLUSTER STATUS
PARTITION AVAIL   NODES  STATE NODELIST
ada*         up       4    mix srvrochpc[100-101,103-104]
ada*         up       1  alloc srvrochpc102
ada*         up      11   idle srvrochpc[105-115]
l40s         up       1    mix srvrocgpu012
l40s         up       3   idle srvrocgpu[013-015]
swan         up       1  alloc srvrochpc207
swan         up       7   idle srvrochpc[218-224]

PartitionName=ada
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=YES QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrochpc[100-115]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=768 TotalNodes=16 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=8000 MaxMemPerCPU=8000
    TRES=cpu=768,mem=6000G,node=16,billing=1368
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=l40s
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrocgpu[012-015]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=192 TotalNodes=4 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=10000 MaxMemPerCPU=10000
    TRES=cpu=192,mem=2000G,node=4,billing=392,gres/gpu=16,gres/gpu:l40s=16
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=swan
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrochpc[207,218-224]
    PriorityJobFactor=30 PriorityTier=30 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=320 TotalNodes=8 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=9000 MaxMemPerCPU=9000
    TRES=cpu=320,mem=3000G,node=8,billing=620
    TRESBillingWeights=CPU=1.0,Mem=0.1G

WORKER NODE STATUS
NodeName=srvrochpc100 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=46 CPUEfctv=48 CPUTot=48 CPULoad=48.37
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc100 NodeHostName=srvrochpc100 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=368000 FreeMem=7264 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:19:48 SlurmdStartTime=2024-11-14T12:28:23
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=46,mem=368000M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      52694 bnseve001 'BA_Seed_211_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_10-09-26' hpc100   
      52684 bnseve001 'BA_Seed_207_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_09-59-08' hpc100   
      52685 bnseve001 'BA_Seed_208_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_09-59-08' hpc100   
      52680 bnseve001 'BA_Seed_205_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_09-54-00' hpc100   
      52668 bnseve001 'BAUCB_Seed_398_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_09-38-35' hpc100   
      52657 bnseve001 'BAUCB_Seed_395_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_09-22-51' hpc100   
      52656 bnseve001 'BAUCB_Seed_394_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_09-12-42' hpc100   
      52653 bnseve001 'BAUCB_Seed_393_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_09-07-34' hpc100   
      52648 bnseve001 'BAUCB_Seed_388_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-52-08' hpc100   
      52643 bnseve001 'BAUCB_Seed_384_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-46-59' hpc100   
      52644 bnseve001 'BAUCB_Seed_385_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-46-59' hpc100   
      52639 bnseve001 'BAUCB_Seed_381_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-41-51' hpc100   
      52640 bnseve001 'BAUCB_Seed_382_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-41-51' hpc100   
      52637 bnseve001 'BAUCB_Seed_380_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-36-42' hpc100   
      52635 bnseve001 'BAUCB_Seed_378_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-21-25' hpc100   
      52631 bnseve001 'BAUCB_Seed_374_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-11-06' hpc100   
      52632 bnseve001 'BAUCB_Seed_375_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-11-06' hpc100   
      52630 bnseve001 'BAUCB_Seed_373_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-05-57' hpc100   
      52628 bnseve001 'BAUCB_Seed_371_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-00-49' hpc100   
      52625 bnseve001 'BAUCB_Seed_368_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-55-39' hpc100   
      52626 bnseve001 'BAUCB_Seed_369_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-55-39' hpc100   
      52624 bnseve001 'BAUCB_Seed_367_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-55-39' hpc100   
      52621 bnseve001 'BAUCB_Seed_364_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-50-30' hpc100   
      52609 bnseve001 'BAUCB_Seed_353_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-24-42' hpc100   
      52604 bnseve001 'BAUCB_Seed_350_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-14-22' hpc100   
      52600 bnseve001 'BAUCB_Seed_346_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-09-13' hpc100   
      52595 bnseve001 'BAUCB_Seed_343_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_06-38-55' hpc100   
      52589 bnseve001 'BAUCB_Seed_339_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_06-18-31' hpc100   
      52578 bnseve001 'BAUCB_Seed_331_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_05-47-51' hpc100   
      52577 bnseve001 'BAUCB_Seed_330_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_05-42-43' hpc100   
      52573 bnseve001 'BAUCB_Seed_326_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_05-32-26' hpc100   
      52568 bnseve001 'BAUCB_Seed_321_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_03-31-53' hpc100   
      52567 bnseve001 'BAUCB_Seed_320_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_01-31-43' hpc100   
      52552 bnseve001 'BAUCB_Seed_312_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_00-21-02' hpc100   
      52553 bnseve001 'BAUCB_Seed_313_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_00-21-02' hpc100   
      52539 bnseve001 'BAUCB_Seed_301_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_23-40-11' hpc100   
      52535 bnseve001 'BAUCB_Seed_297_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_23-35-03' hpc100   
      52524 bnseve001 'BAUCB_Seed_286_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_23-14-31' hpc100   
      52520 bnseve001 'BAUCB_Seed_282_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_23-09-22' hpc100   
      52512 bnseve001 'BAUCB_Seed_275_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_22-54-06' hpc100   
      52495 bnseve001 'BAUCB_Seed_263_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_22-43-49' hpc100   
      52492 bnseve001 'BAUCB_Seed_261_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_22-38-40' hpc100   
      52474 bnseve001 'BAUCB_Seed_244_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_22-23-14' hpc100   
      52475 bnseve001 'BAUCB_Seed_245_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_22-23-15' hpc100   
      52455 bnseve001 'BAUCB_Seed_228_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_21-57-33' hpc100   
      52445 bnseve001 'BAUCB_Seed_219_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_21-47-17' hpc100   

NodeName=srvrochpc101 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=47 CPUEfctv=48 CPUTot=48 CPULoad=45.85
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc101 NodeHostName=srvrochpc101 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=376000 FreeMem=7312 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:21:51 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=47,mem=376000M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      52692 anxtem001 'bash' hpc101   
      52676 nvcela001 'bash' hpc101   
      52704 bnseve001 'BA_Seed_214_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_10-19-43' hpc101   
      52700 bnseve001 'BA_Seed_213_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_10-14-35' hpc101   
      52695 bnseve001 'BA_Seed_212_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_10-09-26' hpc101   
      52686 bnseve001 'BA_Seed_209_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_09-59-08' hpc101   
      52681 bnseve001 'BA_Seed_206_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_09-54-00' hpc101   
      52669 bnseve001 'BAUCB_Seed_399_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_09-38-35' hpc101   
      52665 bnseve001 'BAUCB_Seed_396_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_09-33-00' hpc101   
      52652 bnseve001 'BAUCB_Seed_392_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_09-02-25' hpc101   
      52651 bnseve001 'BAUCB_Seed_391_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-57-17' hpc101   
      52649 bnseve001 'BAUCB_Seed_389_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-52-08' hpc101   
      52650 bnseve001 'BAUCB_Seed_390_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-52-08' hpc101   
      52645 bnseve001 'BAUCB_Seed_386_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-46-59' hpc101   
      52641 bnseve001 'BAUCB_Seed_383_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-41-51' hpc101   
      52636 bnseve001 'BAUCB_Seed_379_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-31-34' hpc101   
      52633 bnseve001 'BAUCB_Seed_376_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-16-16' hpc101   
      52629 bnseve001 'BAUCB_Seed_372_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-00-49' hpc101   
      52622 bnseve001 'BAUCB_Seed_365_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-50-30' hpc101   
      52623 bnseve001 'BAUCB_Seed_366_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-50-30' hpc101   
      52620 bnseve001 'BAUCB_Seed_363_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-45-20' hpc101   
      52619 bnseve001 'BAUCB_Seed_362_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-45-20' hpc101   
      52618 bnseve001 'BAUCB_Seed_361_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-40-11' hpc101   
      52615 bnseve001 'BAUCB_Seed_358_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-35-01' hpc101   
      52616 bnseve001 'BAUCB_Seed_359_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-35-01' hpc101   
      52617 bnseve001 'BAUCB_Seed_360_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-35-01' hpc101   
      52614 bnseve001 'BAUCB_Seed_357_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-35-01' hpc101   
      52607 bnseve001 'BAUCB_Seed_352_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-19-32' hpc101   
      52605 bnseve001 'BAUCB_Seed_351_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-14-22' hpc101   
      52601 bnseve001 'BAUCB_Seed_347_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-09-13' hpc101   
      52586 bnseve001 'BAUCB_Seed_337_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_06-13-23' hpc101   
      52584 bnseve001 'BAUCB_Seed_335_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_06-08-15' hpc101   
      52580 bnseve001 'BAUCB_Seed_333_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_05-57-59' hpc101   
      52575 bnseve001 'BAUCB_Seed_328_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_05-37-35' hpc101   
      52574 bnseve001 'BAUCB_Seed_327_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_05-32-27' hpc101   
      52571 bnseve001 'BAUCB_Seed_324_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_05-27-18' hpc101   
      52569 bnseve001 'BAUCB_Seed_322_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_05-02-02' hpc101   
      52566 bnseve001 'BAUCB_Seed_319_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_01-21-35' hpc101   
      52547 bnseve001 'BAUCB_Seed_307_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_00-00-36' hpc101   
      52540 bnseve001 'BAUCB_Seed_302_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_23-40-11' hpc101   
      52538 bnseve001 'BAUCB_Seed_300_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_23-35-03' hpc101   
      52516 bnseve001 'BAUCB_Seed_278_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_23-04-14' hpc101   
      52496 bnseve001 'BAUCB_Seed_264_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_22-43-49' hpc101   
      52490 bnseve001 'BAUCB_Seed_259_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_22-33-32' hpc101   
      52491 bnseve001 'BAUCB_Seed_260_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_22-33-32' hpc101   
      52477 bnseve001 'BAUCB_Seed_247_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_22-23-15' hpc101   
      52437 bnseve001 'BAUCB_Seed_213_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-20_21-36-59' hpc101   

NodeName=srvrochpc102 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=48 CPUEfctv=48 CPUTot=48 CPULoad=61.62
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc102 NodeHostName=srvrochpc102 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=384000 FreeMem=12798 Sockets=2 Boards=1
   State=allocated  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:31:42 SlurmdStartTime=2024-11-14T12:28:23
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=48,mem=375G
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      52647 chwsom002 'I_v1_comp' hpc102   
      52660 thnthi002 'Alignment' hpc102   
      52658 thnthi002 'Alignment' hpc102   
      52708 thnthi002 'checking' hpc102   
      52691 bnseve001 'BA_Seed_210_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_10-04-18' hpc102   
      52678 bnseve001 'BA_Seed_203_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_09-48-52' hpc102   
      52679 bnseve001 'BA_Seed_204_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_09-48-52' hpc102   
      52674 bnseve001 'BA_Seed_202_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_09-43-43' hpc102   
      52670 bnseve001 'BAUCB_Seed_400_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_09-38-35' hpc102   
      52666 bnseve001 'BAUCB_Seed_397_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_09-33-00' hpc102   
      52646 bnseve001 'BAUCB_Seed_387_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-46-59' hpc102   
      52634 bnseve001 'BAUCB_Seed_377_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_08-16-16' hpc102   
      52627 bnseve001 'BAUCB_Seed_370_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-55-39' hpc102   
      52613 bnseve001 'BAUCB_Seed_356_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-29-51' hpc102   
      52611 bnseve001 'BAUCB_Seed_355_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-24-42' hpc102   
      52610 bnseve001 'BAUCB_Seed_354_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-24-42' hpc102   
      52603 bnseve001 'BAUCB_Seed_349_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-09-13' hpc102   
      52602 bnseve001 'BAUCB_Seed_348_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-09-13' hpc102   
      52599 bnseve001 'BAUCB_Seed_345_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_07-04-04' hpc102   
      52596 bnseve001 'BAUCB_Seed_344_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_06-38-56' hpc102   
      52593 bnseve001 'BAUCB_Seed_342_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_06-28-48' hpc102   
      52591 bnseve001 'BAUCB_Seed_340_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_06-23-39' hpc102   
      52592 bnseve001 'BAUCB_Seed_341_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_06-23-39' hpc102   
      52587 bnseve001 'BAUCB_Seed_338_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_06-13-23' hpc102   
      52585 bnseve001 'BAUCB_Seed_336_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_06-08-15' hpc102   
      52581 bnseve001 'BAUCB_Seed_334_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_06-03-07' hpc102   
      52579 bnseve001 'BAUCB_Seed_332_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_05-47-51' hpc102   
      52576 bnseve001 'BAUCB_Seed_329_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_05-37-35' hpc102   
      52572 bnseve001 'BAUCB_Seed_325_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_05-27-18' hpc102   
      52570 bnseve001 'BAUCB_Seed_323_223c43fe38a65e81e4850acf2c36d3d9_Grid10_Hor5_Hill55_Start38_Food50_5_76_24_Water45_33_1_26_Sleep76_89_7_69_2024-11-21_05-22-10' hpc102   

NodeName=srvrochpc103 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=34 CPUEfctv=48 CPUTot=48 CPULoad=32.95
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc103 NodeHostName=srvrochpc103 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=308608 FreeMem=3422 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:31:40 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T09:15:52 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=34,mem=308608M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      52667 vhrdew002 'Opt_A' hpc103   
      52662 vhrdew002 'Opt_P' hpc103   
      52687 thnthi002 'Alignment' hpc103   
      52693 bndlev001 'PPO_Training_Simple' hpc103   

NodeName=srvrochpc104 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=20 CPUEfctv=48 CPUTot=48 CPULoad=1.58
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc104 NodeHostName=srvrochpc104 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=160000 FreeMem=86680 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:42:25 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-19T17:04:47 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=20,mem=160000M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      52706 bndlev001 'PPO_Training_Simple' hpc104   
      52702 bndlev001 'PPO_Training_Simple' hpc104   

NodeName=srvrochpc105 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc105 NodeHostName=srvrochpc105 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=125271 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:28:41 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-19T17:05:52 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc106 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc106 NodeHostName=srvrochpc106 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=68475 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:27:19 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-20T15:50:11 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc107 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc107 NodeHostName=srvrochpc107 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=45185 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:27:12 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-16T12:04:27 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc108 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc108 NodeHostName=srvrochpc108 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=177451 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:19:21 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc109 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc109 NodeHostName=srvrochpc109 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=141051 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:19:09 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc110 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc110 NodeHostName=srvrochpc110 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=188960 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:05:25 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc111 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc111 NodeHostName=srvrochpc111 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=280923 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:05:01 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc112 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc112 NodeHostName=srvrochpc112 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=279421 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:03:49 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc113 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc113 NodeHostName=srvrochpc113 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=287517 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:02:56 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc114 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc114 NodeHostName=srvrochpc114 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=2263 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T13:52:51 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-20T14:53:58 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc115 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc115 NodeHostName=srvrochpc115 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=316236 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T13:45:20 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc207 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUEfctv=40 CPUTot=40 CPULoad=40.57
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc207 NodeHostName=srvrochpc207 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=360000 FreeMem=360109 Sockets=2 Boards=1
   State=allocated  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-13T18:57:00 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-19T01:21:36 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      51035 iklray001 'cyl' hpc207   

NodeName=srvrochpc218 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc218 NodeHostName=srvrochpc218 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371545 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-13T19:39:08 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc219 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc219 NodeHostName=srvrochpc219 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371538 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-14T09:20:53 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc220 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.06
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc220 NodeHostName=srvrochpc220 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371499 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-14T12:14:48 SlurmdStartTime=2024-11-14T12:52:52
   LastBusyTime=2024-11-14T12:53:15 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc221 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc221 NodeHostName=srvrochpc221 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371524 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-14T08:35:02 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc222 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc222 NodeHostName=srvrochpc222 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371552 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-14T08:35:34 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc223 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc223 NodeHostName=srvrochpc223 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=372432 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-07T15:27:10 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc224 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc224 NodeHostName=srvrochpc224 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=372480 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-07T22:26:17 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-14T12:28:21 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu012 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=10 CPUEfctv=48 CPUTot=48 CPULoad=1.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu012 NodeHostName=srvrocgpu012 Version=23.11.5
   OS=Linux 5.14.0-427.35.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 18:24:53 UTC 2024 
   RealMemory=512000 AllocMem=100000 FreeMem=286870 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2024-11-01T11:55:41 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-20T11:00:18 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=cpu=10,mem=100000M,gres/gpu=4,gres/gpu:l40s=4
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      51651 nvcela001 'TinySTorY' gpu012   

NodeName=srvrocgpu013 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.41
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu013 NodeHostName=srvrocgpu013 Version=23.11.5
   OS=Linux 5.14.0-427.35.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 18:24:53 UTC 2024 
   RealMemory=512000 AllocMem=0 FreeMem=366865 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2024-11-01T11:55:59 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T10:17:09 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu014 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.19
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu014 NodeHostName=srvrocgpu014 Version=23.11.5
   OS=Linux 5.14.0-427.35.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 18:24:53 UTC 2024 
   RealMemory=512000 AllocMem=0 FreeMem=428908 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2024-11-01T11:58:50 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T10:18:32 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu015 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.08
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu015 NodeHostName=srvrocgpu015 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=512000 AllocMem=0 FreeMem=472001 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2024-11-19T11:51:56 SlurmdStartTime=2024-11-19T12:56:54
   LastBusyTime=2024-11-21T08:26:54 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE