UCT High Performance Computing Facility
Home        About us       Documentation        Support and Capabilities       Policies        Apply for account

Thu Nov 21 15:51:02 SAST 2024

Users logged in: 01465760 01468393 bndlev001 chdbha001 chwsom002 gmdsbo006 hsmsia001 nvcela001 t0087231 thnthi002 vhrdew002
Head Node load: 1.20 0.90 0.99 (0.87)     Head Node RAM free: 61%
Currently computing: 219 hours     Jobs running: 129     Jobs queued: 2
Efficiency: 60%   System overview    System config    Summary    Queue accounting    Graphs

JOBS RUNNING
#    JOBID      PRTTN   NAME                USER      ACCOUNT      STATE      Q\R-TIME CORES NODES  NODES\REASON           QOS     PRIORITY     CPUTIME
-------------------------------------------------------------------------------------------------------------------------------------------------------
1    52839      ada     boot_threshold      01465760  humbio       RUNNING       57:23   10    1    hpc100                 normal  7438         9:33:50
2    52968      ada     I_v1_comp           chwsom002 humbio       RUNNING       50:02   10    1    hpc103                 normal  7422         8:20:20
3    52980      ada     bash                nvcela001 compsci      RUNNING        8:39   1     1    hpc100                 normal  7419         0:08:39
4    52662      ada     Opt_P               vhrdew002 chemistry    RUNNING       57:23   10    1    hpc100                 normal  7287         9:33:50
5    52667      ada     Opt_A               vhrdew002 chemistry    RUNNING       57:23   10    1    hpc101                 normal  7287         9:33:50
6    52844      ada     PPO_Training_Simpl  bndlev001 stats        RUNNING       57:23   10    1    hpc101                 normal  7115         9:33:50
7    52984      ada     BA_Seed_400_63d1f7  bnseve001 neuroscience RUNNING        2:20   1     1    hpc100                 normal  6692         0:02:20
8    52985      ada     BAUCB_Seed_201_63d  bnseve001 neuroscience RUNNING        2:20   1     1    hpc100                 normal  6692         0:02:20
9    52986      ada     BAUCB_Seed_202_63d  bnseve001 neuroscience RUNNING        2:20   1     1    hpc101                 normal  6692         0:02:20
10   52987      ada     BAUCB_Seed_203_63d  bnseve001 neuroscience RUNNING        2:20   1     1    hpc101                 normal  6692         0:02:20
11   52988      ada     BAUCB_Seed_204_63d  bnseve001 neuroscience RUNNING        2:20   1     1    hpc101                 normal  6692         0:02:20
12   52989      ada     BAUCB_Seed_205_63d  bnseve001 neuroscience RUNNING        2:20   1     1    hpc101                 normal  6692         0:02:20
13   52990      ada     BAUCB_Seed_206_63d  bnseve001 neuroscience RUNNING        2:20   1     1    hpc101                 normal  6692         0:02:20
14   52983      ada     BA_Seed_399_63d1f7  bnseve001 neuroscience RUNNING        2:21   1     1    hpc100                 normal  6692         0:02:21
15   52981      ada     BA_Seed_398_63d1f7  bnseve001 neuroscience RUNNING        7:31   1     1    hpc100                 normal  6692         0:07:31
16   52977      ada     BA_Seed_397_63d1f7  bnseve001 neuroscience RUNNING       17:40   1     1    hpc100                 normal  6692         0:17:40
17   52938      ada     BA_Seed_367_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc102                 normal  6692         0:52:47
18   52939      ada     BA_Seed_368_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc102                 normal  6692         0:52:47
19   52940      ada     BA_Seed_369_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc102                 normal  6692         0:52:47
20   52941      ada     BA_Seed_370_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
21   52942      ada     BA_Seed_371_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
22   52943      ada     BA_Seed_372_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
23   52944      ada     BA_Seed_373_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
24   52945      ada     BA_Seed_374_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
25   52946      ada     BA_Seed_375_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
26   52947      ada     BA_Seed_376_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
27   52948      ada     BA_Seed_377_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
28   52949      ada     BA_Seed_378_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
29   52950      ada     BA_Seed_379_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
30   52951      ada     BA_Seed_380_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
31   52952      ada     BA_Seed_381_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
32   52953      ada     BA_Seed_382_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
33   52954      ada     BA_Seed_383_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
34   52956      ada     BA_Seed_385_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
35   52957      ada     BA_Seed_386_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
36   52958      ada     BA_Seed_387_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
37   52959      ada     BA_Seed_388_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
38   52960      ada     BA_Seed_389_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
39   52961      ada     BA_Seed_390_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
40   52962      ada     BA_Seed_391_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
41   52963      ada     BA_Seed_392_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
42   52964      ada     BA_Seed_393_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
43   52965      ada     BA_Seed_394_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
44   52966      ada     BA_Seed_395_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
45   52967      ada     BA_Seed_396_63d1f7  bnseve001 neuroscience RUNNING       52:47   1     1    hpc103                 normal  6692         0:52:47
46   52937      ada     BA_Seed_366_63d1f7  bnseve001 neuroscience RUNNING       52:48   1     1    hpc102                 normal  6692         0:52:48
47   52854      ada     BA_Seed_283_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc100                 normal  6692         0:52:51
48   52855      ada     BA_Seed_284_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc100                 normal  6692         0:52:51
49   52856      ada     BA_Seed_285_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc100                 normal  6692         0:52:51
50   52858      ada     BA_Seed_287_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc100                 normal  6692         0:52:51
51   52859      ada     BA_Seed_288_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc100                 normal  6692         0:52:51
52   52861      ada     BA_Seed_290_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc100                 normal  6692         0:52:51
53   52863      ada     BA_Seed_292_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc100                 normal  6692         0:52:51
54   52864      ada     BA_Seed_293_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc100                 normal  6692         0:52:51
55   52865      ada     BA_Seed_294_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc100                 normal  6692         0:52:51
56   52866      ada     BA_Seed_295_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc100                 normal  6692         0:52:51
57   52867      ada     BA_Seed_296_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc100                 normal  6692         0:52:51
58   52868      ada     BA_Seed_297_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
59   52869      ada     BA_Seed_298_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
60   52870      ada     BA_Seed_299_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
61   52871      ada     BA_Seed_300_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
62   52872      ada     BA_Seed_301_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
63   52873      ada     BA_Seed_302_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
64   52874      ada     BA_Seed_303_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
65   52876      ada     BA_Seed_305_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
66   52877      ada     BA_Seed_306_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
67   52878      ada     BA_Seed_307_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
68   52880      ada     BA_Seed_309_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
69   52881      ada     BA_Seed_310_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
70   52882      ada     BA_Seed_311_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
71   52883      ada     BA_Seed_312_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
72   52885      ada     BA_Seed_314_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
73   52886      ada     BA_Seed_315_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
74   52887      ada     BA_Seed_316_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
75   52889      ada     BA_Seed_318_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
76   52891      ada     BA_Seed_320_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
77   52892      ada     BA_Seed_321_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc101                 normal  6692         0:52:51
78   52894      ada     BA_Seed_323_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
79   52895      ada     BA_Seed_324_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
80   52896      ada     BA_Seed_325_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
81   52897      ada     BA_Seed_326_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
82   52898      ada     BA_Seed_327_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
83   52899      ada     BA_Seed_328_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
84   52900      ada     BA_Seed_329_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
85   52901      ada     BA_Seed_330_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
86   52902      ada     BA_Seed_331_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
87   52903      ada     BA_Seed_332_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
88   52904      ada     BA_Seed_333_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
89   52905      ada     BA_Seed_334_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
90   52906      ada     BA_Seed_335_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
91   52907      ada     BA_Seed_336_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
92   52908      ada     BA_Seed_337_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
93   52909      ada     BA_Seed_338_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
94   52910      ada     BA_Seed_339_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
95   52911      ada     BA_Seed_340_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
96   52912      ada     BA_Seed_341_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
97   52913      ada     BA_Seed_342_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
98   52914      ada     BA_Seed_343_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
99   52915      ada     BA_Seed_344_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
100  52916      ada     BA_Seed_345_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
101  52917      ada     BA_Seed_346_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
102  52918      ada     BA_Seed_347_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
103  52919      ada     BA_Seed_348_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
104  52920      ada     BA_Seed_349_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
105  52922      ada     BA_Seed_351_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
106  52923      ada     BA_Seed_352_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
107  52924      ada     BA_Seed_353_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
108  52925      ada     BA_Seed_354_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
109  52926      ada     BA_Seed_355_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
110  52927      ada     BA_Seed_356_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
111  52928      ada     BA_Seed_357_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
112  52929      ada     BA_Seed_358_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
113  52931      ada     BA_Seed_360_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
114  52932      ada     BA_Seed_361_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
115  52933      ada     BA_Seed_362_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
116  52934      ada     BA_Seed_363_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
117  52935      ada     BA_Seed_364_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
118  52936      ada     BA_Seed_365_63d1f7  bnseve001 neuroscience RUNNING       52:51   1     1    hpc102                 normal  6692         0:52:51
119  52850      ada     BA_Seed_279_63d1f7  bnseve001 neuroscience RUNNING       52:53   1     1    hpc100                 normal  6692         0:52:53
120  52851      ada     BA_Seed_280_63d1f7  bnseve001 neuroscience RUNNING       52:53   1     1    hpc100                 normal  6692         0:52:53
121  52853      ada     BA_Seed_282_63d1f7  bnseve001 neuroscience RUNNING       52:53   1     1    hpc100                 normal  6692         0:52:53
122  52848      ada     BA_Seed_277_63d1f7  bnseve001 neuroscience RUNNING       52:54   1     1    hpc100                 normal  6692         0:52:54
123  52849      ada     BA_Seed_278_63d1f7  bnseve001 neuroscience RUNNING       52:54   1     1    hpc100                 normal  6692         0:52:54
124  51651      l40s    TinySTorY           nvcela001 l40sfree     RUNNING       57:23   10(4) 1    gpu014                 l40sfree7536         9:33:50
125  52759      l40s    Translation         nvcela001 l40sfree     RUNNING       57:23   10(4) 1    gpu015                 l40sfree7536         9:33:50
126  52973      l40s    SALLM               anxtem001 l40sfree     RUNNING       37:32   10(4) 1    gpu013                 l40sfree7532         6:15:20
127  52760      l40s    Translation         nvcela001 l40sfree     RUNNING       52:51   10(4) 1    gpu012                 l40sfree7520         8:48:30
128  52971      l40s    cc100               gmdsbo006 l40sfree     RUNNING       47:08   10    1    gpu012                 l40sfree7050         7:51:20
129  52975      l40s    SALLM               anxtem001 l40sfree     PENDING       35:11   10(4) 1    AssocGrpGRES           l40sfree7540                
130  52976      l40s    SALLM               anxtem001 l40sfree     PENDING       34:49   10(4) 1    AssocGrpGRES           l40sfree7540                
131  51035      swan    cyl                 iklray001 mecheng      RUNNING       57:23   40    1    hpc207                 normal  10465      1-14:15:20

CLUSTER STATUS
PARTITION AVAIL   NODES  STATE NODELIST
ada*         up       4    mix srvrochpc[100-103]
ada*         up      12   idle srvrochpc[104-115]
l40s         up       4    mix srvrocgpu[012-015]
swan         up       1  alloc srvrochpc207
swan         up       7   idle srvrochpc[218-224]

PartitionName=ada
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=YES QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrochpc[100-115]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=768 TotalNodes=16 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=8000 MaxMemPerCPU=8000
    TRES=cpu=768,mem=6000G,node=16,billing=1368
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=l40s
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrocgpu[012-015]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=192 TotalNodes=4 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=10000 MaxMemPerCPU=10000
    TRES=cpu=192,mem=2000G,node=4,billing=392,gres/gpu=16,gres/gpu:l40s=16
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=swan
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=UNLIMITED MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
    Nodes=srvrochpc[207,218-224]
    PriorityJobFactor=30 PriorityTier=30 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=320 TotalNodes=8 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=9000 MaxMemPerCPU=9000
    TRES=cpu=320,mem=3000G,node=8,billing=620
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 


WORKER NODE STATUS
NodeName=srvrochpc100 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=42 CPUEfctv=48 CPUTot=48 CPULoad=40.75
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc100 NodeHostName=srvrochpc100 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=354304 FreeMem=35306 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:19:48 SlurmdStartTime=2024-11-14T12:28:23
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=42,mem=346G
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      52839 01465760 'boot_threshold' hpc100   
      52980 nvcela001 'bash' hpc100   
      52662 vhrdew002 'Opt_P' hpc100   
      52984 bnseve001 'BA_Seed_400_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_15-48-41' hpc100   
      52985 bnseve001 'BAUCB_Seed_201_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_15-48-41' hpc100   
      52983 bnseve001 'BA_Seed_399_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_15-48-41' hpc100   
      52981 bnseve001 'BA_Seed_398_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_15-43-31' hpc100   
      52977 bnseve001 'BA_Seed_397_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_15-33-22' hpc100   
      52854 bnseve001 'BA_Seed_283_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-08' hpc100   
      52855 bnseve001 'BA_Seed_284_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc100   
      52856 bnseve001 'BA_Seed_285_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc100   
      52858 bnseve001 'BA_Seed_287_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc100   
      52859 bnseve001 'BA_Seed_288_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc100   
      52861 bnseve001 'BA_Seed_290_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc100   
      52863 bnseve001 'BA_Seed_292_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc100   
      52864 bnseve001 'BA_Seed_293_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc100   
      52865 bnseve001 'BA_Seed_294_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc100   
      52866 bnseve001 'BA_Seed_295_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc100   
      52867 bnseve001 'BA_Seed_296_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc100   
      52850 bnseve001 'BA_Seed_279_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-08' hpc100   
      52851 bnseve001 'BA_Seed_280_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-08' hpc100   
      52853 bnseve001 'BA_Seed_282_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-08' hpc100   
      52848 bnseve001 'BA_Seed_277_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-08' hpc100   
      52849 bnseve001 'BA_Seed_278_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-08' hpc100   

NodeName=srvrochpc101 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=45 CPUEfctv=48 CPUTot=48 CPULoad=35.39
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc101 NodeHostName=srvrochpc101 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=378304 FreeMem=44913 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:21:51 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=45,mem=378304M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      52667 vhrdew002 'Opt_A' hpc101   
      52844 bndlev001 'PPO_Training_Simple' hpc101   
      52986 bnseve001 'BAUCB_Seed_202_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_15-48-41' hpc101   
      52987 bnseve001 'BAUCB_Seed_203_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_15-48-41' hpc101   
      52988 bnseve001 'BAUCB_Seed_204_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_15-48-41' hpc101   
      52989 bnseve001 'BAUCB_Seed_205_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_15-48-41' hpc101   
      52990 bnseve001 'BAUCB_Seed_206_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_15-48-41' hpc101   
      52868 bnseve001 'BA_Seed_297_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52869 bnseve001 'BA_Seed_298_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52870 bnseve001 'BA_Seed_299_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52871 bnseve001 'BA_Seed_300_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52872 bnseve001 'BA_Seed_301_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52873 bnseve001 'BA_Seed_302_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52874 bnseve001 'BA_Seed_303_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52876 bnseve001 'BA_Seed_305_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52877 bnseve001 'BA_Seed_306_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52878 bnseve001 'BA_Seed_307_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52880 bnseve001 'BA_Seed_309_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52881 bnseve001 'BA_Seed_310_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52882 bnseve001 'BA_Seed_311_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52883 bnseve001 'BA_Seed_312_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52885 bnseve001 'BA_Seed_314_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52886 bnseve001 'BA_Seed_315_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52887 bnseve001 'BA_Seed_316_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-09' hpc101   
      52889 bnseve001 'BA_Seed_318_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc101   
      52891 bnseve001 'BA_Seed_320_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc101   
      52892 bnseve001 'BA_Seed_321_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc101   

NodeName=srvrochpc102 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=45 CPUEfctv=48 CPUTot=48 CPULoad=46.83
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc102 NodeHostName=srvrochpc102 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=360000 FreeMem=7777 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:31:42 SlurmdStartTime=2024-11-14T12:28:23
   LastBusyTime=2024-11-21T14:56:08 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=45,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      52938 bnseve001 'BA_Seed_367_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52939 bnseve001 'BA_Seed_368_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52940 bnseve001 'BA_Seed_369_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52937 bnseve001 'BA_Seed_366_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52894 bnseve001 'BA_Seed_323_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52895 bnseve001 'BA_Seed_324_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52896 bnseve001 'BA_Seed_325_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52897 bnseve001 'BA_Seed_326_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52898 bnseve001 'BA_Seed_327_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52899 bnseve001 'BA_Seed_328_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52900 bnseve001 'BA_Seed_329_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52901 bnseve001 'BA_Seed_330_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52902 bnseve001 'BA_Seed_331_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52903 bnseve001 'BA_Seed_332_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52904 bnseve001 'BA_Seed_333_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52905 bnseve001 'BA_Seed_334_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52906 bnseve001 'BA_Seed_335_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52907 bnseve001 'BA_Seed_336_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52908 bnseve001 'BA_Seed_337_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52909 bnseve001 'BA_Seed_338_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52910 bnseve001 'BA_Seed_339_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52911 bnseve001 'BA_Seed_340_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52912 bnseve001 'BA_Seed_341_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52913 bnseve001 'BA_Seed_342_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52914 bnseve001 'BA_Seed_343_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52915 bnseve001 'BA_Seed_344_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52916 bnseve001 'BA_Seed_345_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52917 bnseve001 'BA_Seed_346_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52918 bnseve001 'BA_Seed_347_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52919 bnseve001 'BA_Seed_348_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-10' hpc102   
      52920 bnseve001 'BA_Seed_349_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52922 bnseve001 'BA_Seed_351_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52923 bnseve001 'BA_Seed_352_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52924 bnseve001 'BA_Seed_353_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52925 bnseve001 'BA_Seed_354_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52926 bnseve001 'BA_Seed_355_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52927 bnseve001 'BA_Seed_356_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52928 bnseve001 'BA_Seed_357_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52929 bnseve001 'BA_Seed_358_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52931 bnseve001 'BA_Seed_360_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52932 bnseve001 'BA_Seed_361_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52933 bnseve001 'BA_Seed_362_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52934 bnseve001 'BA_Seed_363_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52935 bnseve001 'BA_Seed_364_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   
      52936 bnseve001 'BA_Seed_365_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc102   

NodeName=srvrochpc103 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=36 CPUEfctv=48 CPUTot=48 CPULoad=37.32
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc103 NodeHostName=srvrochpc103 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=288000 FreeMem=5323 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-20T10:31:40 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:54:11 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=cpu=36,mem=288000M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      52968 chwsom002 'I_v1_comp' hpc103   
      52941 bnseve001 'BA_Seed_370_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc103   
      52942 bnseve001 'BA_Seed_371_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc103   
      52943 bnseve001 'BA_Seed_372_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc103   
      52944 bnseve001 'BA_Seed_373_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc103   
      52945 bnseve001 'BA_Seed_374_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc103   
      52946 bnseve001 'BA_Seed_375_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-11' hpc103   
      52947 bnseve001 'BA_Seed_376_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52948 bnseve001 'BA_Seed_377_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52949 bnseve001 'BA_Seed_378_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52950 bnseve001 'BA_Seed_379_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52951 bnseve001 'BA_Seed_380_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52952 bnseve001 'BA_Seed_381_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52953 bnseve001 'BA_Seed_382_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52954 bnseve001 'BA_Seed_383_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52956 bnseve001 'BA_Seed_385_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52957 bnseve001 'BA_Seed_386_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52958 bnseve001 'BA_Seed_387_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52959 bnseve001 'BA_Seed_388_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52960 bnseve001 'BA_Seed_389_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52961 bnseve001 'BA_Seed_390_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52962 bnseve001 'BA_Seed_391_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52963 bnseve001 'BA_Seed_392_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52964 bnseve001 'BA_Seed_393_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52965 bnseve001 'BA_Seed_394_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52966 bnseve001 'BA_Seed_395_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   
      52967 bnseve001 'BA_Seed_396_63d1f770170e4acd14a7252ad08d0674_Grid10_Hor5_Hill55_Start76_Food10_40_72_97_Water27_87_32_61_Sleep11_80_20_48_2024-11-21_14-58-12' hpc103   

NodeName=srvrochpc104 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc104 NodeHostName=srvrochpc104 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=88194 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:42:25 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc105 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc105 NodeHostName=srvrochpc105 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=125298 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:28:41 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc106 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc106 NodeHostName=srvrochpc106 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=68491 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:27:19 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc107 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc107 NodeHostName=srvrochpc107 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=45174 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:27:12 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc108 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc108 NodeHostName=srvrochpc108 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=177437 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:19:21 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc109 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc109 NodeHostName=srvrochpc109 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=141038 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:19:09 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc110 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc110 NodeHostName=srvrochpc110 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=188958 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:05:25 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc111 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.09
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc111 NodeHostName=srvrochpc111 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=280947 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:05:01 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc112 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc112 NodeHostName=srvrochpc112 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=279438 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:03:49 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc113 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc113 NodeHostName=srvrochpc113 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=287479 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T14:02:56 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc114 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc114 NodeHostName=srvrochpc114 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=2227 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T13:52:51 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc115 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=0 CPUEfctv=48 CPUTot=48 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc115 NodeHostName=srvrochpc115 Version=23.11.5
   OS=Linux 5.14.0-427.24.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jul 8 17:47:19 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=316259 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2024-08-19T13:45:20 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=375G,billing=85
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc207 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUEfctv=40 CPUTot=40 CPULoad=40.64
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc207 NodeHostName=srvrochpc207 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=360000 FreeMem=360485 Sockets=2 Boards=1
   State=allocated  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-13T18:57:00 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      51035 iklray001 'cyl' hpc207   

NodeName=srvrochpc218 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc218 NodeHostName=srvrochpc218 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371498 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-13T19:39:08 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc219 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc219 NodeHostName=srvrochpc219 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371543 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-14T09:20:53 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc220 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.09
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc220 NodeHostName=srvrochpc220 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371506 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-14T12:14:48 SlurmdStartTime=2024-11-14T12:52:52
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc221 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc221 NodeHostName=srvrochpc221 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371564 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-14T08:35:02 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc222 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.11
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc222 NodeHostName=srvrochpc222 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=371579 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-14T08:35:34 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc223 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc223 NodeHostName=srvrochpc223 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=372454 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-07T15:27:10 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrochpc224 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=0 CPUEfctv=40 CPUTot=40 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvrochpc224 NodeHostName=srvrochpc224 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=384000 AllocMem=0 FreeMem=372509 Sockets=2 Boards=1
   State=idle ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=swan 
   BootTime=2024-11-07T22:26:17 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:36 ResumeAfterTime=None
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE

NodeName=srvrocgpu012 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=20 CPUEfctv=48 CPUTot=48 CPULoad=2.72
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu012 NodeHostName=srvrocgpu012 Version=23.11.5
   OS=Linux 5.14.0-427.35.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 18:24:53 UTC 2024 
   RealMemory=512000 AllocMem=200000 FreeMem=268382 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2024-11-01T11:55:41 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:58:11 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=cpu=20,mem=200000M,gres/gpu=4,gres/gpu:l40s=4
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      52760 nvcela001 'Translation' gpu012   
      52971 gmdsbo006 'cc100' gpu012   

NodeName=srvrocgpu013 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=10 CPUEfctv=48 CPUTot=48 CPULoad=4.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu013 NodeHostName=srvrocgpu013 Version=23.11.5
   OS=Linux 5.14.0-427.35.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 18:24:53 UTC 2024 
   RealMemory=512000 AllocMem=100000 FreeMem=350058 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2024-11-01T11:55:59 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T15:02:47 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=cpu=10,mem=100000M,gres/gpu=4,gres/gpu:l40s=4
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      52973 anxtem001 'SALLM' gpu013   

NodeName=srvrocgpu014 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=10 CPUEfctv=48 CPUTot=48 CPULoad=1.00
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu014 NodeHostName=srvrocgpu014 Version=23.11.5
   OS=Linux 5.14.0-427.35.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 18:24:53 UTC 2024 
   RealMemory=512000 AllocMem=100000 FreeMem=411415 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2024-11-01T11:58:50 SlurmdStartTime=2024-11-14T12:28:21
   LastBusyTime=2024-11-21T14:53:37 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=cpu=10,mem=100000M,gres/gpu=4,gres/gpu:l40s=4
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      51651 nvcela001 'TinySTorY' gpu014   

NodeName=srvrocgpu015 Arch=x86_64 CoresPerSocket=24 
   CPUAlloc=10 CPUEfctv=48 CPUTot=48 CPULoad=1.67
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:l40s:4
   NodeAddr=srvrocgpu015 NodeHostName=srvrocgpu015 Version=23.11.5
   OS=Linux 5.14.0-427.42.1.el9_4.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Oct 31 14:01:51 UTC 2024 
   RealMemory=512000 AllocMem=100000 FreeMem=446934 Sockets=2 Boards=1
   State=mixed  ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=l40s 
   BootTime=2024-11-19T11:51:56 SlurmdStartTime=2024-11-19T12:56:54
   LastBusyTime=2024-11-21T14:53:37 ResumeAfterTime=None
   CfgTRES=cpu=48,mem=500G,billing=98,gres/gpu=4,gres/gpu:l40s=4
   AllocTRES=cpu=10,mem=100000M,gres/gpu=4,gres/gpu:l40s=4
   CapWatts=n/a
   CurrentWatts=0 AveWatts=0
   ExtSensorsJoules=n/a ExtSensorsWatts=0 ExtSensorsTemp=n/a
   CORE USAGE
      52759 nvcela001 'Translation' gpu015