slurm_report_one

CS SLURM Cluster Report - 1 Week

CS SLURM Cluster Report - 1 Week

Report generated for jobs run on the CS SLURM cluster from 2024-11-03 through 2024-11-09.

Job total during this query range: 1,980

Job total since August 1st 2024: 607,152

This page is updated every Sunday at 5:00pm EST.

SLURM Scheduler System Output

--------------------------------------------------------------------------------
Cluster Utilization 2024-11-03T00:00:00 - 2024-11-09T23:59:59
Usage reported in TRES Hours/Percentage of Total
--------------------------------------------------------------------------------
  Cluster      TRES Name              Allocated                 Down         PLND Down                    Idle           Planned                Reported 
--------- -------------- ---------------------- -------------------- ----------------- ----------------------- ----------------- ----------------------- 
       cs            cpu         121581(16.09%)          8079(1.07%)          0(0.00%)          606447(80.25%)      19557(2.59%)          755664(99.41%) 
       cs            mem      802193555(13.57%)      16735467(0.28%)          0(0.00%)      5090638979(86.14%)          0(0.00%)      5909568000(99.41%) 
       cs       gres/gpu          15306(44.01%)             0(0.00%)          0(0.00%)           19470(55.99%)          0(0.00%)           34776(99.41%) 

* Total Cluster Resources Avaialble by Partition
 (Note, TRES is short for Trackable RESources)
PartitionName=cpu
   TRES=cpu=1494,mem=12594000M,node=41
PartitionName=gpu
   TRES=cpu=2226,mem=19710000M,node=37,gres/gpu=159
PartitionName=nolim
   TRES=cpu=354,mem=864000M,node=7
PartitionName=gnolim
   TRES=cpu=424,mem=2008000M,node=16,gres/gpu=48

SLURM Usage by Partition

PartitionName	total_jobs	cputime(HH:MM:SS)	completed	cancelled	failed	timeout	out_of_memory
gpu	1081	102963:49:44	429	216	412	9	15
cpu	312	11508:28:23	242	24	38	0	8
gnolim	572	5815:05:30	156	156	259	0	1
nolim	15	39:43:26	10	1	3	0	1

SLURM Usage by Advisor Group

slurm-cs-undefined, users that have CS accounts but are not CS students
slurm-cs-unassigned, users that are CS students but do not have a listed CS advisor

^GroupName^total_jobs^cputime(HH:MM:SS)^cpu^gpu^nolim^gnolim^completed^cancelled^running^failed^preempted^requeued^pending^timeout^out_of_memory^suspended^boot_fail^deadline^node_fail^resizing^revoked^

slurm-cs-tianhao-wang	99	40287:07:48	0	71	0	28	22	39	37	1	0
slurm-cs-zezhou-cheng	48	24789:24:46	0	48	0	0	8	16	24	0	0
slurm-cs-yu-meng	3	24100:55:28	0	3	0	0	1	0	0	2	0
slurm-cs-chen-yu-wei	191	10091:36:32	191	0	0	0	171	0	20	0	0
slurm-cs-lu-feng	672	6818:40:14	0	499	0	173	259	132	281	0	0
slurm-cs-hongning-wang	3	6481:27:28	0	3	0	0	1	0	1	1	0
slurm-cs-madhur-behl	23	1782:46:54	7	14	0	2	16	6	1	0	0
slurm-cs-farzad-farnoud	9	1651:31:12	0	9	0	0	4	3	1	0	1
slurm-cs-kevin-skadron	280	1343:53:56	68	202	10	0	189	31	56	3	1
slurm-cs-daniel-graham	43	995:10:34	18	25	0	0	29	7	7	0	0
slurm-cs-adwait-jog	41	542:39:39	26	14	1	0	12	7	6	0	16
slurm-cs-yen-ling-kuo	9	407:11:02	0	9	0	0	4	1	3	0	1
slurm-cs-shangtong-zhang	6	305:54:24	2	4	0	0	2	1	3	0	0
slurm-cs-ferdinando-fioretto	7	289:39:36	0	7	0	0	0	0	4	2	1
slurm-cs-sebastian-elbaum	92	207:30:38	0	58	0	34	29	0	61	0	2
slurm-cs-undefined	390	174:20:54	0	51	4	335	87	142	161	0	0
slurm-cs-geoffrey-fox	6	45:08:00	0	6	0	0	3	1	2	0	0
slurm-cs-mary-lou-soffa	58	12:07:58	0	58	0	0	0	11	44	0	3

SLURM Usage by NodeName

Nodename	total_jobs	cputime(HH:MM:SS)	completed	cancelled	failed	timeout	out_of_memory
serval01	6	30582:22:56	2	0	1	3	0
cheetah06	48	24789:24:46	8	16	24	0	0
jaguar01	7	6092:18:08	0	7	0	0	0
jaguar04	7	5877:27:28	0	7	0	0	0
jaguar03	44	5085:27:26	18	5	21	0	0
puma02	25	4967:54:08	5	6	11	2	1
lotus	73	4259:43:22	22	18	30	0	3
cortado08	70	3895:28:58	61	0	9	0	0
cortado01	72	3849:43:02	65	0	7	0	0
sds01	20	3084:40:54	4	8	8	0	0
sds02	24	2999:10:04	0	13	11	0	0
cheetah04	29	2543:02:56	19	6	2	1	1
bigcat01	39	1417:38:36	31	1	7	0	0
lynx08	37	1135:57:38	32	0	5	0	0
ai01	11	1083:12:16	1	6	4	0	0
lynx02	13	969:18:52	0	0	12	0	1
ai02	5	967:56:32	0	1	4	0	0
ai04	5	966:10:08	0	1	4	0	0
ai03	5	955:02:00	0	1	4	0	0
lynx01	6	915:53:10	1	0	5	0	0
jaguar02	60	913:35:44	19	9	31	1	0
jaguar05	44	905:53:36	25	6	12	0	1
cheetah02	36	841:26:28	11	4	19	0	2
cheetah01	31	822:46:24	13	8	10	0	0
lynx05	8	754:16:54	1	2	5	0	0
lynx03	5	741:35:20	0	1	3	0	1
lynx04	5	721:55:58	0	0	3	0	2
ai05	71	681:21:48	21	25	25	0	0
affogato13	39	533:25:42	9	10	20	0	0
affogato11	40	520:59:00	8	10	21	0	1
affogato14	32	518:24:52	8	10	14	0	0
puma01	16	469:43:28	13	3	0	0	0
affogato15	28	466:06:38	8	8	12	0	0
jaguar06	47	420:44:08	10	6	31	0	0
adriatic01	32	363:50:12	21	4	7	0	0
ai06	57	355:36:50	17	17	23	0	0
ai07	28	321:53:46	13	0	15	0	0
ai08	19	320:32:46	11	2	6	0	0
adriatic03	28	306:53:22	20	4	4	0	0
panther01	39	299:05:38	28	7	3	0	1
adriatic02	29	293:01:14	21	4	4	0	0
affogato04	2	243:10:30	1	1	0	0	0
cheetah05	167	225:03:10	135	15	15	2	0
cheetah03	24	201:44:58	10	3	11	0	0
adriatic04	20	194:05:42	13	4	3	0	0
lynx12	17	189:01:48	0	4	13	0	0
lynx11	17	188:26:00	0	4	13	0	0
lynx10	17	187:30:50	0	4	13	0	0
lynx06	11	148:16:36	1	5	4	0	1
lynx07	9	140:55:32	0	4	4	0	1
adriatic05	10	103:12:22	9	1	0	0	0
adriatic06	13	93:53:04	8	0	5	0	0
slurm1	4	75:59:29	1	1	0	0	2
ai09	46	58:46:42	14	16	16	0	0
slurm4	2	45:32:44	0	1	0	0	1
titanx04	26	28:07:46	11	8	7	0	0
affogato10	2	26:21:56	0	1	0	0	1
heartpiece	4	23:08:30	2	1	0	0	1
titanx03	38	19:02:40	8	8	22	0	0
slurm2	9	18:51:50	3	5	0	0	1
titanx05	36	16:51:08	10	8	18	0	0
doppio03	1	16:30:48	1	0	0	0	0
hydro	3	14:28:16	3	0	0	0	0
jinx01	60	11:37:28	13	19	28	0	0
jinx02	60	11:09:02	13	16	31	0	0
ai10	49	10:52:52	16	16	17	0	0
titanx02	47	06:51:46	8	8	30	0	1
cortado09	2	05:18:58	2	0	0	0	0
struct08	3	05:15:30	0	3	0	0	0
cortado10	2	03:10:36	0	1	0	0	1
slurm5	1	02:41:12	0	0	0	0	1
doppio04	1	00:03:36	0	0	1	0	0
epona	6	00:00:30	6	0	0	0	0
affogato02	1	00:00:02	1	0	0	0	0
doppio05	1	00:00:02	1	0	0	0	0
struct02	1	00:00:00	1	0	0	0	0
cortado03	1	00:00:00	0	0	1	0	0
cortado05	1	00:00:00	0	0	1	0	0
cortado07	1	00:00:00	0	0	1	0	0
affogato01	0	00:00:00	0	0	0	0	0
affogato03	0	00:00:00	0	0	0	0	0
affogato05	0	00:00:00	0	0	0	0	0
affogato06	0	00:00:00	0	0	0	0	0
affogato07	0	00:00:00	0	0	0	0	0
affogato08	0	00:00:00	0	0	0	0	0
affogato09	0	00:00:00	0	0	0	0	0
cortado02	0	00:00:00	0	0	0	0	0
cortado04	0	00:00:00	0	0	0	0	0
cortado06	0	00:00:00	0	0	0	0	0
doppio01	0	00:00:00	0	0	0	0	0
doppio02	0	00:00:00	0	0	0	0	0
lynx09	0	00:00:00	0	0	0	0	0
slurm3	0	00:00:00	0	0	0	0	0
struct01	0	00:00:00	0	0	0	0	0
struct03	0	00:00:00	0	0	0	0	0
struct04	0	00:00:00	0	0	0	0	0
struct05	0	00:00:00	0	0	0	0	0
struct06	0	00:00:00	0	0	0	0	0
struct07	0	00:00:00	0	0	0	0	0
struct09	0	00:00:00	0	0	0	0	0
struct10	0	00:00:00	0	0	0	0	0

Table of Contents

CS SLURM Cluster Report - 1 Week

SLURM Scheduler System Output

SLURM Usage by Partition

SLURM Usage by Advisor Group

SLURM Usage by NodeName