slurm_report_eight_weeks

CS SLURM Cluster Report - 8 /weeks

Report generated for jobs run on the CS SLURM cluster from 2024-10-27 through 2024-12-21.

Job total during this query range: 521,294

Job total since August 1st 2024: 1,112,951

This page is updated every Sunday at 5:00pm EST.

SLURM Scheduler System Output

--------------------------------------------------------------------------------
Cluster Utilization 2024-10-27T00:00:00 - 2024-12-21T23:59:59
Usage reported in TRES Hours/Percentage of Total
--------------------------------------------------------------------------------
  Cluster      TRES Name               Allocated                  Down         PLND Down                     Idle             Planned                 Reported 
--------- -------------- ----------------------- --------------------- ----------------- ------------------------ ------------------- ------------------------ 
       cs            cpu         1181784(19.55%)          48757(0.81%)          0(0.00%)          4464227(73.85%)       350544(5.80%)          6045312(99.93%) 
       cs            mem      7272379868(14.01%)      208997344(0.40%)          0(0.00%)      44442259985(85.59%)            0(0.00%)      51923637197(99.74%) 
       cs       gres/gpu          105379(37.88%)            169(0.06%)          0(0.00%)           172660(62.06%)            0(0.00%)           278208(99.93%) 

* Total Cluster Resources Avaialble by Partition
 (Note, TRES is short for Trackable RESources)
PartitionName=cpu
   TRES=cpu=1804,mem=20094000M,node=46
PartitionName=gpu
   TRES=cpu=2226,mem=19710000M,node=37,gres/gpu=159
PartitionName=nolim
   TRES=cpu=44,mem=224000M,node=2
PartitionName=gnolim
   TRES=cpu=424,mem=2008000M,node=16,gres/gpu=48

SLURM Usage by Partition

PartitionName	total_jobs	cputime(HH:MM:SS)	completed	cancelled	running	failed	timeout	out_of_memory	node_fail
gpu	31935	832313:27:58	14654	3754	0	13238	93	190	6
cpu	485918	296464:31:29	454053	1561	0	29515	553	236	0
gnolim	3330	41245:42:28	1474	865	1	972	13	5	0
nolim	111	4232:16:16	56	36	0	18	0	1	0

SLURM Usage by Advisor Group

slurm-cs-undefined, users that have CS accounts but are not CS students
slurm-cs-unassigned, users that are CS students but do not have a listed CS advisor

GroupName	total_jobs	cputime(HH:MM:SS)	cpu	gpu	nolim	gnolim	completed	cancelled	running	failed	timeout	out_of_memory	node_fail
slurm-cs-lu-feng	7001	357677:31:28	0	5784	0	1217	2009	2733	0	2207	0	52	0
slurm-cs-chen-yu-wei	445050	226634:11:51	445050	0	0	0	415748	309	0	28496	496	1	0
slurm-cs-yu-meng	53	173048:49:30	0	53	0	0	10	14	0	5	21	0	3
slurm-cs-tianhao-wang	453	101042:29:50	0	370	0	83	156	164	0	113	11	9	0
slurm-cs-undefined	55097	81700:39:28	36865	16656	4	1572	47062	1756	0	6011	5	261	2
slurm-cs-zezhou-cheng	116	76957:19:58	0	116	0	0	51	26	0	38	1	0	0
slurm-cs-hongning-wang	27	44048:10:40	0	27	0	0	7	8	0	1	10	0	1
slurm-cs-shangtong-zhang	45	24067:12:38	16	29	0	0	5	6	0	21	10	3	0
slurm-cs-adwait-jog	966	14841:41:23	473	198	15	280	371	469	1	90	15	20	0
slurm-cs-kevin-skadron	5435	13947:20:48	3134	2265	34	2	3793	362	0	1223	15	42	0
slurm-cs-yen-ling-kuo	139	11330:01:12	52	87	0	0	68	26	0	32	10	3	0
slurm-cs-madhur-behl	224	9405:44:28	63	79	58	24	82	54	0	68	6	14	0
slurm-cs-panagiotis-apostolellis	37	8101:33:59	37	0	0	0	7	2	0	10	18	0	0
slurm-cs-daniel-graham	150	6364:26:06	18	132	0	0	122	7	0	17	4	0	0
slurm-cs-unassigned	44	6066:36:58	5	39	0	0	14	8	0	16	3	3	0
slurm-cs-haiying-shen	319	5761:48:18	19	300	0	0	316	3	0	0	0	0	0
slurm-cs-farzad-farnoud	34	5640:21:26	0	34	0	0	7	16	0	6	0	5	0
slurm-cs-sebastian-elbaum	446	2905:08:28	103	230	0	113	207	26	0	204	2	7	0
slurm-cs-yangfeng-ji	5043	1827:09:32	80	4963	0	0	52	64	0	4898	28	1	0
slurm-cs-rich-nguyen	42	1196:12:36	0	3	0	39	6	0	0	35	1	0	0
slurm-cs-ferdinando-fioretto	157	865:50:36	2	155	0	0	14	108	0	31	2	2	0
slurm-cs-judy-fox	112	215:58:26	0	112	0	0	54	15	0	43	0	0	0
slurm-cs-mary-lou-soffa	171	210:37:18	0	171	0	0	38	32	0	95	0	6	0
slurm-cs-geoffrey-fox	25	192:05:16	0	25	0	0	4	4	0	13	1	3	0
slurm-cs-xiaozhu-lin	53	177:58:54	0	53	0	0	15	4	0	34	0	0	0
slurm-cs-matthew-dwyer	5	11:31:44	0	5	0	0	2	0	0	3	0	0	0
slurm-cs-yixin-sun	25	09:14:00	0	25	0	0	7	0	0	18	0	0	0
slurm-cs-miaomiao-zhang	18	07:12:42	0	18	0	0	7	0	0	11	0	0	0
slurm-cs-david-evans	2	00:47:06	0	2	0	0	0	0	0	2	0	0	0
slurm-cs-yue-cheng	4	00:11:30	0	4	0	0	2	0	0	2	0	0	0
slurm-cs-aidong-zhang	1	00:00:02	1	0	0	0	1	0	0	0	0	0	0

SLURM Usage by NodeName

Nodename	total_jobs	cputime(HH:MM:SS)	completed	cancelled	running	failed	timeout	out_of_memory	node_fail
serval01	68	186399:03:22	14	20	0	5	21	4	4
cheetah06	384	99242:50:26	187	77	0	107	9	4	0
jaguar03	2000	63604:34:38	573	214	0	1190	12	11	0
cheetah04	288	51885:50:10	97	35	0	147	6	1	2
puma01	27852	36632:47:02	25951	95	0	1796	0	10	0
lotus	1218	32178:08:18	630	163	0	402	3	20	0
bigcat01	17363	27653:21:32	14209	223	0	2757	162	12	0
cortado08	120726	25548:38:14	117939	52	0	2654	74	7	0
jaguar01	196	25333:29:52	89	65	0	29	8	5	0
sds01	1457	24765:11:52	624	191	0	636	2	4	0
lynx08	26550	24304:25:14	23911	43	0	2522	62	12	0
cortado01	129676	24102:36:26	126896	74	0	2637	64	5	0
affogato02	18576	23445:57:06	15518	53	0	2979	22	4	0
jaguar04	283	21734:27:32	109	74	0	80	3	17	0
sds02	2433	20704:51:06	817	218	0	1394	1	3	0
affogato13	961	19499:18:56	340	128	0	490	1	2	0
lynx09	14225	18597:05:48	11932	51	0	2181	59	2	0
adriatic01	1157	15513:46:22	591	137	0	428	1	0	0
adriatic02	902	15065:04:54	553	106	0	243	0	0	0
cheetah05	2168	14676:10:54	1647	100	0	409	11	1	0
adriatic03	838	14516:06:14	550	93	0	195	0	0	0
affogato14	937	14480:50:28	330	143	0	463	0	1	0
affogato04	10146	14460:51:18	8613	45	0	1468	16	4	0
lynx11	744	14379:05:58	222	116	0	403	0	3	0
affogato11	931	14291:48:22	330	122	0	476	1	2	0
lynx10	571	14201:04:12	157	112	0	302	0	0	0
cheetah02	820	13916:52:50	351	100	0	365	2	2	0
affogato01	12511	13653:47:22	10146	40	0	2313	9	3	0
lynx12	765	12861:28:50	216	109	0	440	0	0	0
jaguar02	2374	12676:12:32	1123	209	0	1030	4	8	0
cheetah01	934	12326:48:52	494	136	0	265	1	38	0
cheetah03	768	11884:09:38	354	81	0	333	0	0	0
lynx01	396	11468:43:56	186	69	0	139	0	2	0
adriatic05	703	11158:00:08	495	65	0	142	1	0	0
lynx05	326	11049:59:28	154	55	0	116	0	1	0
lynx02	343	10711:28:10	161	53	0	127	0	2	0
lynx06	368	10149:00:52	200	58	0	107	0	3	0
affogato15	900	9499:03:08	336	106	0	458	0	0	0
lynx04	351	9225:27:28	177	57	0	114	0	3	0
adriatic06	649	9212:05:14	470	63	0	116	0	0	0
adriatic04	651	9013:43:06	454	58	0	139	0	0	0
lynx03	299	8244:16:52	138	45	0	112	1	3	0
lynx07	376	8043:40:26	197	49	0	127	0	3	0
jaguar06	1448	7842:50:28	495	98	0	835	1	19	0
puma02	750	7596:55:20	227	154	0	344	2	23	0
bigcat02	6371	6351:23:56	4802	5	0	1552	12	0	0
jaguar05	1291	6349:28:56	591	161	0	530	2	7	0
affogato06	4782	5899:19:34	4103	14	0	652	6	7	0
cortado09	1863	5823:21:46	1758	43	0	55	2	5	0
affogato07	4614	5800:42:24	3866	19	0	719	3	7	0
affogato08	4573	5793:51:26	3852	14	0	692	7	8	0
affogato10	4493	5642:14:36	3840	15	0	630	5	3	0
affogato09	4477	5622:57:26	3745	16	0	704	3	9	0
bigcat06	46858	4724:19:04	46579	8	0	267	4	0	0
panther01	1281	4294:29:14	1138	96	0	32	3	12	0
bigcat03	4536	4212:49:20	3131	1	0	1395	9	0	0
cortado10	2187	4004:50:22	1759	30	0	385	3	10	0
ai07	230	3754:20:52	117	59	0	53	1	0	0
ai05	205	3624:38:56	92	55	0	55	3	0	0
hydro	3619	3619:04:08	3493	89	0	17	12	8	0
ai02	136	3553:04:44	59	32	0	45	0	0	0
ai08	248	3355:06:28	107	74	0	66	0	1	0
ai03	115	3299:30:20	55	25	0	35	0	0	0
ai10	236	3164:10:54	108	87	0	41	0	0	0
slurm1	1485	3104:49:19	1344	61	0	72	2	6	0
ai01	126	3090:18:58	66	11	0	48	1	0	0
jinx01	412	3040:23:00	191	86	1	132	2	0	0
ai04	126	2894:55:44	54	43	0	29	0	0	0
ai09	302	2801:45:26	126	97	0	79	0	0	0
heartpiece	43	2708:18:28	13	25	0	4	0	1	0
ai06	209	2382:44:26	80	52	0	76	1	0	0
jinx02	321	2290:12:44	134	81	0	103	2	1	0
slurm3	1188	2228:27:10	1083	40	0	59	1	5	0
slurm4	1200	1927:45:50	1085	44	0	61	0	10	0
titanx02	181	1877:46:32	70	47	0	60	2	2	0
cortado06	1246	1563:54:58	1146	20	0	68	0	12	0
cortado02	1316	1556:03:46	1202	44	0	65	0	5	0
cortado03	1312	1546:59:40	1192	48	0	69	0	3	0
cortado04	1277	1425:16:22	1167	33	0	69	0	8	0
cortado05	1249	1408:15:36	1155	25	0	65	0	4	0
cortado07	1180	1357:01:02	1068	13	0	89	0	10	0
affogato05	1502	1127:40:44	1445	27	0	29	1	0	0
epona	17	831:48:44	12	5	0	0	0	0	0
struct01	474	774:08:12	449	11	0	13	0	1	0
struct03	222	747:46:22	195	10	0	14	0	3	0
struct09	415	742:47:04	381	17	0	13	0	4	0
titanx03	180	735:38:08	84	46	0	48	1	1	0
struct08	415	722:40:18	379	20	0	13	0	3	0
struct02	333	707:50:06	305	11	0	13	0	4	0
titanx04	127	694:44:38	64	33	0	30	0	0	0
bigcat04	1004	691:31:50	827	6	0	163	8	0	0
titanx05	137	686:20:38	67	33	0	37	0	0	0
slurm5	575	679:17:14	483	22	0	69	0	1	0
struct04	214	648:16:10	187	10	0	14	0	3	0
struct10	327	624:25:24	297	15	0	13	0	2	0
struct05	202	607:15:40	172	10	0	14	0	6	0
struct06	201	600:20:04	169	10	0	14	0	8	0
struct07	204	590:28:30	176	8	0	14	0	6	0
affogato03	954	590:02:32	897	25	0	28	2	2	0
slurm2	58	275:14:50	32	5	0	18	1	2	0
bigcat05	59	27:19:28	36	0	0	22	1	0	0

Table of Contents

CS SLURM Cluster Report - 8 /weeks

SLURM Scheduler System Output

SLURM Usage by Partition

SLURM Usage by Advisor Group

SLURM Usage by NodeName