slurm_report_eight

CS SLURM Cluster Report - 8 /weeks

CS SLURM Cluster Report - 8 /weeks

Report generated for jobs run on the CS SLURM cluster from 2024-10-13 through 2024-12-07.

Job total during this query range: 595,354

Job total since August 1st 2024: 1,005,953

This page is updated every Sunday at 5:00pm EST.

SLURM Scheduler System Output

--------------------------------------------------------------------------------
Cluster Utilization 2024-10-13T00:00:00 - 2024-12-07T23:59:59
Usage reported in TRES Hours/Percentage of Total
--------------------------------------------------------------------------------
  Cluster      TRES Name               Allocated                  Down         PLND Down                     Idle             Planned                 Reported 
--------- -------------- ----------------------- --------------------- ----------------- ------------------------ ------------------- ------------------------ 
       cs            cpu          933275(15.44%)          48851(0.81%)          0(0.00%)          4529695(74.93%)       533492(8.82%)          6045312(99.93%) 
       cs            mem      7513776501(15.14%)      208979282(0.42%)          0(0.00%)      41895921413(84.44%)            0(0.00%)      49618677197(99.74%) 
       cs       gres/gpu          103607(37.24%)            177(0.06%)          0(0.00%)           174424(62.70%)            0(0.00%)           278208(99.93%) 

* Total Cluster Resources Avaialble by Partition
 (Note, TRES is short for Trackable RESources)
PartitionName=cpu
   TRES=cpu=1804,mem=20094000M,node=46
PartitionName=gpu
   TRES=cpu=2226,mem=19710000M,node=37,gres/gpu=159
PartitionName=nolim
   TRES=cpu=44,mem=224000M,node=2
PartitionName=gnolim
   TRES=cpu=424,mem=2008000M,node=16,gres/gpu=48

SLURM Usage by Partition

PartitionName	total_jobs	cputime(HH:MM:SS)	completed	cancelled	running	failed	timeout	out_of_memory	node_fail
gpu	206146	649374:31:54	16824	3222	0	185778	119	198	5
cpu	384210	207860:32:54	369894	1555	0	12059	461	241	0
gnolim	4897	61000:59:30	1997	1553	2	1329	11	5	0
nolim	101	3734:42:56	52	32	0	16	0	1	0

SLURM Usage by Advisor Group

slurm-cs-undefined, users that have CS accounts but are not CS students
slurm-cs-unassigned, users that are CS students but do not have a listed CS advisor

GroupName	total_jobs	cputime(HH:MM:SS)	cpu	gpu	nolim	gnolim	completed	cancelled	running	failed	timeout	out_of_memory	node_fail
slurm-cs-yu-meng	66	164939:56:42	0	66	0	0	15	22	0	9	18	1	1
slurm-cs-lu-feng	8374	155277:04:28	0	5368	0	3006	3283	2502	0	2537	0	52	0
slurm-cs-chen-yu-wei	343263	129942:44:59	343263	0	0	0	331640	244	0	10979	400	0	0
slurm-cs-zezhou-cheng	369	119995:46:38	0	369	0	0	282	44	0	41	2	0	0
slurm-cs-tianhao-wang	536	99654:38:42	0	426	0	110	169	195	0	150	11	10	1
slurm-cs-undefined	55354	81848:47:04	37128	16661	4	1561	47316	1759	0	6011	5	261	2
slurm-cs-hongning-wang	29	45363:54:14	0	29	0	0	10	6	0	2	10	0	1
slurm-cs-shangtong-zhang	59	24081:30:04	24	35	0	0	9	8	0	28	11	3	0
slurm-cs-kevin-skadron	5144	14940:35:06	2273	2835	34	2	3388	311	0	1372	30	43	0
slurm-cs-adwait-jog	773	13944:50:53	479	199	15	80	270	433	2	35	13	20	0
slurm-cs-yen-ling-kuo	187	13065:18:00	4	183	0	0	48	35	0	90	8	6	0
slurm-cs-daniel-graham	286	9043:34:14	38	248	0	0	178	30	0	63	15	0	0
slurm-cs-panagiotis-apostolellis	37	8101:33:59	37	0	0	0	7	2	0	10	18	0	0
slurm-cs-madhur-behl	224	7725:57:38	83	79	48	14	88	48	0	68	6	14	0
slurm-cs-farzad-farnoud	53	7569:43:22	4	49	0	0	10	22	0	13	0	8	0
slurm-cs-yangfeng-ji	177630	6970:57:20	80	177550	0	0	54	303	0	177244	28	1	0
slurm-cs-unassigned	112	6381:28:40	19	93	0	0	30	7	0	67	3	5	0
slurm-cs-haiying-shen	1285	4695:44:04	65	1220	0	0	1198	86	0	0	1	0	0
slurm-cs-ferdinando-fioretto	595	4545:34:07	455	140	0	0	305	232	0	48	8	2	0
slurm-cs-sebastian-elbaum	573	2005:24:38	256	217	0	100	350	22	0	190	2	9	0
slurm-cs-rich-nguyen	27	976:33:06	0	3	0	24	4	0	0	22	1	0	0
slurm-cs-xiaozhu-lin	58	317:09:54	0	58	0	0	17	5	0	36	0	0	0
slurm-cs-mary-lou-soffa	171	210:37:18	0	171	0	0	38	32	0	95	0	6	0
slurm-cs-geoffrey-fox	25	192:05:16	0	25	0	0	4	4	0	13	1	3	0
slurm-cs-judy-fox	68	149:19:16	0	68	0	0	37	10	0	21	0	0	0
slurm-cs-ashish-venkat	2	13:15:52	2	0	0	0	0	0	0	1	0	1	0
slurm-cs-yixin-sun	25	09:14:00	0	25	0	0	7	0	0	18	0	0	0
slurm-cs-miaomiao-zhang	25	07:16:10	0	25	0	0	8	0	0	17	0	0	0
slurm-cs-yue-cheng	4	00:11:30	0	4	0	0	2	0	0	2	0	0	0

SLURM Usage by NodeName

Nodename	total_jobs	cputime(HH:MM:SS)	completed	cancelled	running	failed	timeout	out_of_memory	node_fail
serval01	90	194077:20:30	22	27	0	11	23	5	2
cheetah06	652	131720:56:06	452	90	0	98	8	4	0
cheetah04	1170	44108:17:20	184	35	0	941	7	1	2
jaguar03	7305	42962:15:04	719	131	0	6432	12	11	0
cortado08	121095	34958:28:58	118257	55	0	2702	74	7	0
cortado01	130083	33971:37:24	127246	82	0	2686	64	5	0
bigcat01	8454	25293:14:34	7487	207	0	600	145	15	0
jaguar01	215	23143:21:22	96	58	0	50	5	6	0
lotus	5407	22514:21:30	642	85	0	4652	5	22	1
jaguar04	281	16650:56:32	111	61	0	89	3	17	0
lynx08	19474	16366:43:34	18041	41	0	1324	56	12	0
sds01	7288	16240:41:40	659	168	0	6454	3	4	0
puma01	5989	14584:52:16	5540	78	0	358	1	12	0
cheetah05	2590	14134:33:10	1617	99	0	859	11	4	0
sds02	10621	12678:01:24	883	212	0	9522	1	3	0
lynx09	7747	10572:16:24	6572	49	0	1073	51	2	0
jaguar02	6195	8881:17:12	1264	224	0	4691	8	8	0
puma02	729	7837:49:22	226	143	0	334	3	23	0
cheetah02	3264	7435:33:58	426	85	0	2749	2	2	0
affogato13	7569	7284:00:02	366	85	0	7114	2	2	0
cheetah01	1427	7199:27:16	929	143	0	307	10	38	0
adriatic02	8217	6920:24:34	639	92	0	7486	0	0	0
lynx11	11488	6827:59:18	235	94	0	11157	0	2	0
lynx10	8613	6740:17:58	178	93	0	8340	1	1	0
affogato11	7879	6714:00:44	353	109	0	7414	1	2	0
affogato14	7741	6620:53:36	354	117	0	7269	0	1	0
adriatic01	8847	6581:34:00	657	116	0	8073	1	0	0
jaguar05	7932	6419:41:22	680	192	0	7047	6	7	0
lynx12	12271	6069:41:54	224	93	0	11954	0	0	0
cortado09	1937	6041:41:56	1825	49	0	56	2	5	0
affogato02	4730	6009:25:42	4289	43	0	383	11	4	0
ai03	241	5315:00:18	94	94	0	53	0	0	0
affogato15	7916	5292:05:02	363	105	0	7448	0	0	0
adriatic03	7655	5264:52:20	652	77	0	6926	0	0	0
ai02	259	5248:55:40	94	100	0	65	0	0	0
ai05	348	5200:20:04	155	119	1	71	2	0	0
affogato01	4375	5139:06:04	3552	36	0	782	2	3	0
ai07	360	4981:01:02	170	120	0	69	1	0	0
affogato04	3117	4955:14:00	2814	38	0	249	13	3	0
ai04	255	4858:43:48	96	110	0	49	0	0	0
ai08	356	4755:05:22	147	133	0	75	0	1	0
ai01	245	4682:03:50	103	79	0	62	1	0	0
hydro	3624	4610:33:34	3487	89	0	28	12	8	0
panther01	1123	4587:39:12	994	80	0	33	3	13	0
ai10	460	4447:21:56	176	120	0	164	0	0	0
ai06	339	4316:00:30	143	112	0	83	1	0	0
ai09	520	4283:53:14	186	128	0	206	0	0	0
cortado10	2254	4202:36:32	1817	37	0	387	3	10	0
adriatic04	7412	4046:23:12	558	61	0	6793	0	0	0
cheetah03	2931	3900:48:34	438	61	0	2431	1	0	0
jinx01	435	3613:03:22	188	113	0	132	2	0	0
lynx07	4980	3522:02:10	197	33	0	4747	0	3	0
adriatic06	6854	3351:51:38	569	60	0	6224	1	0	0
jinx02	352	3331:42:30	143	109	0	97	2	1	0
slurm1	1494	3161:46:20	1347	69	0	70	2	6	0
lynx05	4884	3152:00:32	156	25	0	4701	1	1	0
lynx01	6094	3033:27:14	192	26	0	5873	1	2	0
adriatic05	7074	2701:02:24	589	53	0	6431	1	0	0
lynx04	5259	2604:50:54	181	31	0	5044	0	3	0
lynx02	4867	2516:33:52	167	19	0	4679	0	2	0
lynx03	5348	2489:18:04	142	27	0	5174	1	4	0
titanx02	189	2378:33:42	67	58	1	60	1	2	0
heartpiece	36	2340:24:46	10	23	0	2	0	1	0
slurm3	1191	2312:08:08	1081	44	0	60	1	5	0
lynx06	5083	2293:07:36	204	29	0	4847	0	3	0
jaguar06	1947	2198:40:12	504	59	0	1364	1	19	0
slurm4	1196	1927:42:46	1083	44	0	59	0	10	0
bigcat06	45425	1890:20:12	45408	3	0	10	4	0	0
cortado06	1267	1818:24:40	1158	28	0	68	1	12	0
cortado03	1332	1771:55:26	1206	56	0	67	0	3	0
cortado02	1343	1727:50:56	1220	53	0	65	0	5	0
cortado04	1298	1671:16:42	1181	41	0	67	1	8	0
cortado07	1196	1637:18:02	1075	21	0	89	1	10	0
cortado05	1274	1630:57:12	1171	33	0	65	1	4	0
affogato06	1468	1535:27:36	1354	14	0	91	2	7	0
affogato07	1342	1434:50:58	1192	20	0	122	1	7	0
affogato08	1319	1406:41:58	1212	15	0	81	3	8	0
affogato10	1190	1280:45:22	1109	15	0	61	2	3	0
titanx03	183	1263:00:16	81	57	0	43	1	1	0
affogato09	1140	1232:59:56	1042	15	0	72	2	9	0
titanx04	155	1204:31:58	75	48	0	32	0	0	0
affogato05	1313	1136:06:02	1259	26	0	27	1	0	0
titanx05	168	1121:41:58	79	49	0	40	0	0	0
struct01	470	774:08:12	447	11	0	11	0	1	0
struct03	218	747:45:30	193	10	0	12	0	3	0
struct09	411	742:46:12	379	17	0	11	0	4	0
struct08	411	722:39:26	377	20	0	11	0	3	0
slurm5	577	713:35:50	483	26	0	67	0	1	0
struct02	329	707:49:40	303	11	0	11	0	4	0
epona	14	702:09:06	11	3	0	0	0	0	0
struct04	210	648:15:18	185	10	0	12	0	3	0
struct10	323	624:24:32	295	15	0	11	0	2	0
struct05	198	607:14:48	170	10	0	12	0	6	0
struct06	197	600:20:04	167	10	0	12	0	8	0
struct07	200	590:28:04	174	8	0	12	0	6	0
affogato03	761	547:34:08	725	11	0	23	0	2	0
bigcat02	425	402:40:04	382	0	0	43	0	0	0
slurm2	64	353:52:10	34	11	0	16	1	2	0
bigcat04	527	205:14:12	521	4	0	1	1	0	0
bigcat05	34	00:51:40	20	0	0	14	0	0	0
bigcat03	36	00:50:38	20	0	0	16	0	0	0

Table of Contents

CS SLURM Cluster Report - 8 /weeks

SLURM Scheduler System Output

SLURM Usage by Partition

SLURM Usage by Advisor Group

SLURM Usage by NodeName