GPU Type	# Jobs
AMD MI100	175
AMD MI210	47
AMD MI300A	92
AMD MI50	22
INTEL A770	168
INTEL DATA CENTER MAX 1100	389
INTEL DG1	23
NVIDIA A100	99
NVIDIA A2000	22
NVIDIA GH200	79
NVIDIA H100	22
NVIDIA RTX5080	79

Job Times, Last 24 Hours

Job Type	Runtime	% Total Runtime	Average Runtime	N	% UO	% AWS
AWS Packages	27.23 hr	4.9%	3.10 min	527	84%	15%
App CI - E4S - Adios2	14.47 hr	2.6%	1.88 min	462	81%	0%
App CI - E4S - ExaGO	.08 hr	0.0%	1.64 min	3	100%	0%
App CI - E4S - ExaWind	1.21 hr	0.2%	72.84 min	1	100%	0%
App CI - E4S - HPCToolkit	.44 hr	0.1%	2.20 min	12	100%	0%
App CI - E4S - Kokkos	29.04 hr	5.2%	31.12 min	56	100%	0%
App CI - E4S - TAU	.46 hr	0.1%	1.45 min	19	100%	0%
App CI - E4S - Trilinos	8.98 hr	1.6%	38.50 min	14	100%	0%
Data and Vis SDK	37.64 hr	6.8%	15.36 min	147	82%	12%
Developer Tools aarch64-linux-gnu	.63 hr	0.1%	37.73 min	1	0%	100%
Developer Tools x86_64_v3-linux-gnu	.77 hr	0.1%	46.30 min	1	0%	100%
E4S	131.32 hr	23.7%	24.24 min	325	82%	15%
E4S ARM Neoverse V2	58.22 hr	10.5%	6.58 min	531	38%	61%
E4S OneAPI	6.55 hr	1.2%	7.70 min	51	94%	2%
E4S ROCm External	7.07 hr	1.3%	7.57 min	56	89%	11%
High Energy Physics	18.06 hr	3.3%	47.10 min	23	57%	17%
Machine Learning	113.33 hr	20.4%	9.41 min	723	37%	60%
RADIUSS	2.41 hr	0.4%	10.35 min	14	86%	7%
Spack Tutorial	1.91 hr	0.3%	5.45 min	21	81%	19%
Windows Visualization (Kitware)	1.06 hr	0.2%	7.98 min	8	0%	100%
generate	82.69 hr	14.9%	4.94 min	1,005	63%	36%
no-specs-to-rebuild	4.86 hr	0.9%	0.31 min	947	0%	100%
other	.31 hr	0.1%	0.32 min	57	0%	100%
rebuild-index	4.93 hr	0.9%	4.55 min	65	0%	98%
sign-pkgs	1.2 hr	0.2%	4.01 min	18	0%	100%
TOTAL	554.87 hr	--	--	5,087	50%	47%

Job Times, Last Week

Job Type	Runtime	% Total Runtime	Average Runtime	N	% UO	% AWS
AWS Packages	48.93 hr	1.6%	4.06 min	724	68%	31%
App CI - E4S - Adios2	48.41 hr	1.6%	1.58 min	1,836	84%	0%
App CI - E4S - ExaGO	.48 hr	0.0%	1.53 min	19	100%	0%
App CI - E4S - ExaWind	7.66 hr	0.2%	65.69 min	7	100%	0%
App CI - E4S - HPCToolkit	4.78 hr	0.2%	1.84 min	164	95%	0%
App CI - E4S - Kokkos	209.07 hr	6.8%	31.44 min	399	100%	0%
App CI - E4S - TAU	3.54 hr	0.1%	1.35 min	157	100%	0%
App CI - E4S - Trilinos	46.73 hr	1.5%	16.59 min	169	100%	0%
Build Systems	16.5 hr	0.5%	2.84 min	349	78%	22%
Data and Vis SDK	170.23 hr	5.5%	14.37 min	711	58%	41%
Developer Tools aarch64-linux-gnu	2.97 hr	0.1%	9.36 min	19	84%	16%
Developer Tools x86_64_v3-linux-gnu	4.42 hr	0.1%	6.02 min	44	48%	52%
Developer Tools, Darwin	.02 hr	0.0%	0.19 min	5	100%	0%
E4S	1,174.45 hr	38.2%	7.43 min	9,485	32%	68%
E4S ARM Neoverse V2	155.28 hr	5.1%	5.54 min	1,682	37%	63%
E4S OneAPI	104.84 hr	3.4%	4.54 min	1,385	29%	71%
E4S ROCm External	41.46 hr	1.3%	6.11 min	407	53%	47%
High Energy Physics	136.85 hr	4.5%	6.12 min	1,341	23%	77%
Machine Learning	394.92 hr	12.9%	10.84 min	2,185	34%	65%
RADIUSS	25.56 hr	0.8%	5.46 min	281	59%	40%
Spack CI	1.33 hr	0.0%	3.80 min	21	62%	38%
Spack Tutorial	62.87 hr	2.0%	3.19 min	1,182	69%	31%
Windows Visualization (Kitware)	7.74 hr	0.3%	12.91 min	36	0%	100%
generate	349.67 hr	11.4%	5.16 min	4,069	53%	46%
no-specs-to-rebuild	19.37 hr	0.6%	0.32 min	3,588	0%	100%
other	4.32 hr	0.1%	0.89 min	291	11%	89%
rebuild-index	22.58 hr	0.7%	3.13 min	433	0%	100%
sign-pkgs	6.2 hr	0.2%	1.68 min	222	0%	100%
TOTAL	3,071.17 hr	--	--	31,211	39%	60%

Job Times, Overview

Job Type	Runtime	% Total Runtime	Average Runtime	N	% UO	% AWS
AHUG ARM HPC User Group	27.39 days	0.1%	5.75 min	6,858	14%	85%
AWS Packages	1,689.02 days	4.1%	6.28 min	387,214	40%	57%
Build Systems	40.7 days	0.1%	4.37 min	13,416	73%	25%
Copy	16.4 days	0.0%	7.04 min	3,356	17%	82%
Data and Vis SDK	1,293.66 days	3.2%	7.95 min	234,468	54%	44%
Developer Tools	35.13 days	0.1%	5.51 min	9,179	67%	32%
Developer Tools Manylinux2014	52.05 days	0.1%	6.02 min	12,454	63%	33%
Developer Tools aarch64-linux-gnu	8.62 days	0.0%	3.57 min	3,480	61%	38%
Developer Tools x86_64_v3-linux-gnu	12.81 days	0.0%	4.41 min	4,180	61%	39%
Developer Tools, Darwin	10.72 days	0.0%	3.64 min	4,237	100%	0%
E4S	8,997.15 days	21.9%	8.95 min	1,447,867	51%	47%
E4S ARM Neoverse V2	914.53 days	2.2%	6.27 min	210,072	100%	0%
E4S Cray	267.46 days	0.7%	3.75 min	103,218	100%	0%
E4S OneAPI	1,405.69 days	3.4%	5.74 min	352,759	48%	50%
E4S ROCm External	712.73 days	1.7%	10.41 min	98,626	55%	42%
GCP Packages	.21 days	0.0%	3.78 min	81	0%	99%
GPU Testing	35.1 days	0.1%	6.09 min	8,376	70%	28%
High Energy Physics	66.31 days	0.2%	5.41 min	17,636	61%	39%
Machine Learning	4,836.83 days	11.8%	7.45 min	935,580	57%	41%
RADIUSS	297.62 days	0.7%	4.74 min	90,407	56%	41%
Spack CI	9.82 days	0.0%	2.87 min	4,941	67%	33%
Spack Deprecated CI	1.15 days	0.0%	3.96 min	417	76%	21%
Spack Tutorial	205.13 days	0.5%	5.37 min	55,017	67%	31%
Windows Visualization (Kitware)	29.3 days	0.1%	14.02 min	3,009	0%	87%
cleanup	8.56 days	0.0%	1.03 min	12,022	88%	12%
generate	2,782.68 days	6.8%	7.63 min	525,572	56%	42%
no-specs-to-rebuild	289.97 days	0.7%	0.66 min	635,504	27%	70%
pr-generate	1,186.42 days	2.9%	6.53 min	261,741	35%	63%
protected-generate	84.93 days	0.2%	6.61 min	18,725	25%	70%
protected-publish	41.74 days	0.1%	38.04 min	1,580	0%	98%
rebuild, aarch64	1,029.06 days	2.5%	5.51 min	269,139	0%	97%
rebuild, cray, zen4	.58 days	0.0%	1.16 min	851	100%	0%
rebuild, macOS	23.29 days	0.1%	1.45 min	23,191	100%	0%
rebuild, other	1,610.36 days	3.9%	6.41 min	363,018	2%	77%
rebuild, ppc64le	953.52 days	2.3%	9.81 min	140,428	97%	0%
rebuild, x86_64	9,865.17 days	24.0%	5.86 min	2,423,539	47%	53%
rebuild, x86_64 (p)	1,912.96 days	4.7%	7.46 min	369,092	3%	97%
rebuild-index	204.81 days	0.5%	3.01 min	97,870	32%	65%
sign-pkgs	107.58 days	0.3%	7.75 min	20,075	0%	96%
TOTAL	41,067.14 days	--	--	9,169,195	45%	52%

Runner	Total Jobs	System Failures #	System Failures %	Facility
runner-x86-v3-pub-gitlab-runner-5cbf78c995-bb6br	7	1	14.29%	AWS
runner-graviton3-prot-gitlab-runner-845b766d96-fbpxx	55	3	5.45%	other
runner-graviton4-pub-gitlab-runner-789c4d6b8b-27t8q	51	1	1.96%	AWS
runner-graviton4-prot-gitlab-runner-5f7df57d6-x7gr2	64	1	1.56%	other
runner-graviton4-pub-gitlab-runner-789c4d6b8b-j6h8b	66	1	1.52%	AWS

Summary

Navigation

GPU Usage, UO, Last Week

Job Times, Last 24 Hours

Job Times, Last Week

Job Times, Overview

Runner System Failures, by Type, Last 24 Hours

Runner System Failures, by Runner, Last 24 Hours