GPU Type	# Jobs
AMD MI100	203
AMD MI210	40
AMD MI300A	133
AMD MI50	17
INTEL A770	182
INTEL DATA CENTER MAX 1100	361
INTEL DG1	10
NVIDIA A100	88
NVIDIA A2000	17
NVIDIA GH200	128
NVIDIA H100	25
NVIDIA RTX5080	129

Job Times, Last 24 Hours

Job Type	Runtime	% Total Runtime	Average Runtime	N	% UO	% AWS
AWS Packages	.42 hr	0.2%	3.13 min	8	38%	63%
App CI - E4S - Adios2	2.63 hr	1.3%	0.79 min	200	97%	0%
App CI - E4S - ExaGO	.11 hr	0.1%	2.20 min	3	100%	0%
App CI - E4S - ExaWind	0. hr	0.0%	0.04 min	1	100%	0%
App CI - E4S - HPCToolkit	.68 hr	0.3%	1.69 min	24	100%	0%
App CI - E4S - Kokkos	73. hr	37.4%	28.81 min	152	100%	0%
App CI - E4S - TAU	1.3 hr	0.7%	2.79 min	28	100%	0%
App CI - E4S - Trilinos	20.95 hr	10.7%	83.80 min	18	100%	0%
Build Systems	.07 hr	0.0%	2.07 min	2	100%	0%
Data and Vis SDK	16.43 hr	8.4%	11.33 min	87	51%	49%
Developer Tools aarch64-linux-gnu	.23 hr	0.1%	3.44 min	4	100%	0%
Developer Tools x86_64_v3-linux-gnu	.24 hr	0.1%	3.54 min	4	75%	25%
Developer Tools, Darwin	.24 hr	0.1%	3.57 min	4	100%	0%
E4S	39.72 hr	20.4%	5.74 min	415	17%	83%
E4S ARM Neoverse V2	.87 hr	0.4%	1.81 min	29	93%	7%
E4S OneAPI	.37 hr	0.2%	1.69 min	13	69%	31%
E4S ROCm External	.22 hr	0.1%	3.37 min	4	75%	25%
High Energy Physics	12.68 hr	6.5%	17.29 min	44	36%	64%
Machine Learning	4.64 hr	2.4%	4.56 min	61	52%	48%
RADIUSS	.58 hr	0.3%	2.34 min	15	67%	33%
Spack CI	.9 hr	0.5%	3.39 min	16	63%	38%
Spack Tutorial	.22 hr	0.1%	2.60 min	5	100%	0%
Windows Visualization (Kitware)	2.46 hr	1.3%	49.24 min	3	0%	100%
generate	13.4 hr	6.9%	3.64 min	221	63%	37%
no-specs-to-rebuild	1.05 hr	0.5%	0.33 min	194	0%	100%
other	.17 hr	0.1%	0.77 min	13	15%	85%
rebuild-index	.64 hr	0.3%	2.14 min	18	0%	100%
sign-pkgs	.91 hr	0.5%	18.10 min	3	0%	100%
TOTAL	195.12 hr	--	--	1,589	50%	49%

Job Times, Last Week

Job Type	Runtime	% Total Runtime	Average Runtime	N	% UO	% AWS
AWS Packages	53.51 hr	1.5%	4.75 min	676	38%	62%
App CI - E4S - Adios2	42.47 hr	1.2%	1.10 min	2,326	85%	0%
App CI - E4S - ExaGO	.56 hr	0.0%	1.60 min	21	100%	0%
App CI - E4S - ExaWind	1.41 hr	0.0%	12.13 min	7	100%	0%
App CI - E4S - HPCToolkit	3.68 hr	0.1%	1.67 min	132	100%	0%
App CI - E4S - Kokkos	436.46 hr	11.9%	31.03 min	844	100%	0%
App CI - E4S - TAU	57.19 hr	1.6%	21.45 min	160	100%	0%
App CI - E4S - Trilinos	47.78 hr	1.3%	31.16 min	107	100%	0%
Build Systems	1.29 hr	0.0%	2.86 min	27	52%	48%
Data and Vis SDK	204.39 hr	5.6%	9.26 min	1,325	47%	53%
Developer Tools aarch64-linux-gnu	2.3 hr	0.1%	3.20 min	43	19%	81%
Developer Tools x86_64_v3-linux-gnu	3.65 hr	0.1%	3.98 min	55	27%	73%
Developer Tools, Darwin	10.5 hr	0.3%	4.31 min	146	100%	0%
E4S	886.38 hr	24.2%	6.00 min	8,864	27%	73%
E4S ARM Neoverse V2	45.35 hr	1.2%	2.95 min	923	31%	69%
E4S OneAPI	54.36 hr	1.5%	3.44 min	947	20%	80%
E4S ROCm External	10.51 hr	0.3%	4.78 min	132	64%	36%
High Energy Physics	243.46 hr	6.7%	8.98 min	1,627	39%	61%
Machine Learning	995.64 hr	27.2%	6.09 min	9,803	50%	50%
RADIUSS	46.08 hr	1.3%	3.46 min	800	36%	64%
Spack CI	5.77 hr	0.2%	3.36 min	103	70%	30%
Spack Tutorial	32.54 hr	0.9%	2.93 min	667	64%	36%
Windows Visualization (Kitware)	6.18 hr	0.2%	21.80 min	17	0%	100%
generate	383.41 hr	10.5%	4.72 min	4,876	67%	33%
no-specs-to-rebuild	20.28 hr	0.6%	0.29 min	4,242	0%	100%
other	4.13 hr	0.1%	0.92 min	271	6%	94%
rebuild-index	40.4 hr	1.1%	6.11 min	397	0%	100%
sign-pkgs	18.53 hr	0.5%	12.49 min	89	0%	100%
TOTAL	3,658.21 hr	--	--	39,627	43%	56%

Job Times, Overview

Job Type	Runtime	% Total Runtime	Average Runtime	N	% UO	% AWS
AHUG ARM HPC User Group	27.39 days	0.1%	5.75 min	6,858	14%	85%
AWS Packages	1,689.02 days	4.1%	6.28 min	387,214	40%	57%
Build Systems	40.7 days	0.1%	4.37 min	13,416	73%	25%
Copy	16.4 days	0.0%	7.04 min	3,356	17%	82%
Data and Vis SDK	1,293.66 days	3.2%	7.95 min	234,468	54%	44%
Developer Tools	35.13 days	0.1%	5.51 min	9,179	67%	32%
Developer Tools Manylinux2014	52.05 days	0.1%	6.02 min	12,454	63%	33%
Developer Tools aarch64-linux-gnu	8.62 days	0.0%	3.57 min	3,480	61%	38%
Developer Tools x86_64_v3-linux-gnu	12.81 days	0.0%	4.41 min	4,180	61%	39%
Developer Tools, Darwin	10.72 days	0.0%	3.64 min	4,237	100%	0%
E4S	8,997.15 days	21.9%	8.95 min	1,447,867	51%	47%
E4S ARM Neoverse V2	914.53 days	2.2%	6.27 min	210,072	100%	0%
E4S Cray	267.46 days	0.7%	3.75 min	103,218	100%	0%
E4S OneAPI	1,405.69 days	3.4%	5.74 min	352,759	48%	50%
E4S ROCm External	712.73 days	1.7%	10.41 min	98,626	55%	42%
GCP Packages	.21 days	0.0%	3.78 min	81	0%	99%
GPU Testing	35.1 days	0.1%	6.09 min	8,376	70%	28%
High Energy Physics	66.31 days	0.2%	5.41 min	17,636	61%	39%
Machine Learning	4,836.83 days	11.8%	7.45 min	935,580	57%	41%
RADIUSS	297.62 days	0.7%	4.74 min	90,407	56%	41%
Spack CI	9.82 days	0.0%	2.87 min	4,941	67%	33%
Spack Deprecated CI	1.15 days	0.0%	3.96 min	417	76%	21%
Spack Tutorial	205.13 days	0.5%	5.37 min	55,017	67%	31%
Windows Visualization (Kitware)	29.3 days	0.1%	14.02 min	3,009	0%	87%
cleanup	8.56 days	0.0%	1.03 min	12,022	88%	12%
generate	2,782.68 days	6.8%	7.63 min	525,572	56%	42%
no-specs-to-rebuild	289.97 days	0.7%	0.66 min	635,504	27%	70%
pr-generate	1,186.42 days	2.9%	6.53 min	261,741	35%	63%
protected-generate	84.93 days	0.2%	6.61 min	18,725	25%	70%
protected-publish	41.74 days	0.1%	38.04 min	1,580	0%	98%
rebuild, aarch64	1,029.06 days	2.5%	5.51 min	269,139	0%	97%
rebuild, cray, zen4	.58 days	0.0%	1.16 min	851	100%	0%
rebuild, macOS	23.29 days	0.1%	1.45 min	23,191	100%	0%
rebuild, other	1,610.36 days	3.9%	6.41 min	363,018	2%	77%
rebuild, ppc64le	953.52 days	2.3%	9.81 min	140,428	97%	0%
rebuild, x86_64	9,865.17 days	24.0%	5.86 min	2,423,539	47%	53%
rebuild, x86_64 (p)	1,912.96 days	4.7%	7.46 min	369,092	3%	97%
rebuild-index	204.81 days	0.5%	3.01 min	97,870	32%	65%
sign-pkgs	107.58 days	0.3%	7.75 min	20,075	0%	96%
TOTAL	41,067.14 days	--	--	9,169,195	45%	52%

Runner	Total Jobs	System Failures #	System Failures %	Facility
runner-x86-v3-pub-gitlab-runner-6bb57b456d-9tlrc	12	1	8.33%	AWS
runner-x86-v4-prot-gitlab-runner-59bd4646dc-stmdz	19	1	5.26%	other

Summary

Navigation

GPU Usage, UO, Last Week

Job Times, Last 24 Hours

Job Times, Last Week

Job Times, Overview

Runner System Failures, by Type, Last 24 Hours

Runner System Failures, by Runner, Last 24 Hours