Summary

Period Beginning: 2021-09-22 07:48:34.025+00

Period Ending: 2022-06-24 23:27:35.05+00

Number of Jobs: 1365088

Number of Failed Jobs, all types: 44257

Number of Failed Jobs, system failures only: 11714

Node Descriptions

Shortcuts


Job Times, Last 4 Hours

name total_runtime avg_runtime n pct_uo pct_aws
empty

Job Times, Last Week

name total_runtime avg_runtime n pct_uo pct_aws
rebuild2187:33:56.3900:10:14.916561280726%73%
generate139:39:31.5900:04:54.190515170926%74%
service34:27:53.14700:01:20.934864153366%30%
other10:49:59.14300:04:48.8825411350%100%

Job Times, Overview

name total_runtime avg_runtime n pct_uo pct_aws
rebuild89961:16:10.28600:04:21.437208123961049%50%
generate4681:31:54.51800:04:38.3818326062069%31%
service1601:19:04.6700:01:30.0656926408283%16%
other45:57:26.7700:03:38.26750777615%82%

Job Times, Detailed

name total_runtime avg_runtime n pct_uo pct_aws
rebuild89961:16:10.28600:04:21.437208123961049%50%
e4s-pr-generate1851:32:29.87500:11:17.875508983371%29%
rebuild-index1145:30:40.42600:05:08.7169061338786%13%
radiuss-pr-generate693:06:46.02100:04:17.822486967867%33%
data-vis-sdk-pr-generate424:07:42.45800:02:36.376737976465%35%
tutorial-pr-generate359:37:46.61500:02:58.009984727364%36%
build_systems-pr-generate351:52:56.34500:02:09.052195981668%32%
e4s-develop-generate275:17:38.76300:11:40.890214141484%16%
no-specs-to-rebuild250:28:33.34200:00:23.3254013867381%19%
cleanup205:19:50.90200:01:01.6506171202288%12%
e4s-on-power-pr-generate111:53:28.90200:26:13.47227325695%0%
radiuss-develop-generate91:17:54.82900:03:58.689055137782%18%
aws-ahug-aarch64-pr-generate84:23:22.80900:08:06.8634766240%100%
aws-isc-aarch64-pr-generate76:01:29.04900:06:52.1823036640%100%
aws-ahug-pr-generate50:56:46.41800:04:50.65993363188%12%
data-vis-sdk-develop-generate48:10:36.44800:02:05.405964138381%19%
other45:57:26.7700:03:38.26750777615%82%
build_systems-develop-generate40:50:34.55800:01:46.546781138083%17%
tutorial-develop-generate36:56:25.24300:02:15.2850998377%23%
aws-isc-pr-generate32:56:09.23300:02:58.29959866588%12%
e4s-mac-pr-generate27:32:02.13300:00:31.477337322098%0%
e4s-protected-generate16:28:56.63500:07:13.1141241370%100%
aws-isc-aarch64-protected-generate16:02:39.86200:08:45.0896551100%100%
aws-ahug-aarch64-protected-generate13:00:22.11300:07:09.560671090%100%
tutorial-protected-generate10:02:01.95900:04:16.1841061410%100%
aws-e4s-pr-generate09:53:15.98100:08:51.2832996779%21%
radiuss-protected-generate09:23:39.87500:04:05.0715581380%100%
data-vis-sdk-protected-generate08:55:46.94900:03:52.9489061380%100%
python-pr-generate08:08:29.5500:22:12.2522732259%41%
aws-ahug-protected-generate07:35:30.00200:04:13.05557410886%14%
build_systems-protected-generate06:18:36.2600:02:47.0313241360%100%
aws-e4s-aarch64-pr-generate05:37:58.22400:10:33.6945320%100%
aws-isc-protected-generate05:13:34.2300:02:54.20583310886%14%
e4s-on-power-develop-generate03:49:57.88200:32:51.126771%0%
e4s-mac-develop-generate01:42:10.36300:00:25.43719124997%0%
e4s-mac-protected-generate01:29:08.58200:00:41.142938130100%0%
radiuss-aws-aarch64-pr-generate00:24:26.64100:04:04.44016760%100%
dev-tools-pr-generate00:24:11.1600:02:00.931267%33%
aws-e4s-aarch64-develop-generate00:10:46.1900:10:46.1910%100%
radiuss-aws-pr-generate00:08:56.6300:01:29.4383336100%0%
aws-e4s-develop-generate00:07:01.84100:07:01.8411100%0%
dev_tools-pr-generate00:00:13.8900:00:13.891100%0%

Runner System Failures, by Runner, Last 4 Hours

runner n_jobs n_system_failures system_failure_rate facility
empty

Runner System Failures, by Runner, Last Week

runner n_jobs n_system_failures system_failure_rate facility
large-x86-pub-gitlab-runner-7c5d6645c5-s85zc1029191.85%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-qqlfl942101.06%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-psbtj933333.54%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-7g6cr91330.33%AWS
large-arm-pub-gitlab-runner-b58985c75-vd845890151.69%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-n7pjx822151.82%AWS
large-arm-pub-gitlab-runner-b58985c75-gc2pr71360.84%AWS
large-arm-pub-gitlab-runner-b58985c75-89sjg69960.86%AWS
large-arm-pub-gitlab-runner-b58985c75-h8psf62240.64%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-fkmnz53061.13%AWS
large-arm-pub-gitlab-runner-b58985c75-t6mw750830.59%AWS
large-arm-pub-gitlab-runner-b58985c75-krvws45610.22%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-xmzrl40120.50%AWS
uo-godzilla24410.41%UO
large-arm-prot-gitlab-runner-6f778bd5b9-wzfxf24062.50%other
spack-omnia23141.73%other
large-arm-prot-gitlab-runner-6f778bd5b9-p86n619021.05%other

Runner System Failures, by Runner

runner n_jobs n_system_failures pct_system_failures facility
large-x86-pub-gitlab-runner-75d954648d-pphmp793182010.25%AWS
large-x86-pub-gitlab-runner-64fcfb66b-w2gnl567704300.76%AWS
large-x86-pub-gitlab-runner-788666b4-hd469388001270.33%AWS
large-x86-pub-gitlab-runner-586fc54475-5d6kr306781330.43%AWS
large-x86-pub-gitlab-runner-586fc54475-qb5kt16547500.30%AWS
large-x86-pub-gitlab-runner-64fcfb66b-28pd5163262771.70%AWS
large-x86-pub-gitlab-runner-596fbc486b-4j9sc145845433.72%AWS
large-x86-pub-gitlab-runner-596fbc486b-mpv22144415333.69%AWS
large-x86-pub-gitlab-runner-596fbc486b-46rjf144275333.69%AWS
large-x86-pub-gitlab-runner-596fbc486b-9v8tl141095113.62%AWS
large-x86-pub-gitlab-runner-596fbc486b-wthd7119904944.12%AWS
large-x86-pub-gitlab-runner-856f65bf79-9wx9g90864184.60%AWS
xlarge-x86-pub-gitlab-runner-f9f45999f-ld7hk7653140.18%AWS
large-x86-pub-gitlab-runner-596fbc486b-vcwxm64354266.62%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-n7pjx4845450.93%AWS
xlarge-x86-pub-gitlab-runner-7c58cc9d47-k87vf46291813.91%AWS
medium-x86-pub-gitlab-runner-5b4ddf9758-n62pg4563952.08%AWS
medium-x86-pub-gitlab-runner-5b4ddf9758-bxjvf40021102.75%AWS
large-x86-pub-gitlab-runner-586fc54475-fr4vn362740.11%AWS
large-x86-pub-gitlab-runner-596fbc486b-phm943188321.00%AWS
xlarge-x86-pub-gitlab-runner-5d8f87c7dd-mklgd310190.29%AWS
large-x86-pub-gitlab-runner-75d954648d-9528c294040.14%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-psbtj2806642.28%AWS
large-x86-pub-gitlab-runner-546548c6d8-jj8v82795291.04%AWS
large-arm-pub-gitlab-runner-b58985c75-vd8452732220.81%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-s85zc2729531.94%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-7g6cr2659100.38%AWS
large-x86-pub-gitlab-runner-586fc54475-5lktb254820.08%AWS
large-x86-pub-gitlab-runner-596fbc486b-xxktt2459441.79%AWS
large-arm-pub-gitlab-runner-b58985c75-ztndw2427230.95%AWS
large-x86-pub-gitlab-runner-596fbc486b-f88ns2398361.50%AWS
large-arm-pub-gitlab-runner-b58985c75-89sjg2242200.89%AWS
large-arm-pub-gitlab-runner-b58985c75-gc2pr2158140.65%AWS
large-arm-pub-gitlab-runner-b58985c75-pwnkt2158100.46%AWS
large-arm-pub-gitlab-runner-b58985c75-g728s2154341.58%AWS
large-arm-pub-gitlab-runner-b58985c75-xgvnw2147251.16%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-99j842142140.65%AWS
large-arm-pub-gitlab-runner-b58985c75-h8psf2123170.80%AWS
large-arm-pub-gitlab-runner-b58985c75-q6rsj2103271.28%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-fkmnz2089422.01%AWS
large-arm-pub-gitlab-runner-b58985c75-zg9961991422.11%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-t4zvc191780.42%AWS
large-x86-pub-gitlab-runner-596fbc486b-s98p51881382.02%AWS
medium-x86-pub-gitlab-runner-6d6b484d7c-dx4cn184150.27%AWS
xlarge-x86-pub-gitlab-runner-7c58cc9d47-6rh2n18021065.88%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-65bwx177180.45%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-6lf8j176400.00%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-pk5cs1711331.93%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-q4dl7169740.24%AWS
large-arm-pub-gitlab-runner-b58985c75-t6mw71666130.78%AWS
medium-x86-pub-gitlab-runner-77f9fc59f6-22fv51642332.01%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-69qbw1523100.66%AWS
medium-x86-pub-gitlab-runner-5b4ddf9758-9qjtp14001148.14%AWS
large-arm-pub-gitlab-runner-b58985c75-krvws137090.66%AWS
xlarge-x86-pub-gitlab-runner-78bf7464f5-fz8sp1352141.04%AWS
glr-testing-x86-pub-gitlab-runner-67c47869cb-k5tqv131570.53%AWS
medium-x86-pub-gitlab-runner-5449c66658-86bl2129719815.27%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-zrkfc129070.54%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-qrpd21277110.86%AWS
glr-testing-x86-pub-gitlab-runner-67c47869cb-zl94w120380.67%AWS
large-x86-pub-gitlab-runner-586fc54475-mm59w117820417.32%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-qqlfl1163100.86%AWS
xlarge-x86-pub-gitlab-runner-5d8f87c7dd-5rbmf105250.48%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-b252v93850.53%AWS
large-x86-pub-gitlab-runner-546548c6d8-8gzhq90182992.01%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-qkm5p85210.12%AWS
large-x86-pub-gitlab-runner-5fd66c6468-95xmb84183899.64%AWS
glr-testing-x86-pub-gitlab-runner-766f5dc44c-5ld8t824121.46%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-gtqlt71730.42%AWS
huge-x86-pub-gitlab-runner-6ff68d7cdf-tfr6v67550.74%AWS
xlarge-x86-pub-gitlab-runner-5d8f87c7dd-f8bz263960.94%AWS
glr-testing-x86-pub-gitlab-runner-55f6847674-8rdlz58510.17%AWS
huge-x86-pub-gitlab-runner-54cb9dd65f-74hbd55155099.82%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-mlzwx51800.00%AWS
xlarge-x86-pub-gitlab-runner-988db589c-rh9hr4894910.02%AWS
large-x86-pub-gitlab-runner-586fc54475-cnfk84544610.13%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-hrzrj44371.58%AWS
medium-x86-pub-gitlab-runner-d7ff69878-9w9t741130.73%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-xmzrl40120.50%AWS
xlarge-x86-pub-gitlab-runner-6ffc5954f-fpgmg39971.75%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-5s5p238300.00%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-55bgd36600.00%AWS
huge-x86-pub-gitlab-runner-56dcc9f4d4-8pn8535130.85%AWS
huge-x86-pub-gitlab-runner-658c9ff576-h7czw30161.99%AWS
large-x86-pub-gitlab-runner-6564fcd648-nx89m26031.15%AWS
large-x86-pub-gitlab-runner-586fc54475-9zpvs25500.00%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-wqmxz25052.00%AWS
large-x86-pub-gitlab-runner-596fbc486b-gvdt6248166.45%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-n8cp824800.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-dcxdk23562.55%AWS
xlarge-x86-pub-gitlab-runner-7c58cc9d47-7b4sl20031.50%AWS
large-arm-pub-gitlab-runner-b58985c75-9b8gk18700.00%AWS
large-x86-pub-gitlab-runner-596fbc486b-hpgg2183126.56%AWS
xlarge-x86-pub-gitlab-runner-6b59cc5b7f-s9g9j17384.62%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-h86mf17200.00%AWS
large-x86-pub-gitlab-runner-5fd66c6468-24jfs16900.00%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-w4xsw1631710.43%AWS
medium-x86-pub-gitlab-runner-79488dbc4-mgvxz16200.00%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-r7l8m14500.00%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-n7kgs13100.00%AWS
large-x86-pub-gitlab-runner-84589cff4f-swxl912910.78%AWS
huge-x86-pub-gitlab-runner-854685d854-klg2k1145649.12%AWS
huge-x86-pub-gitlab-runner-68c974fc48-z8sr511310.88%AWS
huge-x86-pub-gitlab-runner-854685d854-ndl599400.00%AWS
large-x86-pub-gitlab-runner-596fbc486b-ctnv78600.00%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-dlb5k8100.00%AWS
medium-x86-pub-gitlab-runner-75b685dd9f-f4dll7979100.00%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-lj92t6600.00%AWS
xlarge-x86-pub-gitlab-runner-89c9d4c99-w9xdl6666100.00%AWS
large-x86-pub-gitlab-runner-6cf4d66cf8-57fnf5511.82%AWS
large-x86-pub-gitlab-runner-6cf4d66cf8-tb2v65523.64%AWS
large-x86-pub-gitlab-runner-6cf4d66cf8-mvtcd47612.77%AWS
large-x86-pub-gitlab-runner-6cf4d66cf8-r7fhn4312.33%AWS
large-x86-pub-gitlab-runner-6cf4d66cf8-mrgd83912.56%AWS
huge-x86-pub-gitlab-runner-854685d854-hlwlj3812.63%AWS
large-x86-pub-gitlab-runner-6cf4d66cf8-tb2bt3800.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-59vm83800.00%AWS
large-x86-tmp-pub-gitlab-runner-8576848c95-cfhc23700.00%AWS
large-x86-pub-gitlab-runner-6564fcd648-7n9nb3600.00%AWS
huge-x86-pub-gitlab-runner-5c76cc9d55-78l2n3500.00%AWS
large-x86-tmp-pub-gitlab-runner-66494cc84c-k2r2v3213.13%AWS
large-x86-tmp-pub-gitlab-runner-5674bd848-7bmm73100.00%AWS
large-x86-testing-pub-gitlab-runner-d7589dcb4-bdkkt282485.71%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-k6jtv2800.00%AWS
huge-x86-pub-gitlab-runner-85854fd676-xb62d2828100.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-zpcd52500.00%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-nrptl2400.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-2jn2t1800.00%AWS
huge-x86-pub-gitlab-runner-854685d854-b94771800.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-ljklb1700.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-bkns21700.00%AWS
large-x86-pub-gitlab-runner-5fd66c6468-cppwp1717100.00%AWS
glr-testing-x86-pub-gitlab-runner-5d75b975bb-6r5wg1515100.00%AWS
large-x86-pub-gitlab-runner-7c5d6645c5-ggxjb1500.00%AWS
xlarge-x86-pub-gitlab-runner-89c9d4c99-jtts21515100.00%AWS
large-x86-pub-gitlab-runner-75d954648d-qxft41200.00%AWS
huge-x86-pub-gitlab-runner-854685d854-4bqgt1100.00%AWS
glr-testing-x86-pub-gitlab-runner-7f9b984b56-dpbk21010100.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-bpd6c900.00%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-b94l5800.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-mbbl27114.29%AWS
huge-x86-pub-gitlab-runner-5c76cc9d55-5ql997114.29%AWS
large-x86-tmp-pub-gitlab-runner-6d66cfcf79-xpmmx700.00%AWS
huge-x86-pub-gitlab-runner-b4d474c54-xvbql7342.86%AWS
huge-x86-pub-gitlab-runner-854685d854-sh2hj700.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-zfptz400.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-rmmqx400.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-b4dps300.00%AWS
medium-x86-pub-gitlab-runner-75b685dd9f-5fqxf33100.00%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-j6nb6200.00%AWS
huge-x86-pub-gitlab-runner-5c76cc9d55-kvdg2200.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-jnjfz200.00%AWS
huge-x86-pub-gitlab-runner-b4d474c54-qwzxh200.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-kw5dk100.00%AWS
large-x86-pub-gitlab-runner-546548c6d8-n89h5100.00%AWS
huge-x86-pub-gitlab-runner-5c76cc9d55-6qw7g100.00%AWS
huge-x86-pub-gitlab-runner-5c76cc9d55-llzrg100.00%AWS
large-x86-tmp-pub-gitlab-runner-f4c8644d6-rkbck100.00%AWS
medium-x86-pub-gitlab-runner-5576f87d5b-7cg8q11100.00%AWS
huge-x86-pub-gitlab-runner-5c76cc9d55-69lbs100.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-vl7x4100.00%AWS
medium-x86-pub-gitlab-runner-6dd47d4f9d-rx2j6100.00%AWS
uo-jupiter108119190.02%UO
uo-gilgamesh96897350.04%UO
uo-illyad937114540.48%UO
uo-instinct77323230.03%UO
uo-saturn6564890.01%UO
uo-reptar5887660.01%UO
uo-godzilla558921380.25%UO
uo-voltar37540130.03%UO
uo-cygnus2620520.01%UO
uo-mothra2543130.01%UO
uo-delphi24389100.04%UO
uo-pegasus1647500.00%UO
uo-omicron701700.00%UO
uo-eagle337010.03%UO
uo-vina321000.00%UO
uo-minotaur1816130.72%UO
uo-centaur1671342.03%UO
uo-typhon1300.00%UO
uo-medusa900.00%UO
large-x86-pub-4-gitlab-runner-5c4d87479c-m8qc5338251730.51%other
large-x86-pub-2-gitlab-runner-85bdcf44b-m644j332081650.50%other
large-x86-pub-3-gitlab-runner-fbdbc6b99-5m76d328381350.41%other
large-x86-pub-4-gitlab-runner-5c4d87479c-ltnls16464480.29%other
large-x86-pub-2-gitlab-runner-85bdcf44b-t4h84117082722.32%other
large-x86-pub-3-gitlab-runner-fbdbc6b99-x4kvn110312752.49%other
large-x86-pub-2-gitlab-runner-85bdcf44b-tmxpz9866340.34%other
large-x86-pub-3-gitlab-runner-fbdbc6b99-8jbkk5069410.81%other
large-x86-prot-gitlab-runner-677dccf647-snhlt371180.22%other
large-x86-pub-3-gitlab-runner-fbdbc6b99-f2hhf2863130.45%other
large-x86-prot-gitlab-runner-677dccf647-zrsq8274430.11%other
large-x86-prot-gitlab-runner-677dccf647-kgbwc218130.14%other
large-x86-prot-gitlab-runner-677dccf647-nfq5t212050.24%other
large-x86-pub-4-gitlab-runner-5c4d87479c-7w6q6206560.29%other
large-x86-prot-gitlab-runner-677dccf647-cqzbq193740.21%other
large-arm-prot-gitlab-runner-6f778bd5b9-xkwzj1706110.64%other
large-arm-prot-gitlab-runner-6f778bd5b9-wzfxf1661140.84%other
large-x86-prot-gitlab-runner-677dccf647-t57b2160900.00%other
large-x86-prot-gitlab-runner-677dccf647-c4jgf160410.06%other
large-x86-prot-gitlab-runner-677dccf647-lwml5158600.00%other
large-x86-prot-gitlab-runner-677dccf647-7zstx152900.00%other
large-x86-prot-gitlab-runner-677dccf647-j4mcs141000.00%other
large-x86-pub-4-gitlab-runner-5c4d87479c-f2k6z111223320.95%other
large-arm-prot-gitlab-runner-6f778bd5b9-h2qhw89010.11%other
large-arm-prot-gitlab-runner-6f778bd5b9-p86n676070.92%other
large-x86-prot-gitlab-runner-677dccf647-qvzsh74900.00%other
large-x86-prot-gitlab-runner-64f7f5d6cf-j9zcj73100.00%other
large-x86-prot-gitlab-runner-64f7f5d6cf-7vcxl72510.14%other
large-x86-prot-gitlab-runner-677dccf647-tsfjh68720.29%other
large-x86-prot-gitlab-runner-64f7f5d6cf-sd9n867510.15%other
large-x86-prot-gitlab-runner-64f7f5d6cf-hw6rz67300.00%other
large-x86-prot-gitlab-runner-64f7f5d6cf-rn9s455810.18%other
large-x86-prot-gitlab-runner-64f7f5d6cf-9n87j48400.00%other
large-x86-prot-gitlab-runner-677dccf647-ntt4q35300.00%other
spack-omnia30841.30%other
large-x86-pub-4-gitlab-runner-5c4d87479c-6nfxm30700.00%other
spack-package-signing-gitlab-runner-657765f47f-7jf9p24600.00%other
large-x86-pub-4-gitlab-runner-5c4d87479c-jzlv819300.00%other
large-x86-pub-3-gitlab-runner-fbdbc6b99-qfqcq8411.19%other
large-x86-pub-3-gitlab-runner-fbdbc6b99-7jlwk5200.00%other
spack-package-signing-gitlab-runner-657765f47f-rczgn4000.00%other
large-x86-pub-3-gitlab-runner-fbdbc6b99-jmsw43500.00%other
large-x86-pub-4-gitlab-runner-5c4d87479c-bh4q42900.00%other
large-x86-pub-3-gitlab-runner-fbdbc6b99-t62mw1900.00%other
large-x86-pub-4-gitlab-runner-5c4d87479c-kqxrb1500.00%other
large-x86-pub-4-gitlab-runner-5c4d87479c-hpswz1200.00%other
large-x86-pub-4-gitlab-runner-5c4d87479c-b7b5f1100.00%other
large-x86-pub-4-gitlab-runner-5c4d87479c-p9fnt400.00%other
spack-package-signing-gitlab-runner-657765f47f-6jjrb100.00%other
spack-package-signing-gitlab-runner-657765f47f-hsr7g100.00%other

Runner System Failures, by Type, Last 4 Hours

failure_type n n_aws n_uo percent
empty

Runner System Failures, by Type, Last Week

failure_type n n_aws n_uo percent
pod-unready8484061.76%
pod-not-found4242030.88%
connection-upgrade5503.68%
aborted-terminated4002.94%
docker-daemon1010.74%

Runner System Failures, by Type

failure_type n n_aws n_uo percent
pod-unready74947455063.97%
pod-not-found15921578013.59%
configmap-failed1133101909.67%
docker-daemon65606565.60%
dial-backend50550104.31%
exit-13712680461.08%
connection-upgrade939300.79%
aborted-terminated420380.36%
other3824130.32%
pull-failed282800.24%
no-space-on-device7070.06%

Runner System Failures, Last 20

id name finished_at web_url failure_type runner
2722128(specs) openfoam/gxgqqi3 2112_220610 gcc@7.3.1 linux-amzn2-graviton2 AWS Packages2022-06-24 11:25:55.684+00https://gitlab.spack.io/spack/spack/-/jobs/2722128pod-not-foundlarge-arm-pub-gitlab-runner-b58985c75-vd845
2722378(specs) qmcpack/23yh7w2 3.14.0 gcc@7.3.1 linux-amzn2-graviton2 AHUG ARM HPC User Group2022-06-24 09:40:52.431+00https://gitlab.spack.io/spack/spack/-/jobs/2722378pod-not-foundlarge-arm-pub-gitlab-runner-b58985c75-vd845
2722125(specs) salmon/ol6vr2u 1.4.0 gcc@7.3.1 linux-amzn2-aarch64 AWS Packages2022-06-24 09:35:52.626+00https://gitlab.spack.io/spack/spack/-/jobs/2722125pod-not-foundlarge-arm-pub-gitlab-runner-b58985c75-vd845
2722401(specs) elmerfem/gku35u7 9.0 gcc@7.3.1 linux-amzn2-aarch64 AHUG ARM HPC User Group2022-06-24 09:35:52.049+00https://gitlab.spack.io/spack/spack/-/jobs/2722401pod-not-foundlarge-arm-pub-gitlab-runner-b58985c75-vd845
2722367(specs) abyss/ufggmb2 2.3.1 gcc@7.3.1 linux-amzn2-graviton2 AHUG ARM HPC User Group2022-06-24 09:25:51.252+00https://gitlab.spack.io/spack/spack/-/jobs/2722367pod-not-foundlarge-arm-pub-gitlab-runner-b58985c75-t6mw7
2722113(specs) flux-sched/pqez67d 0.23.0 gcc@7.3.1 linux-amzn2-aarch64 AWS Packages2022-06-24 09:20:53.091+00https://gitlab.spack.io/spack/spack/-/jobs/2722113pod-not-foundlarge-arm-pub-gitlab-runner-b58985c75-krvws
2722109(specs) cgal/lmvd2fg 4.13 gcc@7.3.1 linux-amzn2-aarch64 AWS Packages2022-06-24 09:20:52.62+00https://gitlab.spack.io/spack/spack/-/jobs/2722109pod-not-foundlarge-arm-pub-gitlab-runner-b58985c75-vd845
2722124(specs) salmon/i6dvn4u 1.4.0 gcc@7.3.1 linux-amzn2-graviton2 AWS Packages2022-06-24 09:20:52.262+00https://gitlab.spack.io/spack/spack/-/jobs/2722124pod-not-foundlarge-arm-pub-gitlab-runner-b58985c75-vd845
2720241(specs) warpx/jjnt23l 22.06 gcc@7.5.0 linux-ubuntu18.04-x86_64 Spack E4S CI Testing2022-06-23 19:18:36.634+00https://gitlab.spack.io/spack/spack/-/jobs/2720241pod-not-foundlarge-x86-pub-gitlab-runner-7c5d6645c5-xmzrl
2721290(specs) pruners-ninja/ohdujek 1.0.1 gcc@11.2.0 linux-ubuntu22.04-x86_64 New PR testing workflow2022-06-23 19:13:24.435+00https://gitlab.spack.io/spack/spack/-/jobs/2721290aborted-terminatedspack-omnia
2720753(specs) py-requests/mauszai 2.26.0 gcc@11.2.0 linux-ubuntu22.04-x86_64 New PR testing workflow2022-06-23 19:13:23.474+00https://gitlab.spack.io/spack/spack/-/jobs/2720753aborted-terminatedspack-omnia
2720190(specs) slate/5xsllli 2022.06.00 gcc@7.5.0 linux-ubuntu18.04-x86_64 Spack E4S CI Testing2022-06-23 19:13:22.778+00https://gitlab.spack.io/spack/spack/-/jobs/2720190aborted-terminatedspack-omnia
2720312(specs) py-hpbandster/wc44kk3 0.7.4 gcc@7.5.0 linux-ubuntu18.04-x86_64 Spack E4S CI Testing2022-06-23 19:13:22.23+00https://gitlab.spack.io/spack/spack/-/jobs/2720312aborted-terminatedspack-omnia
2720708(specs) mercury/p7jzykh 2.1.0 gcc@11.2.0 linux-ubuntu22.04-x86_64 New PR testing workflow2022-06-23 19:06:09.342+00https://gitlab.spack.io/spack/spack/-/jobs/2720708pod-not-foundlarge-x86-pub-gitlab-runner-7c5d6645c5-psbtj
2720709(specs) metall/wpwgtx6 0.20 gcc@11.2.0 linux-ubuntu22.04-x86_64 New PR testing workflow2022-06-23 19:06:07.161+00https://gitlab.spack.io/spack/spack/-/jobs/2720709pod-not-foundlarge-x86-pub-gitlab-runner-7c5d6645c5-psbtj
2719956(specs) adios2/y6yv2fr 2.8.1 gcc@7.5.0 linux-ubuntu18.04-x86_64 Spack E4S CI Testing2022-06-23 18:56:20.001+00https://gitlab.spack.io/spack/spack/-/jobs/2719956pod-unreadylarge-x86-pub-gitlab-runner-7c5d6645c5-psbtj
2720735(specs) py-kiwisolver/i2l3ngq 1.3.2 gcc@11.2.0 linux-ubuntu22.04-x86_64 New PR testing workflow2022-06-23 18:55:31.878+00https://gitlab.spack.io/spack/spack/-/jobs/2720735pod-not-foundlarge-x86-pub-gitlab-runner-7c5d6645c5-s85zc
2721153(specs) gotcha/q6ucpu7 1.0.3 gcc@11.2.0 linux-ubuntu22.04-x86_64 New PR testing workflow2022-06-23 17:54:35.537+00https://gitlab.spack.io/spack/spack/-/jobs/2721153docker-daemonuo-godzilla
2719303(specs) salmon/pyao5zx 1.4.0 gcc@7.3.1 linux-amzn2-aarch64 AWS Packages2022-06-23 17:20:30.3+00https://gitlab.spack.io/spack/spack/-/jobs/2719303pod-not-foundlarge-arm-pub-gitlab-runner-b58985c75-vd845
2719726aws-isc-aarch64-pr-generate2022-06-23 17:20:30.256+00https://gitlab.spack.io/spack/spack/-/jobs/2719726pod-not-foundlarge-arm-pub-gitlab-runner-b58985c75-h8psf