Overall
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 45.4 | — | — | 10 / 15 |
| CPU efficiency index | 42.0 | — | — | 9 / 15 |
| Peak memory | 671.4 MiB | — | — | 14 / 15 |
The same Spring Boot service with a Project Leyden AOT cache created by a training run at build time (JEP 514/515).
Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 45.4 | — | — | 10 / 15 |
| CPU efficiency index | 42.0 | — | — | 9 / 15 |
| Peak memory | 671.4 MiB | — | — | 14 / 15 |
Start-up
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Cold start | 1,486 ms 95 % CI 1,457–1,560 | 1,457–1,560 | 5 | 14 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Memory | ||||
| Memory at idle | 142.7 MiB 95 % CI 142.2–153.6 | 142.2–153.6 | 5 | 12 / 15 |
| Anonymous memory at idle | 109.4 MiB 95 % CI 109.0–120.1 | 109.0–120.1 | 5 | 14 / 15 |
| Start-up | ||||
| Cold start (fastest) | 1,414 ms 95 % CI 1,367–1,539 | 1,367–1,539 | 5 | 14 / 15 |
| Cold start (slowest) | 1,531 ms 95 % CI 1,524–1,641 | 1,524–1,641 | 5 | 14 / 15 |
| Footprint | ||||
| Image size | 632 MB | — | 5 | 14 / 15 |
Cold load
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 8,124 req/s 95 % CI 5,804–9,049 | 5,804–9,049 | 5 | 14 / 15 |
| Latency p99 | 194.05 ms 95 % CI 187.76–779.08 | 187.76–779.08 | 5 | 14 / 15 |
| CPU per request | 245.3 µs 95 % CI 220.5–343.5 | 220.5–343.5 | 5 | 14 / 15 |
| Memory under load (PSS) | 262.3 MiB 95 % CI 260.9–265.7 | 260.9–265.7 | 5 | 15 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 13.03 ms 95 % CI 11.66–18.75 | 11.66–18.75 | 5 | 12 / 15 |
| Latency p90 | 41.38 ms 95 % CI 38.67–81.49 | 38.67–81.49 | 5 | 14 / 15 |
| Latency p99.9 | 357.87 ms 95 % CI 339.57–1,125.32 | 339.57–1,125.32 | 5 | 14 / 15 |
| Latency p75 | 21.71 ms 95 % CI 20.99–30.86 | 20.99–30.86 | 5 | 14 / 15 |
| Latency p99.99 | 459.55 ms 95 % CI 405.06–1,323.74 | 405.06–1,323.74 | 5 | 14 / 15 |
| Latency mean | 22.28 ms 95 % CI 21.77–56.27 | 21.77–56.27 | 5 | 14 / 15 |
| Latency std. dev. | 35.01 ms 95 % CI 33.93–137.63 | 33.93–137.63 | 5 | 14 / 15 |
| Latency max | 515.44 ms 95 % CI 439.38–1,345.81 | 439.38–1,345.81 | 5 | 14 / 15 |
| CPU | ||||
| CPU used | 1.99 cores 95 % CI 1.98–1.99 | 1.98–1.99 | 5 | — |
| User-space CPU share | 0.810 95 % CI 0.802–0.835 | 0.802–0.835 | 5 | — |
| CPU throttling | 11.1 ms 95 % CI 7.7–14.8 | 7.7–14.8 | 5 | 10 / 15 |
| Memory | ||||
| Anonymous memory peak | 229.0 MiB 95 % CI 227.3–232.2 | 227.3–232.2 | 5 | 15 / 15 |
| Database | ||||
| Database CPU per request | 119.0 µs 95 % CI 102.7–121.1 | 102.7–121.1 | 5 | 13 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Start-up | ||||
| Cold vs. warm throughput | 0.28 95 % CI 0.19–0.31 | 0.19–0.31 | 5 | 14 / 15 |
| Energy | ||||
| CPU package energy | 477.5 J 95 % CI 469.3–599.1 | 469.3–599.1 | 5 | — |
| Package energy per request | 5.767 mJ 95 % CI 5.260–10.281 | 5.260–10.281 | 5 | 13 / 15 |
| Network | ||||
| Bytes per response | 137 B 95 % CI 137–137 | 137–137 | 5 | — |
| Disk I/O | ||||
| Disk writes | 28 KiB | — | 5 | 13 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.44 runnable tasks 95 % CI 3.43–5.46 | 3.43–5.46 | 5 | 9 / 15 |
| CPU clock | 3,520 MHz 95 % CI 3,500–3,632 | 3,500–3,632 | 5 | — |
| Load generator CPU | 0.10 95 % CI 0.05–0.11 | 0.05–0.11 | 5 | 2 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 56,027 req/s 95 % CI 54,160–57,922 | 54,160–57,922 | 5 | 10 / 15 |
| Latency p99 | 4.33 ms 95 % CI 4.09–4.81 | 4.09–4.81 | 5 | 9 / 15 |
| CPU per request | 29.8 µs 95 % CI 29.7–31.5 | 29.7–31.5 | 5 | 9 / 15 |
| Memory under load (PSS) | 276.8 MiB 95 % CI 272.8–282.9 | 272.8–282.9 | 5 | 14 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 2.29 ms 95 % CI 2.11–2.40 | 2.11–2.40 | 5 | 11 / 15 |
| Latency p90 | 2.92 ms 95 % CI 2.82–3.02 | 2.82–3.02 | 5 | 11 / 15 |
| Latency p99.9 | 23.18 ms 95 % CI 6.38–26.74 | 6.38–26.74 | 5 | 13 / 15 |
| Latency p75 | 2.71 ms 95 % CI 2.67–2.87 | 2.67–2.87 | 5 | 10 / 15 |
| Latency p99.99 | 32.77 ms 95 % CI 8.80–56.30 | 8.80–56.30 | 5 | 13 / 15 |
| Latency mean | 2.27 ms 95 % CI 2.26–2.40 | 2.26–2.40 | 5 | 10 / 15 |
| Latency std. dev. | 1.33 ms 95 % CI 0.70–1.63 | 0.70–1.63 | 5 | 11 / 15 |
| Latency max | 35.91 ms 95 % CI 23.23–71.28 | 23.23–71.28 | 5 | 13 / 15 |
| CPU | ||||
| CPU used | 1.70 cores 95 % CI 1.67–1.72 | 1.67–1.72 | 5 | — |
| User-space CPU share | 0.583 95 % CI 0.570–0.595 | 0.570–0.595 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 243.2 MiB 95 % CI 239.0–249.5 | 239.0–249.5 | 5 | 14 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 9 / 15 |
| Energy | ||||
| CPU package energy | 689.8 J 95 % CI 686.6–704.4 | 686.6–704.4 | 5 | — |
| Package energy per request | 0.812 mJ 95 % CI 0.799–0.844 | 0.799–0.844 | 5 | 10 / 15 |
| Network | ||||
| Bytes per response | 133 B 95 % CI 133–133 | 133–133 | 5 | — |
| Disk I/O | ||||
| Disk writes | 36 KiB | — | 5 | 14 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.21 runnable tasks 95 % CI 4.76–6.25 | 4.76–6.25 | 5 | 5 / 15 |
| CPU clock | 3,670 MHz 95 % CI 3,587–3,723 | 3,587–3,723 | 5 | — |
| Load generator CPU | 0.56 95 % CI 0.55–0.56 | 0.55–0.56 | 5 | 8 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 29,702 req/s 95 % CI 29,233–30,341 | 29,233–30,341 | 5 | 9 / 15 |
| Latency p99 | 12.04 ms 95 % CI 11.81–12.57 | 11.81–12.57 | 5 | 11 / 15 |
| CPU per request | 65.6 µs 95 % CI 64.2–67.0 | 64.2–67.0 | 5 | 9 / 15 |
| Memory under load (PSS) | 277.2 MiB 95 % CI 273.0–283.2 | 273.0–283.2 | 5 | 14 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 3.78 ms 95 % CI 3.72–3.88 | 3.72–3.88 | 5 | 9 / 15 |
| Latency p90 | 7.64 ms 95 % CI 7.48–7.81 | 7.48–7.81 | 5 | 11 / 15 |
| Latency p99.9 | 16.90 ms 95 % CI 16.77–18.50 | 16.77–18.50 | 5 | 11 / 15 |
| Latency p75 | 5.60 ms 95 % CI 5.49–5.71 | 5.49–5.71 | 5 | 10 / 15 |
| Latency p99.99 | 23.23 ms 95 % CI 21.80–26.29 | 21.80–26.29 | 5 | 9 / 15 |
| Latency mean | 4.39 ms 95 % CI 4.31–4.49 | 4.31–4.49 | 5 | 9 / 15 |
| Latency std. dev. | 2.41 ms 95 % CI 2.36–2.53 | 2.36–2.53 | 5 | 11 / 15 |
| Latency max | 32.95 ms 95 % CI 29.55–60.00 | 29.55–60.00 | 5 | 9 / 15 |
| CPU | ||||
| CPU used | 1.95 cores 95 % CI 1.94–1.96 | 1.94–1.96 | 5 | — |
| User-space CPU share | 0.530 95 % CI 0.525–0.530 | 0.525–0.530 | 5 | — |
| CPU throttling | 1.3 ms 95 % CI 0.1–3.8 | 0.1–3.8 | 5 | 7 / 15 |
| Memory | ||||
| Anonymous memory peak | 243.5 MiB 95 % CI 239.2–249.8 | 239.2–249.8 | 5 | 14 / 15 |
| Database | ||||
| Database CPU per request | 77.5 µs 95 % CI 76.2–78.4 | 76.2–78.4 | 5 | 10 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 756.4 J 95 % CI 746.2–762.6 | 746.2–762.6 | 5 | — |
| Package energy per request | 1.687 mJ 95 % CI 1.654–1.699 | 1.654–1.699 | 5 | 9 / 15 |
| Network | ||||
| Bytes per response | 137 B 95 % CI 137–137 | 137–137 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.70 runnable tasks 95 % CI 4.99–6.35 | 4.99–6.35 | 5 | 10 / 15 |
| CPU clock | 3,613 MHz 95 % CI 3,573–3,627 | 3,573–3,627 | 5 | — |
| Load generator CPU | 0.35 95 % CI 0.34–0.36 | 0.34–0.36 | 5 | 7 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 3,781 req/s 95 % CI 3,751–3,850 | 3,751–3,850 | 5 | 8 / 15 |
| Latency p99 | 100.10 ms 95 % CI 98.06–104.10 | 98.06–104.10 | 5 | 12 / 15 |
| CPU per request | 525.0 µs 95 % CI 516.6–531.6 | 516.6–531.6 | 5 | 10 / 15 |
| Memory under load (PSS) | 277.4 MiB 95 % CI 273.1–283.4 | 273.1–283.4 | 5 | 14 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 31.30 ms 95 % CI 30.85–31.92 | 30.85–31.92 | 5 | 6 / 15 |
| Latency p90 | 60.33 ms 95 % CI 59.55–61.33 | 59.55–61.33 | 5 | 12 / 15 |
| Latency p99.9 | 138.26 ms 95 % CI 134.97–146.92 | 134.97–146.92 | 5 | 13 / 15 |
| Latency p75 | 44.53 ms 95 % CI 43.55–44.76 | 43.55–44.76 | 5 | 11 / 15 |
| Latency p99.99 | 178.46 ms 95 % CI 166.31–199.96 | 166.31–199.96 | 5 | 13 / 15 |
| Latency mean | 34.92 ms 95 % CI 34.28–35.05 | 34.28–35.05 | 5 | 8 / 15 |
| Latency std. dev. | 19.70 ms 95 % CI 19.39–20.56 | 19.39–20.56 | 5 | 13 / 15 |
| Latency max | 217.92 ms 95 % CI 196.96–241.70 | 196.96–241.70 | 5 | 13 / 15 |
| CPU | ||||
| CPU used | 1.99 cores 95 % CI 1.98–1.99 | 1.98–1.99 | 5 | — |
| User-space CPU share | 0.423 95 % CI 0.420–0.439 | 0.420–0.439 | 5 | — |
| CPU throttling | 15.6 ms 95 % CI 8.0–25.5 | 8.0–25.5 | 5 | 12 / 15 |
| Memory | ||||
| Anonymous memory peak | 243.6 MiB 95 % CI 239.3–249.9 | 239.3–249.9 | 5 | 14 / 15 |
| Database | ||||
| Database CPU per request | 802.8 µs 95 % CI 801.6–806.8 | 801.6–806.8 | 5 | 4 / 15 |
| SELECTs per request | 20.04 queries 95 % CI 20.04–20.05 | 20.04–20.05 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 929.6 J 95 % CI 922.5–940.5 | 922.5–940.5 | 5 | — |
| Package energy per request | 16.286 mJ 95 % CI 16.063–16.592 | 16.063–16.592 | 5 | 8 / 15 |
| Network | ||||
| Bytes per response | 744 B 95 % CI 744–744 | 744–744 | 5 | — |
| Disk I/O | ||||
| Disk writes | 12 KiB | — | 5 | 14 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.26 runnable tasks 95 % CI 5.96–7.32 | 5.96–7.32 | 5 | 10 / 15 |
| CPU clock | 3,507 MHz 95 % CI 3,427–3,627 | 3,427–3,627 | 5 | — |
| Load generator CPU | 0.05 95 % CI 0.05–0.05 | 0.05–0.05 | 5 | 9 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 6,667 req/s 95 % CI 6,532–6,785 | 6,532–6,785 | 5 | 8 / 15 |
| Latency p99 | 70.57 ms 95 % CI 66.14–71.12 | 66.14–71.12 | 5 | 14 / 15 |
| CPU per request | 295.8 µs 95 % CI 293.6–304.9 | 293.6–304.9 | 5 | 10 / 15 |
| Memory under load (PSS) | 277.5 MiB 95 % CI 273.2–283.5 | 273.2–283.5 | 5 | 14 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 17.30 ms 95 % CI 17.09–17.73 | 17.09–17.73 | 5 | 6 / 15 |
| Latency p90 | 39.35 ms 95 % CI 37.33–39.92 | 37.33–39.92 | 5 | 14 / 15 |
| Latency p99.9 | 100.00 ms 95 % CI 96.63–103.19 | 96.63–103.19 | 5 | 14 / 15 |
| Latency p75 | 27.23 ms 95 % CI 26.07–27.35 | 26.07–27.35 | 5 | 13 / 15 |
| Latency p99.99 | 135.22 ms 95 % CI 122.37–136.56 | 122.37–136.56 | 5 | 14 / 15 |
| Latency mean | 20.64 ms 95 % CI 20.02–20.86 | 20.02–20.86 | 5 | 10 / 15 |
| Latency std. dev. | 14.48 ms 95 % CI 13.49–14.84 | 13.49–14.84 | 5 | 14 / 15 |
| Latency max | 161.07 ms 95 % CI 156.26–192.92 | 156.26–192.92 | 5 | 14 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.95–1.99 | 1.95–1.99 | 5 | — |
| User-space CPU share | 0.449 95 % CI 0.443–0.461 | 0.443–0.461 | 5 | — |
| CPU throttling | 9.7 ms 95 % CI 5.8–12.7 | 5.8–12.7 | 5 | 12 / 15 |
| Memory | ||||
| Anonymous memory peak | 243.7 MiB 95 % CI 239.4–250.0 | 239.4–250.0 | 5 | 14 / 15 |
| Database | ||||
| Database CPU per request | 489.8 µs 95 % CI 475.6–491.7 | 475.6–491.7 | 5 | 8 / 15 |
| SELECTs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| UPDATEs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| Energy | ||||
| CPU package energy | 947.3 J 95 % CI 940.4–957.9 | 940.4–957.9 | 5 | — |
| Package energy per request | 9.492 mJ 95 % CI 9.266–9.650 | 9.266–9.650 | 5 | 11 / 15 |
| Network | ||||
| Bytes per response | 267 B 95 % CI 267–267 | 267–267 | 5 | — |
| Disk I/O | ||||
| Disk writes | 12 KiB 95 % CI 0–12 | 0–12 | 5 | 14 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.12 runnable tasks 95 % CI 6.23–8.56 | 6.23–8.56 | 5 | 8 / 15 |
| CPU clock | 3,613 MHz 95 % CI 3,583–3,627 | 3,583–3,627 | 5 | — |
| Load generator CPU | 0.08 95 % CI 0.08–0.09 | 0.08–0.09 | 5 | 8 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 19,898 req/s 95 % CI 19,593–20,141 | 19,593–20,141 | 5 | 9 / 15 |
| Latency p99 | 15.83 ms 95 % CI 15.39–16.05 | 15.39–16.05 | 5 | 11 / 15 |
| CPU per request | 99.5 µs 95 % CI 98.6–100.5 | 98.6–100.5 | 5 | 8 / 15 |
| Memory under load (PSS) | 294.6 MiB 95 % CI 283.8–296.1 | 283.8–296.1 | 5 | 14 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 6.10 ms 95 % CI 6.02–6.18 | 6.02–6.18 | 5 | 9 / 15 |
| Latency p90 | 10.66 ms 95 % CI 10.57–10.75 | 10.57–10.75 | 5 | 10 / 15 |
| Latency p99.9 | 22.39 ms 95 % CI 21.08–22.93 | 21.08–22.93 | 5 | 10 / 15 |
| Latency p75 | 8.07 ms 95 % CI 7.98–8.40 | 7.98–8.40 | 5 | 9 / 15 |
| Latency p99.99 | 31.51 ms 95 % CI 28.02–50.31 | 28.02–50.31 | 5 | 10 / 15 |
| Latency mean | 6.48 ms 95 % CI 6.43–6.60 | 6.43–6.60 | 5 | 9 / 15 |
| Latency std. dev. | 3.19 ms 95 % CI 3.09–3.25 | 3.09–3.25 | 5 | 12 / 15 |
| Latency max | 41.99 ms 95 % CI 39.45–90.42 | 39.45–90.42 | 5 | 10 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.95–1.98 | 1.95–1.98 | 5 | — |
| User-space CPU share | 0.619 95 % CI 0.615–0.627 | 0.615–0.627 | 5 | — |
| CPU throttling | 9.1 ms 95 % CI 3.9–10.5 | 3.9–10.5 | 5 | 10 / 15 |
| Memory | ||||
| Anonymous memory peak | 261.1 MiB 95 % CI 250.4–262.6 | 250.4–262.6 | 5 | 14 / 15 |
| Database | ||||
| Database CPU per request | 122.6 µs 95 % CI 120.2–124.3 | 120.2–124.3 | 5 | 9 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 823.7 J 95 % CI 815.5–831.2 | 815.5–831.2 | 5 | — |
| Package energy per request | 2.756 mJ 95 % CI 2.729–2.770 | 2.729–2.770 | 5 | 9 / 15 |
| Network | ||||
| Bytes per response | 4,738 B 95 % CI 4,738–4,738 | 4,738–4,738 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.41 runnable tasks 95 % CI 6.34–9.11 | 6.34–9.11 | 5 | 10 / 15 |
| CPU clock | 3,600 MHz 95 % CI 3,553–3,613 | 3,553–3,613 | 5 | — |
| Load generator CPU | 0.25 95 % CI 0.24–0.25 | 0.24–0.25 | 5 | 8 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 23,460 req/s 95 % CI 23,203–24,061 | 23,203–24,061 | 5 | 11 / 15 |
| Latency p99 | 8.07 ms 95 % CI 7.95–8.10 | 7.95–8.10 | 5 | 8 / 15 |
| CPU per request | 84.6 µs 95 % CI 82.4–85.5 | 82.4–85.5 | 5 | 11 / 15 |
| Memory under load (PSS) | 295.0 MiB 95 % CI 284.3–301.9 | 284.3–301.9 | 5 | 14 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 5.35 ms 95 % CI 5.22–5.42 | 5.22–5.42 | 5 | 11 / 15 |
| Latency p90 | 6.44 ms 95 % CI 6.30–6.50 | 6.30–6.50 | 5 | 10 / 15 |
| Latency p99.9 | 10.07 ms 95 % CI 9.83–10.59 | 9.83–10.59 | 5 | 5 / 15 |
| Latency p75 | 5.69 ms 95 % CI 5.57–5.76 | 5.57–5.76 | 5 | 10 / 15 |
| Latency p99.99 | 14.34 ms 95 % CI 13.36–45.82 | 13.36–45.82 | 5 | 7 / 15 |
| Latency mean | 5.42 ms 95 % CI 5.30–5.50 | 5.30–5.50 | 5 | 11 / 15 |
| Latency std. dev. | 0.95 ms 95 % CI 0.90–1.13 | 0.90–1.13 | 5 | 5 / 15 |
| Latency max | 52.41 ms 95 % CI 14.93–80.36 | 14.93–80.36 | 5 | 12 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.98–1.98 | 1.98–1.98 | 5 | — |
| User-space CPU share | 0.736 95 % CI 0.734–0.746 | 0.734–0.746 | 5 | — |
| CPU throttling | 5.0 ms 95 % CI 2.9–6.8 | 2.9–6.8 | 5 | 6 / 15 |
| Memory | ||||
| Anonymous memory peak | 261.7 MiB 95 % CI 250.9–268.1 | 250.9–268.1 | 5 | 14 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–0.1 | < 0.1–0.1 | 5 | 7 / 15 |
| Energy | ||||
| CPU package energy | 722.9 J 95 % CI 706.6–731.2 | 706.6–731.2 | 5 | — |
| Package energy per request | 2.024 mJ 95 % CI 2.003–2.052 | 2.003–2.052 | 5 | 11 / 15 |
| Network | ||||
| Bytes per response | 195 B 95 % CI 195–195 | 195–195 | 5 | — |
| Disk I/O | ||||
| Disk writes | 12 KiB | — | 5 | 14 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.91 runnable tasks 95 % CI 6.40–8.68 | 6.40–8.68 | 5 | 7 / 15 |
| CPU clock | 3,733 MHz 95 % CI 3,613–3,788 | 3,613–3,788 | 5 | — |
| Load generator CPU | 0.35 95 % CI 0.34–0.35 | 0.34–0.35 | 5 | 7 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 29,548 req/s 95 % CI 28,693–29,988 | 28,693–29,988 | 5 | 10 / 15 |
| Latency p99 | 1.10 ms 95 % CI 1.08–1.42 | 1.08–1.42 | 5 | 6 / 15 |
| CPU per request | 55.0 µs 95 % CI 54.2–56.9 | 54.2–56.9 | 5 | 9 / 15 |
| Memory under load (PSS) | 293.1 MiB 95 % CI 284.5–300.1 | 284.5–300.1 | 5 | 14 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.52 ms 95 % CI 0.51–0.53 | 0.51–0.53 | 5 | 10 / 15 |
| Latency p90 | 0.71 ms 95 % CI 0.70–0.73 | 0.70–0.73 | 5 | 8 / 15 |
| Latency p99.9 | 2.53 ms 95 % CI 2.48–3.56 | 2.48–3.56 | 5 | 7 / 15 |
| Latency p75 | 0.62 ms 95 % CI 0.61–0.64 | 0.61–0.64 | 5 | 9 / 15 |
| Latency p99.99 | 4.37 ms 95 % CI 3.87–6.08 | 3.87–6.08 | 5 | 5 / 15 |
| Latency mean | 0.54 ms 95 % CI 0.53–0.56 | 0.53–0.56 | 5 | 8 / 15 |
| Latency std. dev. | 0.20 ms 95 % CI 0.19–0.25 | 0.19–0.25 | 5 | 5 / 15 |
| Latency max | 6.73 ms 95 % CI 6.59–8.87 | 6.59–8.87 | 5 | 5 / 15 |
| CPU | ||||
| CPU used | 1.63 cores 95 % CI 1.60–1.65 | 1.60–1.65 | 5 | — |
| User-space CPU share | 0.531 95 % CI 0.529–0.542 | 0.529–0.542 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 259.8 MiB 95 % CI 251.0–266.3 | 251.0–266.3 | 5 | 14 / 15 |
| Database | ||||
| Database CPU per request | 78.2 µs 95 % CI 77.0–80.2 | 77.0–80.2 | 5 | 10 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 703.6 J 95 % CI 701.7–712.2 | 701.7–712.2 | 5 | — |
| Package energy per request | 1.573 mJ 95 % CI 1.568–1.624 | 1.568–1.624 | 5 | 9 / 15 |
| Network | ||||
| Bytes per response | 137 B 95 % CI 137–137 | 137–137 | 5 | — |
| Disk I/O | ||||
| Disk writes | 12 KiB | — | 5 | 14 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.40 runnable tasks 95 % CI 5.87–7.59 | 5.87–7.59 | 5 | 10 / 15 |
| CPU clock | 3,318 MHz 95 % CI 3,241–3,440 | 3,241–3,440 | 5 | — |
| Load generator CPU | 0.35 95 % CI 0.34–0.36 | 0.34–0.36 | 5 | 7 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 26,108 req/s 95 % CI 25,474–26,479 | 25,474–26,479 | 5 | 9 / 15 |
| Latency p99 | 84.31 ms 95 % CI 81.05–90.46 | 81.05–90.46 | 5 | 11 / 15 |
| CPU per request | 75.4 µs 95 % CI 74.5–77.5 | 74.5–77.5 | 5 | 9 / 15 |
| Memory under load (PSS) | 667.2 MiB 95 % CI 662.8–685.5 | 662.8–685.5 | 5 | 14 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 15.94 ms 95 % CI 15.71–16.68 | 15.71–16.68 | 5 | 9 / 15 |
| Latency p90 | 49.48 ms 95 % CI 48.68–50.43 | 48.68–50.43 | 5 | 12 / 15 |
| Latency p99.9 | 120.34 ms 95 % CI 112.06–141.49 | 112.06–141.49 | 5 | 12 / 15 |
| Latency p75 | 32.30 ms 95 % CI 31.71–32.72 | 31.71–32.72 | 5 | 11 / 15 |
| Latency p99.99 | 178.84 ms 95 % CI 149.30–218.21 | 149.30–218.21 | 5 | 13 / 15 |
| Latency mean | 22.61 ms 95 % CI 22.20–22.68 | 22.20–22.68 | 5 | 11 / 15 |
| Latency std. dev. | 19.14 ms 95 % CI 18.66–20.40 | 18.66–20.40 | 5 | 12 / 15 |
| Latency max | 209.69 ms 95 % CI 194.38–247.56 | 194.38–247.56 | 5 | 12 / 15 |
| CPU | ||||
| CPU used | 1.97 cores 95 % CI 1.97–1.97 | 1.97–1.97 | 5 | — |
| User-space CPU share | 0.555 95 % CI 0.551–0.557 | 0.551–0.557 | 5 | — |
| CPU throttling | 7.1 ms 95 % CI 6.4–9.1 | 6.4–9.1 | 5 | 7 / 15 |
| Memory | ||||
| Anonymous memory peak | 633.5 MiB 95 % CI 629.3–652.0 | 629.3–652.0 | 5 | 14 / 15 |
| Database | ||||
| Database CPU per request | 84.4 µs 95 % CI 83.9–87.1 | 83.9–87.1 | 5 | 9 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 742.2 J 95 % CI 734.3–747.5 | 734.3–747.5 | 5 | — |
| Package energy per request | 1.893 mJ 95 % CI 1.868–1.916 | 1.868–1.916 | 5 | 9 / 15 |
| Network | ||||
| Bytes per response | 137 B 95 % CI 137–137 | 137–137 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.31 runnable tasks 95 % CI 5.85–7.56 | 5.85–7.56 | 5 | 9 / 15 |
| CPU clock | 3,533 MHz 95 % CI 3,427–3,547 | 3,427–3,547 | 5 | — |
| Load generator CPU | 0.32 95 % CI 0.32–0.33 | 0.32–0.33 | 5 | 7 / 15 |
Fixed rate
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,999 req/s 95 % CI 4,999–4,999 | 4,999–4,999 | 5 | 11 / 15 |
| Latency p99 | 2.83 ms 95 % CI 2.64–5.39 | 2.64–5.39 | 5 | 10 / 15 |
| CPU per request | 209.7 µs 95 % CI 207.0–210.8 | 207.0–210.8 | 5 | 4 / 15 |
| Memory under load (PSS) | 671.4 MiB 95 % CI 664.9–686.9 | 664.9–686.9 | 5 | 14 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.76 ms 95 % CI 0.76–0.77 | 0.76–0.77 | 5 | 6 / 15 |
| Latency p90 | 1.15 ms 95 % CI 1.14–1.17 | 1.14–1.17 | 5 | 6 / 15 |
| Latency p99.9 | 14.85 ms 95 % CI 11.47–18.48 | 11.47–18.48 | 5 | 12 / 15 |
| Latency p75 | 0.91 ms 95 % CI 0.91–0.94 | 0.91–0.94 | 5 | 5 / 15 |
| Latency p99.99 | 25.43 ms 95 % CI 17.52–55.48 | 17.52–55.48 | 5 | 13 / 15 |
| Latency mean | 0.87 ms 95 % CI 0.86–0.94 | 0.86–0.94 | 5 | 7 / 15 |
| Latency max | 31.77 ms 95 % CI 21.70–61.79 | 21.70–61.79 | 5 | 13 / 15 |
| CPU | ||||
| CPU used | 1.05 cores 95 % CI 1.03–1.05 | 1.03–1.05 | 5 | — |
| User-space CPU share | 0.600 95 % CI 0.594–0.608 | 0.594–0.608 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 637.9 MiB 95 % CI 631.6–653.4 | 631.6–653.4 | 5 | 14 / 15 |
| Database | ||||
| Database CPU per request | 146.8 µs 95 % CI 145.6–148.6 | 145.6–148.6 | 5 | 6 / 15 |
| SELECTs per request | 1.00 queries | — | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 414.6 J 95 % CI 404.2–423.1 | 404.2–423.1 | 5 | — |
| Package energy per request | 4.146 mJ 95 % CI 4.042–4.231 | 4.042–4.231 | 5 | 10 / 15 |
| Network | ||||
| Bytes per response | 30 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 12 KiB | — | 5 | 14 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.86 runnable tasks 95 % CI 5.42–7.81 | 5.42–7.81 | 5 | 9 / 15 |
| CPU clock | 1,230 MHz 95 % CI 1,213–1,264 | 1,213–1,264 | 5 | — |
| Load generator CPU | 0.14 95 % CI 0.14–0.14 | 0.14–0.14 | 5 | 12 / 15 |