Overall
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 17.0 | — | — | 14 / 15 |
| CPU efficiency index | 15.5 | — | — | 14 / 15 |
| Peak memory | 244.3 MiB | — | — | 13 / 15 |
The same Spring Boot service compiled to a native executable with GraalVM Community Edition.
Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 17.0 | — | — | 14 / 15 |
| CPU efficiency index | 15.5 | — | — | 14 / 15 |
| Peak memory | 244.3 MiB | — | — | 13 / 15 |
Start-up
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Cold start | 274 ms 95 % CI 262–348 | 262–348 | 5 | 5 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Memory | ||||
| Memory at idle | 98.2 MiB 95 % CI 98.2–98.2 | 98.2–98.2 | 5 | 9 / 15 |
| Anonymous memory at idle | 39.5 MiB 95 % CI 39.5–39.5 | 39.5–39.5 | 5 | 9 / 15 |
| Start-up | ||||
| Cold start (fastest) | 259 ms 95 % CI 239–265 | 239–265 | 5 | 5 / 15 |
| Cold start (slowest) | 285 ms 95 % CI 278–357 | 278–357 | 5 | 5 / 15 |
| Footprint | ||||
| Image size | 248 MB | — | 5 | 5 / 15 |
Cold load
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 14,545 req/s 95 % CI 14,027–14,711 | 14,027–14,711 | 5 | 11 / 15 |
| Latency p99 | 36.57 ms 95 % CI 33.92–38.77 | 33.92–38.77 | 5 | 11 / 15 |
| CPU per request | 133.4 µs 95 % CI 131.7–138.0 | 131.7–138.0 | 5 | 12 / 15 |
| Memory under load (PSS) | 195.6 MiB 95 % CI 190.8–212.5 | 190.8–212.5 | 5 | 12 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 8.14 ms 95 % CI 8.08–8.34 | 8.08–8.34 | 5 | 11 / 15 |
| Latency p90 | 15.92 ms 95 % CI 15.60–16.98 | 15.60–16.98 | 5 | 11 / 15 |
| Latency p99.9 | 86.37 ms 95 % CI 71.31–87.79 | 71.31–87.79 | 5 | 9 / 15 |
| Latency p75 | 10.60 ms 95 % CI 10.48–11.53 | 10.48–11.53 | 5 | 11 / 15 |
| Latency p99.99 | 106.18 ms 95 % CI 92.92–116.29 | 92.92–116.29 | 5 | 9 / 15 |
| Latency mean | 9.53 ms 95 % CI 9.32–9.85 | 9.32–9.85 | 5 | 11 / 15 |
| Latency std. dev. | 7.29 ms 95 % CI 6.67–7.67 | 6.67–7.67 | 5 | 9 / 15 |
| Latency max | 120.83 ms 95 % CI 113.47–171.57 | 113.47–171.57 | 5 | 9 / 15 |
| CPU | ||||
| CPU used | 1.93 cores 95 % CI 1.93–1.94 | 1.93–1.94 | 5 | — |
| User-space CPU share | 0.692 95 % CI 0.690–0.703 | 0.690–0.703 | 5 | — |
| CPU throttling | 2.2 ms 95 % CI 1.0–6.0 | 1.0–6.0 | 5 | 7 / 15 |
| Memory | ||||
| Anonymous memory peak | 134.4 MiB 95 % CI 129.4–151.4 | 129.4–151.4 | 5 | 11 / 15 |
| Database | ||||
| Database CPU per request | 114.7 µs 95 % CI 109.4–115.2 | 109.4–115.2 | 5 | 12 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Start-up | ||||
| Cold vs. warm throughput | 1.01 95 % CI 1.00–1.03 | 1.00–1.03 | 5 | 5 / 15 |
| Energy | ||||
| CPU package energy | 471.3 J 95 % CI 461.0–481.5 | 461.0–481.5 | 5 | — |
| Package energy per request | 3.198 mJ 95 % CI 3.162–3.399 | 3.162–3.399 | 5 | 12 / 15 |
| Network | ||||
| Bytes per response | 137 B 95 % CI 137–137 | 137–137 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.27 runnable tasks 95 % CI 3.10–6.10 | 3.10–6.10 | 5 | 15 / 15 |
| CPU clock | 3,536 MHz 95 % CI 3,391–3,541 | 3,391–3,541 | 5 | — |
| Load generator CPU | 0.17 95 % CI 0.15–0.18 | 0.15–0.18 | 5 | 5 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 23,641 req/s 95 % CI 21,877–23,689 | 21,877–23,689 | 5 | 14 / 15 |
| Latency p99 | 15.13 ms 95 % CI 14.32–17.49 | 14.32–17.49 | 5 | 15 / 15 |
| CPU per request | 82.3 µs 95 % CI 82.1–88.9 | 82.1–88.9 | 5 | 14 / 15 |
| Memory under load (PSS) | 124.5 MiB 95 % CI 116.8–125.4 | 116.8–125.4 | 5 | 9 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 5.21 ms 95 % CI 5.19–5.55 | 5.19–5.55 | 5 | 13 / 15 |
| Latency p90 | 6.73 ms 95 % CI 6.65–7.58 | 6.65–7.58 | 5 | 13 / 15 |
| Latency p99.9 | 24.80 ms 95 % CI 24.31–32.79 | 24.31–32.79 | 5 | 14 / 15 |
| Latency p75 | 5.73 ms 95 % CI 5.70–6.53 | 5.70–6.53 | 5 | 13 / 15 |
| Latency p99.99 | 29.08 ms 95 % CI 26.55–36.91 | 26.55–36.91 | 5 | 12 / 15 |
| Latency mean | 5.51 ms 95 % CI 5.48–5.96 | 5.48–5.96 | 5 | 14 / 15 |
| Latency std. dev. | 2.00 ms 95 % CI 1.93–2.50 | 1.93–2.50 | 5 | 13 / 15 |
| Latency max | 30.36 ms 95 % CI 28.22–37.16 | 28.22–37.16 | 5 | 11 / 15 |
| CPU | ||||
| CPU used | 1.94 cores 95 % CI 1.94–1.94 | 1.94–1.94 | 5 | — |
| User-space CPU share | 0.763 95 % CI 0.762–0.766 | 0.762–0.766 | 5 | — |
| CPU throttling | 0.4 ms 95 % CI 0.0–0.8 | 0.0–0.8 | 5 | 7 / 15 |
| Memory | ||||
| Anonymous memory peak | 61.9 MiB 95 % CI 53.8–62.9 | 53.8–62.9 | 5 | 9 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 12 / 15 |
| Energy | ||||
| CPU package energy | 677.4 J 95 % CI 674.0–745.7 | 674.0–745.7 | 5 | — |
| Package energy per request | 1.906 mJ 95 % CI 1.899–2.257 | 1.899–2.257 | 5 | 14 / 15 |
| Network | ||||
| Bytes per response | 133 B 95 % CI 133–133 | 133–133 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.02 runnable tasks 95 % CI 3.53–5.89 | 3.53–5.89 | 5 | 3 / 15 |
| CPU clock | 3,763 MHz 95 % CI 3,733–3,800 | 3,733–3,800 | 5 | — |
| Load generator CPU | 0.28 95 % CI 0.24–0.28 | 0.24–0.28 | 5 | 3 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 14,559 req/s 95 % CI 13,654–14,594 | 13,654–14,594 | 5 | 13 / 15 |
| Latency p99 | 33.62 ms 95 % CI 27.43–39.79 | 27.43–39.79 | 5 | 14 / 15 |
| CPU per request | 134.1 µs 95 % CI 133.5–142.9 | 133.5–142.9 | 5 | 13 / 15 |
| Memory under load (PSS) | 179.0 MiB 95 % CI 172.3–181.1 | 172.3–181.1 | 5 | 11 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 8.17 ms 95 % CI 8.15–8.57 | 8.15–8.57 | 5 | 13 / 15 |
| Latency p90 | 15.96 ms 95 % CI 15.17–17.21 | 15.17–17.21 | 5 | 13 / 15 |
| Latency p99.9 | 138.60 ms 95 % CI 42.74–209.97 | 42.74–209.97 | 5 | 15 / 15 |
| Latency p75 | 10.84 ms 95 % CI 10.34–12.03 | 10.34–12.03 | 5 | 13 / 15 |
| Latency p99.99 | 269.98 ms 95 % CI 51.48–453.69 | 51.48–453.69 | 5 | 15 / 15 |
| Latency mean | 9.71 ms 95 % CI 9.09–10.64 | 9.09–10.64 | 5 | 13 / 15 |
| Latency std. dev. | 9.81 ms 95 % CI 5.15–14.20 | 5.15–14.20 | 5 | 15 / 15 |
| Latency max | 340.21 ms 95 % CI 56.13–519.47 | 56.13–519.47 | 5 | 15 / 15 |
| CPU | ||||
| CPU used | 1.95 cores 95 % CI 1.95–1.95 | 1.95–1.95 | 5 | — |
| User-space CPU share | 0.695 95 % CI 0.691–0.698 | 0.691–0.698 | 5 | — |
| CPU throttling | 3.0 ms 95 % CI 1.1–4.3 | 1.1–4.3 | 5 | 9 / 15 |
| Memory | ||||
| Anonymous memory peak | 116.6 MiB 95 % CI 109.7–118.5 | 109.7–118.5 | 5 | 11 / 15 |
| Database | ||||
| Database CPU per request | 114.2 µs 95 % CI 106.3–114.6 | 106.3–114.6 | 5 | 14 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 702.2 J 95 % CI 698.4–751.7 | 698.4–751.7 | 5 | — |
| Package energy per request | 3.219 mJ 95 % CI 3.187–3.664 | 3.187–3.664 | 5 | 14 / 15 |
| Network | ||||
| Bytes per response | 137 B 95 % CI 137–137 | 137–137 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.72 runnable tasks 95 % CI 4.36–6.00 | 4.36–6.00 | 5 | 2 / 15 |
| CPU clock | 3,607 MHz 95 % CI 3,540–3,627 | 3,540–3,627 | 5 | — |
| Load generator CPU | 0.17 95 % CI 0.14–0.17 | 0.14–0.17 | 5 | 3 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 2,234 req/s 95 % CI 2,070–2,244 | 2,070–2,244 | 5 | 14 / 15 |
| Latency p99 | 146.33 ms 95 % CI 138.70–161.36 | 138.70–161.36 | 5 | 15 / 15 |
| CPU per request | 873.2 µs 95 % CI 869.2–942.1 | 869.2–942.1 | 5 | 14 / 15 |
| Memory under load (PSS) | 226.6 MiB 95 % CI 216.2–229.9 | 216.2–229.9 | 5 | 13 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 54.98 ms 95 % CI 54.74–59.27 | 54.74–59.27 | 5 | 14 / 15 |
| Latency p90 | 91.94 ms 95 % CI 89.95–102.54 | 89.95–102.54 | 5 | 15 / 15 |
| Latency p99.9 | 203.68 ms 95 % CI 183.71–224.36 | 183.71–224.36 | 5 | 15 / 15 |
| Latency p75 | 72.57 ms 95 % CI 71.72–79.73 | 71.72–79.73 | 5 | 15 / 15 |
| Latency p99.99 | 236.67 ms 95 % CI 219.45–290.61 | 219.45–290.61 | 5 | 15 / 15 |
| Latency mean | 58.05 ms 95 % CI 57.49–62.69 | 57.49–62.69 | 5 | 14 / 15 |
| Latency std. dev. | 27.73 ms 95 % CI 26.55–31.94 | 26.55–31.94 | 5 | 15 / 15 |
| Latency max | 284.18 ms 95 % CI 252.48–346.72 | 252.48–346.72 | 5 | 15 / 15 |
| CPU | ||||
| CPU used | 1.95 cores 95 % CI 1.94–1.95 | 1.94–1.95 | 5 | — |
| User-space CPU share | 0.592 95 % CI 0.587–0.594 | 0.587–0.594 | 5 | — |
| CPU throttling | 2.8 ms 95 % CI 0.0–5.6 | 0.0–5.6 | 5 | 9 / 15 |
| Memory | ||||
| Anonymous memory peak | 164.0 MiB 95 % CI 153.6–168.0 | 153.6–168.0 | 5 | 11 / 15 |
| Database | ||||
| Database CPU per request | 1,035.3 µs 95 % CI 1,028.3–1,082.3 | 1,028.3–1,082.3 | 5 | 14 / 15 |
| SELECTs per request | 20.08 queries 95 % CI 20.07–20.08 | 20.07–20.08 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 798.5 J 95 % CI 796.9–842.4 | 796.9–842.4 | 5 | — |
| Package energy per request | 23.803 mJ 95 % CI 23.653–27.062 | 23.653–27.062 | 5 | 14 / 15 |
| Network | ||||
| Bytes per response | 744 B 95 % CI 744–744 | 744–744 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.97 runnable tasks 95 % CI 4.64–6.57 | 4.64–6.57 | 5 | 4 / 15 |
| CPU clock | 3,627 MHz 95 % CI 3,560–3,717 | 3,560–3,717 | 5 | — |
| Load generator CPU | 0.03 95 % CI 0.03–0.03 | 0.03–0.03 | 5 | 2 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 3,932 req/s 95 % CI 3,796–3,940 | 3,796–3,940 | 5 | 14 / 15 |
| Latency p99 | 84.42 ms 95 % CI 83.35–103.35 | 83.35–103.35 | 5 | 15 / 15 |
| CPU per request | 496.3 µs 95 % CI 495.4–507.5 | 495.4–507.5 | 5 | 14 / 15 |
| Memory under load (PSS) | 203.2 MiB 95 % CI 194.1–205.7 | 194.1–205.7 | 5 | 11 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 31.38 ms 95 % CI 31.12–32.13 | 31.12–32.13 | 5 | 14 / 15 |
| Latency p90 | 52.22 ms 95 % CI 52.13–57.41 | 52.13–57.41 | 5 | 15 / 15 |
| Latency p99.9 | 126.47 ms 95 % CI 118.64–155.14 | 118.64–155.14 | 5 | 15 / 15 |
| Latency p75 | 41.34 ms 95 % CI 41.03–43.52 | 41.03–43.52 | 5 | 15 / 15 |
| Latency p99.99 | 166.13 ms 95 % CI 146.78–188.39 | 146.78–188.39 | 5 | 15 / 15 |
| Latency mean | 33.08 ms 95 % CI 32.92–34.79 | 32.92–34.79 | 5 | 14 / 15 |
| Latency std. dev. | 16.11 ms 95 % CI 15.88–19.63 | 15.88–19.63 | 5 | 15 / 15 |
| Latency max | 202.48 ms 95 % CI 187.00–241.58 | 187.00–241.58 | 5 | 15 / 15 |
| CPU | ||||
| CPU used | 1.95 cores 95 % CI 1.92–1.95 | 1.92–1.95 | 5 | — |
| User-space CPU share | 0.612 95 % CI 0.609–0.613 | 0.609–0.613 | 5 | — |
| CPU throttling | 4.5 ms 95 % CI 1.7–4.7 | 1.7–4.7 | 5 | 9 / 15 |
| Memory | ||||
| Anonymous memory peak | 140.6 MiB 95 % CI 131.5–143.2 | 131.5–143.2 | 5 | 11 / 15 |
| Database | ||||
| Database CPU per request | 585.4 µs 95 % CI 583.0–597.7 | 583.0–597.7 | 5 | 15 / 15 |
| SELECTs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| UPDATEs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| Energy | ||||
| CPU package energy | 828.6 J 95 % CI 822.8–836.6 | 822.8–836.6 | 5 | — |
| Package energy per request | 13.991 mJ 95 % CI 13.920–14.660 | 13.920–14.660 | 5 | 14 / 15 |
| Network | ||||
| Bytes per response | 267 B 95 % CI 267–267 | 267–267 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.39 runnable tasks 95 % CI 5.16–7.48 | 5.16–7.48 | 5 | 3 / 15 |
| CPU clock | 3,607 MHz 95 % CI 3,553–3,633 | 3,553–3,633 | 5 | — |
| Load generator CPU | 0.05 95 % CI 0.05–0.05 | 0.05–0.05 | 5 | 2 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,162 req/s 95 % CI 4,066–4,200 | 4,066–4,200 | 5 | 14 / 15 |
| Latency p99 | 63.08 ms 95 % CI 60.61–68.15 | 60.61–68.15 | 5 | 14 / 15 |
| CPU per request | 468.7 µs 95 % CI 464.4–479.9 | 464.4–479.9 | 5 | 14 / 15 |
| Memory under load (PSS) | 244.3 MiB 95 % CI 239.7–260.9 | 239.7–260.9 | 5 | 13 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 28.54 ms 95 % CI 28.21–29.07 | 28.21–29.07 | 5 | 14 / 15 |
| Latency p90 | 46.24 ms 95 % CI 45.78–48.48 | 45.78–48.48 | 5 | 14 / 15 |
| Latency p99.9 | 78.55 ms 95 % CI 75.50–87.95 | 75.50–87.95 | 5 | 14 / 15 |
| Latency p75 | 32.57 ms 95 % CI 31.89–34.22 | 31.89–34.22 | 5 | 13 / 15 |
| Latency p99.99 | 99.34 ms 95 % CI 89.00–105.32 | 89.00–105.32 | 5 | 14 / 15 |
| Latency mean | 30.76 ms 95 % CI 30.43–31.50 | 30.43–31.50 | 5 | 14 / 15 |
| Latency std. dev. | 10.15 ms 95 % CI 9.76–11.30 | 9.76–11.30 | 5 | 13 / 15 |
| Latency max | 120.00 ms 95 % CI 106.80–130.43 | 106.80–130.43 | 5 | 14 / 15 |
| CPU | ||||
| CPU used | 1.95 cores 95 % CI 1.95–1.95 | 1.95–1.95 | 5 | — |
| User-space CPU share | 0.876 95 % CI 0.874–0.878 | 0.874–0.878 | 5 | — |
| CPU throttling | 1.9 ms 95 % CI 1.2–3.1 | 1.2–3.1 | 5 | 6 / 15 |
| Memory | ||||
| Anonymous memory peak | 181.6 MiB 95 % CI 177.1–198.3 | 177.1–198.3 | 5 | 13 / 15 |
| Database | ||||
| Database CPU per request | 237.1 µs 95 % CI 235.0–237.2 | 235.0–237.2 | 5 | 13 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 731.1 J 95 % CI 727.2–751.0 | 727.2–751.0 | 5 | — |
| Package energy per request | 11.652 mJ 95 % CI 11.577–12.270 | 11.577–12.270 | 5 | 14 / 15 |
| Network | ||||
| Bytes per response | 4,738 B 95 % CI 4,738–4,738 | 4,738–4,738 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.60 runnable tasks 95 % CI 4.63–8.13 | 4.63–8.13 | 5 | 3 / 15 |
| CPU clock | 3,610 MHz 95 % CI 3,541–3,627 | 3,541–3,627 | 5 | — |
| Load generator CPU | 0.06 95 % CI 0.05–0.06 | 0.05–0.06 | 5 | 2 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,297 req/s 95 % CI 4,239–4,345 | 4,239–4,345 | 5 | 15 / 15 |
| Latency p99 | 41.74 ms 95 % CI 41.20–43.11 | 41.20–43.11 | 5 | 15 / 15 |
| CPU per request | 453.0 µs 95 % CI 448.2–458.7 | 448.2–458.7 | 5 | 15 / 15 |
| Memory under load (PSS) | 127.2 MiB 95 % CI 125.7–129.4 | 125.7–129.4 | 5 | 9 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 29.13 ms 95 % CI 28.83–29.23 | 28.83–29.23 | 5 | 15 / 15 |
| Latency p90 | 31.06 ms 95 % CI 30.64–33.01 | 30.64–33.01 | 5 | 15 / 15 |
| Latency p99.9 | 44.28 ms 95 % CI 42.78–53.27 | 42.78–53.27 | 5 | 13 / 15 |
| Latency p75 | 29.91 ms 95 % CI 29.51–30.04 | 29.51–30.04 | 5 | 15 / 15 |
| Latency p99.99 | 46.22 ms 95 % CI 44.09–58.79 | 44.09–58.79 | 5 | 12 / 15 |
| Latency mean | 29.71 ms 95 % CI 29.38–30.09 | 29.38–30.09 | 5 | 15 / 15 |
| Latency std. dev. | 3.09 ms 95 % CI 3.08–3.78 | 3.08–3.78 | 5 | 12 / 15 |
| Latency max | 46.54 ms 95 % CI 45.02–60.07 | 45.02–60.07 | 5 | 11 / 15 |
| CPU | ||||
| CPU used | 1.94 cores 95 % CI 1.94–1.95 | 1.94–1.95 | 5 | — |
| User-space CPU share | 0.910 95 % CI 0.907–0.911 | 0.907–0.911 | 5 | — |
| CPU throttling | 0.0 ms 95 % CI 0.0–0.8 | 0.0–0.8 | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 64.6 MiB 95 % CI 63.1–66.8 | 63.1–66.8 | 5 | 9 / 15 |
| Database | ||||
| Database CPU per request | 0.2 µs 95 % CI < 0.1–0.4 | < 0.1–0.4 | 5 | 14 / 15 |
| Energy | ||||
| CPU package energy | 702.9 J 95 % CI 700.0–710.9 | 700.0–710.9 | 5 | — |
| Package energy per request | 10.869 mJ 95 % CI 10.796–11.149 | 10.796–11.149 | 5 | 15 / 15 |
| Network | ||||
| Bytes per response | 195 B 95 % CI 195–195 | 195–195 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.69 runnable tasks 95 % CI 4.40–6.81 | 4.40–6.81 | 5 | 2 / 15 |
| CPU clock | 3,767 MHz 95 % CI 3,726–3,777 | 3,726–3,777 | 5 | — |
| Load generator CPU | 0.07 95 % CI 0.07–0.07 | 0.07–0.07 | 5 | 1 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 14,336 req/s 95 % CI 14,076–14,522 | 14,076–14,522 | 5 | 13 / 15 |
| Latency p99 | 6.90 ms 95 % CI 6.78–7.94 | 6.78–7.94 | 5 | 15 / 15 |
| CPU per request | 117.9 µs 95 % CI 117.5–120.0 | 117.5–120.0 | 5 | 13 / 15 |
| Memory under load (PSS) | 107.2 MiB 95 % CI 106.4–109.3 | 106.4–109.3 | 5 | 9 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.04 ms 95 % CI 1.02–1.05 | 1.02–1.05 | 5 | 13 / 15 |
| Latency p90 | 1.55 ms 95 % CI 1.54–1.62 | 1.54–1.62 | 5 | 13 / 15 |
| Latency p99.9 | 14.00 ms 95 % CI 13.17–17.21 | 13.17–17.21 | 5 | 15 / 15 |
| Latency p75 | 1.26 ms 95 % CI 1.25–1.29 | 1.25–1.29 | 5 | 13 / 15 |
| Latency p99.99 | 16.84 ms 95 % CI 14.83–25.01 | 14.83–25.01 | 5 | 15 / 15 |
| Latency mean | 1.22 ms 95 % CI 1.21–1.27 | 1.21–1.27 | 5 | 13 / 15 |
| Latency std. dev. | 1.11 ms 95 % CI 1.07–1.33 | 1.07–1.33 | 5 | 15 / 15 |
| Latency max | 20.92 ms 95 % CI 17.38–27.85 | 17.38–27.85 | 5 | 15 / 15 |
| CPU | ||||
| CPU used | 1.69 cores 95 % CI 1.69–1.71 | 1.69–1.71 | 5 | — |
| User-space CPU share | 0.725 95 % CI 0.717–0.728 | 0.717–0.728 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 44.6 MiB 95 % CI 43.8–46.7 | 43.8–46.7 | 5 | 9 / 15 |
| Database | ||||
| Database CPU per request | 118.2 µs 95 % CI 112.8–118.9 | 112.8–118.9 | 5 | 14 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 665.8 J 95 % CI 661.1–684.8 | 661.1–684.8 | 5 | — |
| Package energy per request | 3.075 mJ 95 % CI 3.042–3.222 | 3.042–3.222 | 5 | 14 / 15 |
| Network | ||||
| Bytes per response | 137 B 95 % CI 137–137 | 137–137 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.24 runnable tasks 95 % CI 4.14–5.77 | 4.14–5.77 | 5 | 2 / 15 |
| CPU clock | 3,476 MHz 95 % CI 3,366–3,513 | 3,366–3,513 | 5 | — |
| Load generator CPU | 0.17 95 % CI 0.16–0.17 | 0.16–0.17 | 5 | 3 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 6,207 req/s 95 % CI 5,354–7,927 | 5,354–7,927 | 5 | 15 / 15 |
| Latency p99 | 269.66 ms 95 % CI 220.74–298.46 | 220.74–298.46 | 5 | 15 / 15 |
| CPU per request | 239.3 µs 95 % CI 202.3–266.9 | 202.3–266.9 | 5 | 14 / 15 |
| Memory under load (PSS) | 239.8 MiB 95 % CI 216.7–276.2 | 216.7–276.2 | 5 | 13 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 81.53 ms 95 % CI 67.08–101.07 | 67.08–101.07 | 5 | 15 / 15 |
| Latency p90 | 176.66 ms 95 % CI 135.65–196.63 | 135.65–196.63 | 5 | 15 / 15 |
| Latency p99.9 | 388.66 ms 95 % CI 349.83–457.31 | 349.83–457.31 | 5 | 15 / 15 |
| Latency p75 | 135.05 ms 95 % CI 99.50–146.77 | 99.50–146.77 | 5 | 15 / 15 |
| Latency p99.99 | 561.97 ms 95 % CI 412.92–655.95 | 412.92–655.95 | 5 | 15 / 15 |
| Latency mean | 87.38 ms 95 % CI 68.56–100.63 | 68.56–100.63 | 5 | 15 / 15 |
| Latency std. dev. | 67.73 ms 95 % CI 51.28–74.09 | 51.28–74.09 | 5 | 15 / 15 |
| Latency max | 589.65 ms 95 % CI 474.50–753.47 | 474.50–753.47 | 5 | 15 / 15 |
| CPU | ||||
| CPU used | 1.48 cores 95 % CI 1.43–1.60 | 1.43–1.60 | 5 | — |
| User-space CPU share | 0.690 95 % CI 0.688–0.696 | 0.688–0.696 | 5 | — |
| CPU throttling | 0.0 ms 95 % CI 0.0–0.4 | 0.0–0.4 | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 177.3 MiB 95 % CI 154.6–213.5 | 154.6–213.5 | 5 | 13 / 15 |
| Database | ||||
| Database CPU per request | 109.9 µs 95 % CI 109.1–110.9 | 109.1–110.9 | 5 | 14 / 15 |
| SELECTs per request | 1.01 queries 95 % CI 1.00–1.01 | 1.00–1.01 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 617.0 J 95 % CI 599.2–632.4 | 599.2–632.4 | 5 | — |
| Package energy per request | 6.468 mJ 95 % CI 5.297–7.425 | 5.297–7.425 | 5 | 15 / 15 |
| Network | ||||
| Bytes per response | 137 B 95 % CI 137–137 | 137–137 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.70 runnable tasks 95 % CI 4.08–5.49 | 4.08–5.49 | 5 | 2 / 15 |
| CPU clock | 3,024 MHz 95 % CI 2,772–3,278 | 2,772–3,278 | 5 | — |
| Load generator CPU | 0.08 95 % CI 0.07–0.10 | 0.07–0.10 | 5 | 1 / 15 |
Fixed rate
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,999 req/s 95 % CI 4,998–4,999 | 4,998–4,999 | 5 | 7 / 15 |
| Latency p99 | 38.56 ms 95 % CI 5.12–41.99 | 5.12–41.99 | 5 | 15 / 15 |
| CPU per request | 267.6 µs 95 % CI 250.2–271.0 | 250.2–271.0 | 5 | 14 / 15 |
| Memory under load (PSS) | 174.9 MiB 95 % CI 146.4–284.5 | 146.4–284.5 | 5 | 11 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.07 ms 95 % CI 1.05–1.14 | 1.05–1.14 | 5 | 12 / 15 |
| Latency p90 | 3.76 ms 95 % CI 1.78–5.23 | 1.78–5.23 | 5 | 14 / 15 |
| Latency p99.9 | 48.38 ms 95 % CI 21.58–53.38 | 21.58–53.38 | 5 | 15 / 15 |
| Latency p75 | 1.71 ms 95 % CI 1.33–2.13 | 1.33–2.13 | 5 | 14 / 15 |
| Latency p99.99 | 52.31 ms 95 % CI 31.61–78.38 | 31.61–78.38 | 5 | 15 / 15 |
| Latency mean | 2.72 ms 95 % CI 1.27–3.55 | 1.27–3.55 | 5 | 15 / 15 |
| Latency max | 60.04 ms 95 % CI 33.32–85.94 | 33.32–85.94 | 5 | 14 / 15 |
| CPU | ||||
| CPU used | 1.33 cores 95 % CI 1.25–1.35 | 1.25–1.35 | 5 | — |
| User-space CPU share | 0.747 95 % CI 0.744–0.755 | 0.744–0.755 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 112.2 MiB 95 % CI 83.8–221.9 | 83.8–221.9 | 5 | 9 / 15 |
| Database | ||||
| Database CPU per request | 127.1 µs 95 % CI 110.5–130.7 | 110.5–130.7 | 5 | 2 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 487.7 J 95 % CI 474.5–634.6 | 474.5–634.6 | 5 | — |
| Package energy per request | 4.878 mJ 95 % CI 4.745–6.347 | 4.745–6.347 | 5 | 13 / 15 |
| Network | ||||
| Bytes per response | 30 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.39 runnable tasks 95 % CI 3.87–5.32 | 3.87–5.32 | 5 | 2 / 15 |
| CPU clock | 2,239 MHz 95 % CI 2,072–2,525 | 2,072–2,525 | 5 | — |
| Load generator CPU | 0.13 95 % CI 0.11–0.13 | 0.11–0.13 | 5 | 4 / 15 |