Overall
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 45.6 | — | — | 9 / 15 |
| CPU efficiency index | 41.9 | — | — | 10 / 15 |
| Peak memory | 680.0 MiB | — | — | 15 / 15 |
Spring Boot with Spring MVC on virtual threads, JdbcClient and HikariCP (16 connections), running on the Java 27 JVM.
Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 45.6 | — | — | 9 / 15 |
| CPU efficiency index | 41.9 | — | — | 10 / 15 |
| Peak memory | 680.0 MiB | — | — | 15 / 15 |
Start-up
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Cold start | 2,368 ms 95 % CI 2,347–2,477 | 2,347–2,477 | 5 | 15 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Memory | ||||
| Memory at idle | 195.6 MiB 95 % CI 193.8–200.9 | 193.8–200.9 | 5 | 15 / 15 |
| Anonymous memory at idle | 168.7 MiB 95 % CI 167.0–173.9 | 167.0–173.9 | 5 | 15 / 15 |
| Start-up | ||||
| Cold start (fastest) | 2,307 ms 95 % CI 2,225–2,392 | 2,225–2,392 | 5 | 15 / 15 |
| Cold start (slowest) | 2,484 ms 95 % CI 2,404–2,522 | 2,404–2,522 | 5 | 15 / 15 |
| Footprint | ||||
| Image size | 561 MB | — | 5 | 13 / 15 |
Cold load
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 7,898 req/s 95 % CI 7,396–8,272 | 7,396–8,272 | 5 | 15 / 15 |
| Latency p99 | 238.10 ms 95 % CI 206.68–255.06 | 206.68–255.06 | 5 | 15 / 15 |
| CPU per request | 252.2 µs 95 % CI 241.3–269.3 | 241.3–269.3 | 5 | 15 / 15 |
| Memory under load (PSS) | 241.7 MiB 95 % CI 234.2–389.5 | 234.2–389.5 | 5 | 14 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 13.91 ms 95 % CI 13.47–14.64 | 13.47–14.64 | 5 | 14 / 15 |
| Latency p90 | 42.77 ms 95 % CI 37.93–48.01 | 37.93–48.01 | 5 | 15 / 15 |
| Latency p99.9 | 406.76 ms 95 % CI 390.32–455.12 | 390.32–455.12 | 5 | 15 / 15 |
| Latency p75 | 22.85 ms 95 % CI 20.85–24.14 | 20.85–24.14 | 5 | 15 / 15 |
| Latency p99.99 | 597.09 ms 95 % CI 449.32–633.93 | 449.32–633.93 | 5 | 15 / 15 |
| Latency mean | 24.87 ms 95 % CI 22.13–26.19 | 22.13–26.19 | 5 | 15 / 15 |
| Latency std. dev. | 42.32 ms 95 % CI 36.21–44.43 | 36.21–44.43 | 5 | 15 / 15 |
| Latency max | 637.67 ms 95 % CI 465.81–767.75 | 465.81–767.75 | 5 | 15 / 15 |
| CPU | ||||
| CPU used | 1.99 cores 95 % CI 1.98–1.99 | 1.98–1.99 | 5 | — |
| User-space CPU share | 0.816 95 % CI 0.814–0.826 | 0.814–0.826 | 5 | — |
| CPU throttling | 5.5 ms 95 % CI 4.0–9.2 | 4.0–9.2 | 5 | 9 / 15 |
| Memory | ||||
| Anonymous memory peak | 214.6 MiB 95 % CI 207.1–362.6 | 207.1–362.6 | 5 | 14 / 15 |
| Database | ||||
| Database CPU per request | 120.1 µs 95 % CI 119.5–121.2 | 119.5–121.2 | 5 | 14 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Start-up | ||||
| Cold vs. warm throughput | 0.27 95 % CI 0.25–0.28 | 0.25–0.28 | 5 | 15 / 15 |
| Energy | ||||
| CPU package energy | 476.8 J 95 % CI 474.0–479.7 | 474.0–479.7 | 5 | — |
| Package energy per request | 6.053 mJ 95 % CI 5.741–6.429 | 5.741–6.429 | 5 | 15 / 15 |
| Network | ||||
| Bytes per response | 137 B 95 % CI 137–137 | 137–137 | 5 | — |
| Disk I/O | ||||
| Disk writes | 28 KiB | — | 5 | 13 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.53 runnable tasks 95 % CI 3.33–5.54 | 3.33–5.54 | 5 | 10 / 15 |
| CPU clock | 3,540 MHz 95 % CI 3,440–3,540 | 3,440–3,540 | 5 | — |
| Load generator CPU | 0.10 95 % CI 0.09–0.10 | 0.09–0.10 | 5 | 1 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 56,745 req/s 95 % CI 54,212–62,241 | 54,212–62,241 | 5 | 9 / 15 |
| Latency p99 | 4.27 ms 95 % CI 4.03–5.80 | 4.03–5.80 | 5 | 8 / 15 |
| CPU per request | 30.4 µs 95 % CI 29.3–31.1 | 29.3–31.1 | 5 | 10 / 15 |
| Memory under load (PSS) | 314.2 MiB 95 % CI 296.7–354.9 | 296.7–354.9 | 5 | 15 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 2.12 ms 95 % CI 1.93–2.35 | 1.93–2.35 | 5 | 9 / 15 |
| Latency p90 | 2.87 ms 95 % CI 2.77–3.07 | 2.77–3.07 | 5 | 10 / 15 |
| Latency p99.9 | 11.80 ms 95 % CI 8.18–43.05 | 8.18–43.05 | 5 | 10 / 15 |
| Latency p75 | 2.74 ms 95 % CI 2.48–2.81 | 2.48–2.81 | 5 | 11 / 15 |
| Latency p99.99 | 27.90 ms 95 % CI 11.27–66.98 | 11.27–66.98 | 5 | 11 / 15 |
| Latency mean | 2.24 ms 95 % CI 2.09–2.50 | 2.09–2.50 | 5 | 9 / 15 |
| Latency std. dev. | 0.93 ms 95 % CI 0.77–2.42 | 0.77–2.42 | 5 | 10 / 15 |
| Latency max | 30.26 ms 95 % CI 13.03–71.77 | 13.03–71.77 | 5 | 10 / 15 |
| CPU | ||||
| CPU used | 1.72 cores 95 % CI 1.68–1.82 | 1.68–1.82 | 5 | — |
| User-space CPU share | 0.583 95 % CI 0.573–0.588 | 0.573–0.588 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 287.2 MiB 95 % CI 269.7–327.8 | 269.7–327.8 | 5 | 15 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 8 / 15 |
| Energy | ||||
| CPU package energy | 688.1 J 95 % CI 678.8–700.4 | 678.8–700.4 | 5 | — |
| Package energy per request | 0.803 mJ 95 % CI 0.749–0.834 | 0.749–0.834 | 5 | 9 / 15 |
| Network | ||||
| Bytes per response | 133 B 95 % CI 133–133 | 133–133 | 5 | — |
| Disk I/O | ||||
| Disk writes | 36 KiB | — | 5 | 14 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.23 runnable tasks 95 % CI 4.93–6.94 | 4.93–6.94 | 5 | 6 / 15 |
| CPU clock | 3,653 MHz 95 % CI 3,547–3,669 | 3,547–3,669 | 5 | — |
| Load generator CPU | 0.56 95 % CI 0.55–0.57 | 0.55–0.57 | 5 | 7 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 29,423 req/s 95 % CI 29,092–30,110 | 29,092–30,110 | 5 | 10 / 15 |
| Latency p99 | 12.37 ms 95 % CI 12.27–12.90 | 12.27–12.90 | 5 | 12 / 15 |
| CPU per request | 66.3 µs 95 % CI 65.0–66.9 | 65.0–66.9 | 5 | 10 / 15 |
| Memory under load (PSS) | 313.6 MiB 95 % CI 297.0–330.1 | 297.0–330.1 | 5 | 15 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 3.83 ms 95 % CI 3.77–3.89 | 3.77–3.89 | 5 | 10 / 15 |
| Latency p90 | 7.76 ms 95 % CI 7.54–7.88 | 7.54–7.88 | 5 | 12 / 15 |
| Latency p99.9 | 18.39 ms 95 % CI 17.78–20.30 | 17.78–20.30 | 5 | 12 / 15 |
| Latency p75 | 5.69 ms 95 % CI 5.48–5.74 | 5.48–5.74 | 5 | 11 / 15 |
| Latency p99.99 | 25.40 ms 95 % CI 25.27–45.00 | 25.27–45.00 | 5 | 11 / 15 |
| Latency mean | 4.46 ms 95 % CI 4.36–4.51 | 4.36–4.51 | 5 | 10 / 15 |
| Latency std. dev. | 2.49 ms 95 % CI 2.43–2.63 | 2.43–2.63 | 5 | 12 / 15 |
| Latency max | 37.37 ms 95 % CI 33.32–65.99 | 33.32–65.99 | 5 | 11 / 15 |
| CPU | ||||
| CPU used | 1.95 cores 95 % CI 1.94–1.96 | 1.94–1.96 | 5 | — |
| User-space CPU share | 0.528 95 % CI 0.522–0.529 | 0.522–0.529 | 5 | — |
| CPU throttling | 2.7 ms 95 % CI 1.6–2.9 | 1.6–2.9 | 5 | 8 / 15 |
| Memory | ||||
| Anonymous memory peak | 286.7 MiB 95 % CI 270.0–303.0 | 270.0–303.0 | 5 | 15 / 15 |
| Database | ||||
| Database CPU per request | 76.9 µs 95 % CI 76.1–78.6 | 76.1–78.6 | 5 | 9 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 750.0 J 95 % CI 748.2–752.7 | 748.2–752.7 | 5 | — |
| Package energy per request | 1.701 mJ 95 % CI 1.653–1.706 | 1.653–1.706 | 5 | 10 / 15 |
| Network | ||||
| Bytes per response | 137 B 95 % CI 137–137 | 137–137 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.52 runnable tasks 95 % CI 5.09–6.44 | 5.09–6.44 | 5 | 9 / 15 |
| CPU clock | 3,533 MHz 95 % CI 3,480–3,587 | 3,480–3,587 | 5 | — |
| Load generator CPU | 0.35 95 % CI 0.34–0.35 | 0.34–0.35 | 5 | 6 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 3,793 req/s 95 % CI 3,765–3,852 | 3,765–3,852 | 5 | 6 / 15 |
| Latency p99 | 102.20 ms 95 % CI 101.66–112.63 | 101.66–112.63 | 5 | 14 / 15 |
| CPU per request | 522.7 µs 95 % CI 512.5–525.2 | 512.5–525.2 | 5 | 9 / 15 |
| Memory under load (PSS) | 313.7 MiB 95 % CI 297.1–328.2 | 297.1–328.2 | 5 | 15 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 31.31 ms 95 % CI 30.82–31.72 | 30.82–31.72 | 5 | 7 / 15 |
| Latency p90 | 60.80 ms 95 % CI 60.63–62.21 | 60.63–62.21 | 5 | 13 / 15 |
| Latency p99.9 | 142.94 ms 95 % CI 140.42–190.35 | 140.42–190.35 | 5 | 14 / 15 |
| Latency p75 | 44.56 ms 95 % CI 44.08–44.72 | 44.08–44.72 | 5 | 12 / 15 |
| Latency p99.99 | 184.57 ms 95 % CI 180.52–261.85 | 180.52–261.85 | 5 | 14 / 15 |
| Latency mean | 34.96 ms 95 % CI 34.42–35.27 | 34.42–35.27 | 5 | 9 / 15 |
| Latency std. dev. | 20.41 ms 95 % CI 20.16–22.43 | 20.16–22.43 | 5 | 14 / 15 |
| Latency max | 218.72 ms 95 % CI 215.68–307.33 | 215.68–307.33 | 5 | 14 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.95–1.99 | 1.95–1.99 | 5 | — |
| User-space CPU share | 0.424 95 % CI 0.422–0.427 | 0.422–0.427 | 5 | — |
| CPU throttling | 12.3 ms 95 % CI 8.5–16.9 | 8.5–16.9 | 5 | 11 / 15 |
| Memory | ||||
| Anonymous memory peak | 286.8 MiB 95 % CI 270.1–301.1 | 270.1–301.1 | 5 | 15 / 15 |
| Database | ||||
| Database CPU per request | 803.7 µs 95 % CI 801.3–809.2 | 801.3–809.2 | 5 | 6 / 15 |
| SELECTs per request | 20.04 queries 95 % CI 20.04–20.04 | 20.04–20.04 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 928.8 J 95 % CI 922.4–934.7 | 922.4–934.7 | 5 | — |
| Package energy per request | 16.288 mJ 95 % CI 16.119–16.325 | 16.119–16.325 | 5 | 9 / 15 |
| Network | ||||
| Bytes per response | 744 B 95 % CI 744–744 | 744–744 | 5 | — |
| Disk I/O | ||||
| Disk writes | 12 KiB | — | 5 | 14 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.10 runnable tasks 95 % CI 5.62–7.07 | 5.62–7.07 | 5 | 8 / 15 |
| CPU clock | 3,573 MHz 95 % CI 3,507–3,627 | 3,507–3,627 | 5 | — |
| Load generator CPU | 0.05 95 % CI 0.05–0.05 | 0.05–0.05 | 5 | 10 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 6,619 req/s 95 % CI 6,508–6,684 | 6,508–6,684 | 5 | 9 / 15 |
| Latency p99 | 69.68 ms 95 % CI 63.77–71.61 | 63.77–71.61 | 5 | 13 / 15 |
| CPU per request | 297.6 µs 95 % CI 292.5–300.7 | 292.5–300.7 | 5 | 12 / 15 |
| Memory under load (PSS) | 305.1 MiB 95 % CI 297.2–322.0 | 297.2–322.0 | 5 | 15 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 17.59 ms 95 % CI 17.46–17.87 | 17.46–17.87 | 5 | 8 / 15 |
| Latency p90 | 38.93 ms 95 % CI 36.61–39.66 | 36.61–39.66 | 5 | 12 / 15 |
| Latency p99.9 | 99.76 ms 95 % CI 90.89–103.44 | 90.89–103.44 | 5 | 13 / 15 |
| Latency p75 | 26.97 ms 95 % CI 25.98–27.54 | 25.98–27.54 | 5 | 12 / 15 |
| Latency p99.99 | 127.04 ms 95 % CI 121.45–141.96 | 121.45–141.96 | 5 | 13 / 15 |
| Latency mean | 20.65 ms 95 % CI 20.12–21.02 | 20.12–21.02 | 5 | 11 / 15 |
| Latency std. dev. | 14.27 ms 95 % CI 12.88–14.65 | 12.88–14.65 | 5 | 13 / 15 |
| Latency max | 156.54 ms 95 % CI 147.14–222.43 | 147.14–222.43 | 5 | 13 / 15 |
| CPU | ||||
| CPU used | 1.97 cores 95 % CI 1.95–1.99 | 1.95–1.99 | 5 | — |
| User-space CPU share | 0.448 95 % CI 0.444–0.452 | 0.444–0.452 | 5 | — |
| CPU throttling | 8.4 ms 95 % CI 5.3–11.7 | 5.3–11.7 | 5 | 11 / 15 |
| Memory | ||||
| Anonymous memory peak | 278.2 MiB 95 % CI 270.1–294.9 | 270.1–294.9 | 5 | 15 / 15 |
| Database | ||||
| Database CPU per request | 486.4 µs 95 % CI 473.1–492.0 | 473.1–492.0 | 5 | 5 / 15 |
| SELECTs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| UPDATEs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| Energy | ||||
| CPU package energy | 939.1 J 95 % CI 931.1–944.4 | 931.1–944.4 | 5 | — |
| Package energy per request | 9.468 mJ 95 % CI 9.272–9.600 | 9.272–9.600 | 5 | 10 / 15 |
| Network | ||||
| Bytes per response | 267 B 95 % CI 267–267 | 267–267 | 5 | — |
| Disk I/O | ||||
| Disk writes | 12 KiB 95 % CI 0–12 | 0–12 | 5 | 14 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.30 runnable tasks 95 % CI 6.56–7.69 | 6.56–7.69 | 5 | 10 / 15 |
| CPU clock | 3,560 MHz 95 % CI 3,533–3,613 | 3,533–3,613 | 5 | — |
| Load generator CPU | 0.08 95 % CI 0.08–0.08 | 0.08–0.08 | 5 | 9 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 19,959 req/s 95 % CI 19,831–20,164 | 19,831–20,164 | 5 | 8 / 15 |
| Latency p99 | 15.25 ms 95 % CI 14.96–15.60 | 14.96–15.60 | 5 | 10 / 15 |
| CPU per request | 99.5 µs 95 % CI 98.5–100.2 | 98.5–100.2 | 5 | 9 / 15 |
| Memory under load (PSS) | 311.0 MiB 95 % CI 297.9–315.4 | 297.9–315.4 | 5 | 15 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 6.06 ms 95 % CI 6.00–6.10 | 6.00–6.10 | 5 | 7 / 15 |
| Latency p90 | 10.57 ms 95 % CI 10.48–10.77 | 10.48–10.77 | 5 | 9 / 15 |
| Latency p99.9 | 20.60 ms 95 % CI 20.19–21.10 | 20.19–21.10 | 5 | 9 / 15 |
| Latency p75 | 8.01 ms 95 % CI 7.92–8.13 | 7.92–8.13 | 5 | 8 / 15 |
| Latency p99.99 | 26.95 ms 95 % CI 26.30–27.62 | 26.30–27.62 | 5 | 9 / 15 |
| Latency mean | 6.46 ms 95 % CI 6.37–6.50 | 6.37–6.50 | 5 | 8 / 15 |
| Latency std. dev. | 3.08 ms 95 % CI 3.03–3.17 | 3.03–3.17 | 5 | 11 / 15 |
| Latency max | 35.13 ms 95 % CI 32.71–40.27 | 32.71–40.27 | 5 | 9 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.98–1.99 | 1.98–1.99 | 5 | — |
| User-space CPU share | 0.621 95 % CI 0.617–0.627 | 0.617–0.627 | 5 | — |
| CPU throttling | 5.4 ms 95 % CI 3.6–10.8 | 3.6–10.8 | 5 | 9 / 15 |
| Memory | ||||
| Anonymous memory peak | 284.1 MiB 95 % CI 270.9–288.3 | 270.9–288.3 | 5 | 15 / 15 |
| Database | ||||
| Database CPU per request | 121.1 µs 95 % CI 119.3–123.1 | 119.3–123.1 | 5 | 8 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 830.2 J 95 % CI 824.0–838.0 | 824.0–838.0 | 5 | — |
| Package energy per request | 2.752 mJ 95 % CI 2.728–2.792 | 2.728–2.792 | 5 | 8 / 15 |
| Network | ||||
| Bytes per response | 4,738 B 95 % CI 4,738–4,738 | 4,738–4,738 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.40 runnable tasks 95 % CI 6.75–7.64 | 6.75–7.64 | 5 | 9 / 15 |
| CPU clock | 3,573 MHz 95 % CI 3,507–3,667 | 3,507–3,667 | 5 | — |
| Load generator CPU | 0.25 95 % CI 0.25–0.25 | 0.25–0.25 | 5 | 7 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 23,924 req/s 95 % CI 22,181–24,011 | 22,181–24,011 | 5 | 10 / 15 |
| Latency p99 | 8.05 ms 95 % CI 7.88–9.24 | 7.88–9.24 | 5 | 7 / 15 |
| CPU per request | 82.9 µs 95 % CI 82.7–89.5 | 82.7–89.5 | 5 | 10 / 15 |
| Memory under load (PSS) | 311.2 MiB 95 % CI 300.2–315.5 | 300.2–315.5 | 5 | 15 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 5.25 ms 95 % CI 5.23–5.67 | 5.23–5.67 | 5 | 10 / 15 |
| Latency p90 | 6.36 ms 95 % CI 6.27–7.20 | 6.27–7.20 | 5 | 9 / 15 |
| Latency p99.9 | 10.15 ms 95 % CI 9.18–12.33 | 9.18–12.33 | 5 | 6 / 15 |
| Latency p75 | 5.58 ms 95 % CI 5.57–6.36 | 5.57–6.36 | 5 | 9 / 15 |
| Latency p99.99 | 12.97 ms 95 % CI 11.97–47.14 | 11.97–47.14 | 5 | 5 / 15 |
| Latency mean | 5.33 ms 95 % CI 5.29–5.73 | 5.29–5.73 | 5 | 10 / 15 |
| Latency std. dev. | 0.90 ms 95 % CI 0.85–1.35 | 0.85–1.35 | 5 | 4 / 15 |
| Latency max | 14.80 ms 95 % CI 13.25–82.61 | 13.25–82.61 | 5 | 5 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.98–1.98 | 1.98–1.98 | 5 | — |
| User-space CPU share | 0.739 95 % CI 0.730–0.753 | 0.730–0.753 | 5 | — |
| CPU throttling | 3.1 ms 95 % CI 0.3–6.9 | 0.3–6.9 | 5 | 4 / 15 |
| Memory | ||||
| Anonymous memory peak | 284.3 MiB 95 % CI 273.3–288.4 | 273.3–288.4 | 5 | 15 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 8 / 15 |
| Energy | ||||
| CPU package energy | 722.8 J 95 % CI 708.4–749.2 | 708.4–749.2 | 5 | — |
| Package energy per request | 2.001 mJ 95 % CI 1.978–2.230 | 1.978–2.230 | 5 | 10 / 15 |
| Network | ||||
| Bytes per response | 195 B 95 % CI 195–195 | 195–195 | 5 | — |
| Disk I/O | ||||
| Disk writes | 12 KiB | — | 5 | 14 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.08 runnable tasks 95 % CI 6.37–7.91 | 6.37–7.91 | 5 | 9 / 15 |
| CPU clock | 3,733 MHz 95 % CI 3,623–3,800 | 3,623–3,800 | 5 | — |
| Load generator CPU | 0.35 95 % CI 0.32–0.36 | 0.32–0.36 | 5 | 8 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 29,664 req/s 95 % CI 29,053–30,083 | 29,053–30,083 | 5 | 9 / 15 |
| Latency p99 | 1.13 ms 95 % CI 1.06–1.55 | 1.06–1.55 | 5 | 7 / 15 |
| CPU per request | 55.2 µs 95 % CI 54.6–56.0 | 54.6–56.0 | 5 | 10 / 15 |
| Memory under load (PSS) | 312.9 MiB 95 % CI 308.7–317.5 | 308.7–317.5 | 5 | 15 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.52 ms 95 % CI 0.51–0.53 | 0.51–0.53 | 5 | 9 / 15 |
| Latency p90 | 0.71 ms 95 % CI 0.70–0.72 | 0.70–0.72 | 5 | 9 / 15 |
| Latency p99.9 | 2.98 ms 95 % CI 2.47–4.35 | 2.47–4.35 | 5 | 8 / 15 |
| Latency p75 | 0.62 ms 95 % CI 0.61–0.63 | 0.61–0.63 | 5 | 10 / 15 |
| Latency p99.99 | 4.69 ms 95 % CI 3.61–10.30 | 3.61–10.30 | 5 | 6 / 15 |
| Latency mean | 0.53 ms 95 % CI 0.53–0.56 | 0.53–0.56 | 5 | 7 / 15 |
| Latency std. dev. | 0.21 ms 95 % CI 0.19–0.29 | 0.19–0.29 | 5 | 6 / 15 |
| Latency max | 8.16 ms 95 % CI 6.23–12.41 | 6.23–12.41 | 5 | 6 / 15 |
| CPU | ||||
| CPU used | 1.63 cores 95 % CI 1.60–1.65 | 1.60–1.65 | 5 | — |
| User-space CPU share | 0.536 95 % CI 0.532–0.542 | 0.532–0.542 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 285.8 MiB 95 % CI 281.6–290.6 | 281.6–290.6 | 5 | 15 / 15 |
| Database | ||||
| Database CPU per request | 76.9 µs 95 % CI 74.5–79.4 | 74.5–79.4 | 5 | 9 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 707.1 J 95 % CI 697.5–722.2 | 697.5–722.2 | 5 | — |
| Package energy per request | 1.588 mJ 95 % CI 1.566–1.615 | 1.566–1.615 | 5 | 10 / 15 |
| Network | ||||
| Bytes per response | 137 B 95 % CI 137–137 | 137–137 | 5 | — |
| Disk I/O | ||||
| Disk writes | 12 KiB 95 % CI 0–12 | 0–12 | 5 | 14 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.36 runnable tasks 95 % CI 6.18–7.49 | 6.18–7.49 | 5 | 9 / 15 |
| CPU clock | 3,382 MHz 95 % CI 3,224–3,434 | 3,224–3,434 | 5 | — |
| Load generator CPU | 0.35 95 % CI 0.33–0.36 | 0.33–0.36 | 5 | 6 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 25,926 req/s 95 % CI 25,840–26,293 | 25,840–26,293 | 5 | 10 / 15 |
| Latency p99 | 84.57 ms 95 % CI 84.03–86.06 | 84.03–86.06 | 5 | 12 / 15 |
| CPU per request | 76.1 µs 95 % CI 75.2–76.4 | 75.2–76.4 | 5 | 10 / 15 |
| Memory under load (PSS) | 677.9 MiB 95 % CI 624.4–689.5 | 624.4–689.5 | 5 | 15 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 16.46 ms 95 % CI 15.83–16.72 | 15.83–16.72 | 5 | 10 / 15 |
| Latency p90 | 49.10 ms 95 % CI 48.82–49.43 | 48.82–49.43 | 5 | 11 / 15 |
| Latency p99.9 | 122.81 ms 95 % CI 119.57–128.92 | 119.57–128.92 | 5 | 13 / 15 |
| Latency p75 | 32.34 ms 95 % CI 31.85–32.41 | 31.85–32.41 | 5 | 12 / 15 |
| Latency p99.99 | 158.60 ms 95 % CI 153.09–176.74 | 153.09–176.74 | 5 | 12 / 15 |
| Latency mean | 22.55 ms 95 % CI 22.21–22.63 | 22.21–22.63 | 5 | 10 / 15 |
| Latency std. dev. | 19.17 ms 95 % CI 19.02–19.44 | 19.02–19.44 | 5 | 13 / 15 |
| Latency max | 210.56 ms 95 % CI 201.32–264.45 | 201.32–264.45 | 5 | 13 / 15 |
| CPU | ||||
| CPU used | 1.97 cores 95 % CI 1.96–1.98 | 1.96–1.98 | 5 | — |
| User-space CPU share | 0.555 95 % CI 0.554–0.564 | 0.554–0.564 | 5 | — |
| CPU throttling | 9.6 ms 95 % CI 3.9–13.4 | 3.9–13.4 | 5 | 10 / 15 |
| Memory | ||||
| Anonymous memory peak | 650.8 MiB 95 % CI 597.4–662.4 | 597.4–662.4 | 5 | 15 / 15 |
| Database | ||||
| Database CPU per request | 85.6 µs 95 % CI 83.0–85.8 | 83.0–85.8 | 5 | 10 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 743.4 J 95 % CI 738.8–747.0 | 738.8–747.0 | 5 | — |
| Package energy per request | 1.896 mJ 95 % CI 1.883–1.921 | 1.883–1.921 | 5 | 10 / 15 |
| Network | ||||
| Bytes per response | 137 B 95 % CI 137–137 | 137–137 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.29 runnable tasks 95 % CI 5.95–7.25 | 5.95–7.25 | 5 | 8 / 15 |
| CPU clock | 3,543 MHz 95 % CI 3,467–3,590 | 3,467–3,590 | 5 | — |
| Load generator CPU | 0.32 95 % CI 0.32–0.32 | 0.32–0.32 | 5 | 6 / 15 |
Fixed rate
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,999 req/s 95 % CI 4,999–4,999 | 4,999–4,999 | 5 | 5 / 15 |
| Latency p99 | 6.95 ms 95 % CI 6.40–17.00 | 6.40–17.00 | 5 | 12 / 15 |
| CPU per request | 211.6 µs 95 % CI 209.9–217.0 | 209.9–217.0 | 5 | 5 / 15 |
| Memory under load (PSS) | 680.0 MiB 95 % CI 624.4–689.6 | 624.4–689.6 | 5 | 15 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.77 ms 95 % CI 0.76–0.77 | 0.76–0.77 | 5 | 7 / 15 |
| Latency p90 | 1.16 ms 95 % CI 1.15–1.17 | 1.15–1.17 | 5 | 7 / 15 |
| Latency p99.9 | 36.57 ms 95 % CI 27.12–42.62 | 27.12–42.62 | 5 | 14 / 15 |
| Latency p75 | 0.92 ms 95 % CI 0.92–0.93 | 0.92–0.93 | 5 | 6 / 15 |
| Latency p99.99 | 51.62 ms 95 % CI 35.40–69.41 | 35.40–69.41 | 5 | 14 / 15 |
| Latency mean | 1.02 ms 95 % CI 0.99–1.19 | 0.99–1.19 | 5 | 11 / 15 |
| Latency max | 71.38 ms 95 % CI 38.12–90.03 | 38.12–90.03 | 5 | 15 / 15 |
| CPU | ||||
| CPU used | 1.05 cores 95 % CI 1.05–1.08 | 1.05–1.08 | 5 | — |
| User-space CPU share | 0.607 95 % CI 0.603–0.621 | 0.603–0.621 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 652.9 MiB 95 % CI 597.5–662.7 | 597.5–662.7 | 5 | 15 / 15 |
| Database | ||||
| Database CPU per request | 149.1 µs 95 % CI 146.6–149.3 | 146.6–149.3 | 5 | 7 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 412.7 J 95 % CI 411.2–429.8 | 411.2–429.8 | 5 | — |
| Package energy per request | 4.127 mJ 95 % CI 4.112–4.299 | 4.112–4.299 | 5 | 9 / 15 |
| Network | ||||
| Bytes per response | 30 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 12 KiB | — | 5 | 14 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.41 runnable tasks 95 % CI 6.25–7.04 | 6.25–7.04 | 5 | 7 / 15 |
| CPU clock | 1,243 MHz 95 % CI 1,212–1,350 | 1,212–1,350 | 5 | — |
| Load generator CPU | 0.14 95 % CI 0.14–0.14 | 0.14–0.14 | 5 | 14 / 15 |