Overall
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 91.6 | — | — | 2 / 15 |
| CPU efficiency index | 92.1 | — | — | 1 / 15 |
| Peak memory | 21.6 MiB | — | — | 1 / 15 |
axum on the multi-threaded Tokio runtime with tokio-postgres and a deadpool connection pool (16 connections, cached prepared statements).
Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 91.6 | — | — | 2 / 15 |
| CPU efficiency index | 92.1 | — | — | 1 / 15 |
| Peak memory | 21.6 MiB | — | — | 1 / 15 |
Start-up
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Cold start | 173 ms 95 % CI 166–184 | 166–184 | 5 | 2 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Memory | ||||
| Memory at idle | 3.9 MiB 95 % CI 3.9–4.0 | 3.9–4.0 | 5 | 1 / 15 |
| Anonymous memory at idle | 0.3 MiB 95 % CI 0.3–0.3 | 0.3–0.3 | 5 | 1 / 15 |
| Start-up | ||||
| Cold start (fastest) | 171 ms 95 % CI 157–172 | 157–172 | 5 | 2 / 15 |
| Cold start (slowest) | 189 ms 95 % CI 182–194 | 182–194 | 5 | 2 / 15 |
| Footprint | ||||
| Image size | 46 MB | — | 5 | 2 / 15 |
Cold load
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 80,965 req/s 95 % CI 79,118–81,820 | 79,118–81,820 | 5 | 1 / 15 |
| Latency p99 | 1.96 ms 95 % CI 1.84–2.04 | 1.84–2.04 | 5 | 1 / 15 |
| CPU per request | 24.3 µs 95 % CI 24.1–24.9 | 24.1–24.9 | 5 | 1 / 15 |
| Memory under load (PSS) | 8.2 MiB 95 % CI 8.1–8.3 | 8.1–8.3 | 5 | 1 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.56 ms 95 % CI 1.55–1.60 | 1.55–1.60 | 5 | 1 / 15 |
| Latency p90 | 1.67 ms 95 % CI 1.65–1.71 | 1.65–1.71 | 5 | 1 / 15 |
| Latency p99.9 | 25.03 ms 95 % CI 6.25–31.86 | 6.25–31.86 | 5 | 2 / 15 |
| Latency p75 | 1.61 ms 95 % CI 1.60–1.65 | 1.60–1.65 | 5 | 1 / 15 |
| Latency p99.99 | 37.01 ms 95 % CI 25.77–45.75 | 25.77–45.75 | 5 | 2 / 15 |
| Latency mean | 1.62 ms 95 % CI 1.58–1.67 | 1.58–1.67 | 5 | 1 / 15 |
| Latency std. dev. | 1.16 ms 95 % CI 0.50–1.51 | 0.50–1.51 | 5 | 2 / 15 |
| Latency max | 50.97 ms 95 % CI 40.00–54.59 | 40.00–54.59 | 5 | 3 / 15 |
| CPU | ||||
| CPU used | 1.97 cores 95 % CI 1.97–1.97 | 1.97–1.97 | 5 | — |
| User-space CPU share | 0.437 95 % CI 0.433–0.445 | 0.433–0.445 | 5 | — |
| CPU throttling | 2.3 ms 95 % CI 0.9–7.3 | 0.9–7.3 | 5 | 8 / 15 |
| Memory | ||||
| Anonymous memory peak | 4.5 MiB 95 % CI 4.5–4.6 | 4.5–4.6 | 5 | 1 / 15 |
| Database | ||||
| Database CPU per request | 40.4 µs 95 % CI 40.4–41.5 | 40.4–41.5 | 5 | 2 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Start-up | ||||
| Cold vs. warm throughput | 1.00 95 % CI 0.97–1.01 | 0.97–1.01 | 5 | 6 / 15 |
| Energy | ||||
| CPU package energy | 657.5 J 95 % CI 646.1–662.5 | 646.1–662.5 | 5 | — |
| Package energy per request | 0.810 mJ 95 % CI 0.802–0.814 | 0.802–0.814 | 5 | 2 / 15 |
| Network | ||||
| Bytes per response | 139 B 95 % CI 139–139 | 139–139 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 3.72 runnable tasks 95 % CI 3.53–5.47 | 3.53–5.47 | 5 | 1 / 15 |
| CPU clock | 3,382 MHz 95 % CI 3,255–3,418 | 3,255–3,418 | 5 | — |
| Load generator CPU | 0.55 95 % CI 0.52–0.55 | 0.52–0.55 | 5 | 14 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 212,688 req/s 95 % CI 201,850–213,381 | 201,850–213,381 | 5 | 2 / 15 |
| Latency p99 | 0.91 ms 95 % CI 0.89–0.97 | 0.89–0.97 | 5 | 1 / 15 |
| CPU per request | 9.3 µs 95 % CI 9.3–9.9 | 9.3–9.9 | 5 | 2 / 15 |
| Memory under load (PSS) | 9.9 MiB 95 % CI 9.5–10.4 | 9.5–10.4 | 5 | 1 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.60 ms 95 % CI 0.60–0.64 | 0.60–0.64 | 5 | 2 / 15 |
| Latency p90 | 0.81 ms 95 % CI 0.80–0.85 | 0.80–0.85 | 5 | 2 / 15 |
| Latency p99.9 | 1.12 ms 95 % CI 1.05–1.15 | 1.05–1.15 | 5 | 1 / 15 |
| Latency p75 | 0.72 ms 95 % CI 0.71–0.76 | 0.71–0.76 | 5 | 2 / 15 |
| Latency p99.99 | 2.14 ms 95 % CI 1.57–3.12 | 1.57–3.12 | 5 | 1 / 15 |
| Latency mean | 0.60 ms 95 % CI 0.59–0.63 | 0.59–0.63 | 5 | 2 / 15 |
| Latency std. dev. | 0.17 ms 95 % CI 0.17–0.19 | 0.17–0.19 | 5 | 2 / 15 |
| Latency max | 6.05 ms 95 % CI 4.04–6.55 | 4.04–6.55 | 5 | 2 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.97–1.99 | 1.97–1.99 | 5 | — |
| User-space CPU share | 0.380 95 % CI 0.378–0.391 | 0.378–0.391 | 5 | — |
| CPU throttling | 3.9 ms 95 % CI 0.6–15.0 | 0.6–15.0 | 5 | 8 / 15 |
| Memory | ||||
| Anonymous memory peak | 6.2 MiB 95 % CI 5.7–6.7 | 5.7–6.7 | 5 | 1 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 2 / 15 |
| Energy | ||||
| CPU package energy | 940.1 J 95 % CI 901.8–948.9 | 901.8–948.9 | 5 | — |
| Package energy per request | 0.295 mJ 95 % CI 0.288–0.302 | 0.288–0.302 | 5 | 2 / 15 |
| Network | ||||
| Bytes per response | 135 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.61 runnable tasks 95 % CI 6.43–7.37 | 6.43–7.37 | 5 | 13 / 15 |
| CPU clock | 3,750 MHz 95 % CI 3,575–3,800 | 3,575–3,800 | 5 | — |
| Load generator CPU | 0.84 95 % CI 0.79–0.85 | 0.79–0.85 | 5 | 15 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 81,347 req/s 95 % CI 80,339–81,873 | 80,339–81,873 | 5 | 1 / 15 |
| Latency p99 | 1.92 ms 95 % CI 1.83–1.98 | 1.83–1.98 | 5 | 1 / 15 |
| CPU per request | 24.3 µs 95 % CI 24.1–24.6 | 24.1–24.6 | 5 | 1 / 15 |
| Memory under load (PSS) | 10.2 MiB 95 % CI 9.1–10.4 | 9.1–10.4 | 5 | 1 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.56 ms 95 % CI 1.55–1.58 | 1.55–1.58 | 5 | 1 / 15 |
| Latency p90 | 1.67 ms 95 % CI 1.65–1.69 | 1.65–1.69 | 5 | 1 / 15 |
| Latency p99.9 | 2.87 ms 95 % CI 2.42–3.15 | 2.42–3.15 | 5 | 1 / 15 |
| Latency p75 | 1.61 ms 95 % CI 1.60–1.64 | 1.60–1.64 | 5 | 1 / 15 |
| Latency p99.99 | 4.30 ms 95 % CI 3.85–5.55 | 3.85–5.55 | 5 | 1 / 15 |
| Latency mean | 1.57 ms 95 % CI 1.55–1.59 | 1.55–1.59 | 5 | 1 / 15 |
| Latency std. dev. | 0.13 ms 95 % CI 0.11–0.14 | 0.11–0.14 | 5 | 1 / 15 |
| Latency max | 8.08 ms 95 % CI 5.44–12.23 | 5.44–12.23 | 5 | 2 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.97–1.98 | 1.97–1.98 | 5 | — |
| User-space CPU share | 0.437 95 % CI 0.434–0.439 | 0.434–0.439 | 5 | — |
| CPU throttling | 6.7 ms 95 % CI 4.0–18.4 | 4.0–18.4 | 5 | 10 / 15 |
| Memory | ||||
| Anonymous memory peak | 6.4 MiB 95 % CI 5.3–6.7 | 5.3–6.7 | 5 | 1 / 15 |
| Database | ||||
| Database CPU per request | 40.3 µs 95 % CI 40.2–40.7 | 40.2–40.7 | 5 | 2 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 991.5 J 95 % CI 979.2–1,001.8 | 979.2–1,001.8 | 5 | — |
| Package energy per request | 0.811 mJ 95 % CI 0.807–0.819 | 0.807–0.819 | 5 | 2 / 15 |
| Network | ||||
| Bytes per response | 139 B 95 % CI 139–139 | 139–139 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.66 runnable tasks 95 % CI 6.54–6.95 | 6.54–6.95 | 5 | 15 / 15 |
| CPU clock | 3,440 MHz 95 % CI 3,413–3,550 | 3,413–3,550 | 5 | — |
| Load generator CPU | 0.54 95 % CI 0.52–0.55 | 0.52–0.55 | 5 | 12 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 5,276 req/s 95 % CI 5,267–5,291 | 5,267–5,291 | 5 | 2 / 15 |
| Latency p99 | 26.67 ms 95 % CI 26.25–27.04 | 26.25–27.04 | 5 | 1 / 15 |
| CPU per request | 282.6 µs 95 % CI 278.5–286.5 | 278.5–286.5 | 5 | 1 / 15 |
| Memory under load (PSS) | 10.6 MiB 95 % CI 10.0–11.0 | 10.0–11.0 | 5 | 1 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 24.13 ms 95 % CI 24.09–24.15 | 24.09–24.15 | 5 | 2 / 15 |
| Latency p90 | 24.41 ms 95 % CI 24.28–24.52 | 24.28–24.52 | 5 | 1 / 15 |
| Latency p99.9 | 30.66 ms 95 % CI 29.88–31.26 | 29.88–31.26 | 5 | 1 / 15 |
| Latency p75 | 24.21 ms 95 % CI 24.18–24.26 | 24.18–24.26 | 5 | 1 / 15 |
| Latency p99.99 | 36.37 ms 95 % CI 34.73–37.54 | 34.73–37.54 | 5 | 1 / 15 |
| Latency mean | 24.18 ms 95 % CI 24.13–24.23 | 24.13–24.23 | 5 | 2 / 15 |
| Latency std. dev. | 0.63 ms 95 % CI 0.57–0.71 | 0.57–0.71 | 5 | 1 / 15 |
| Latency max | 38.01 ms 95 % CI 36.60–38.96 | 36.60–38.96 | 5 | 1 / 15 |
| CPU | ||||
| CPU used | 1.49 cores 95 % CI 1.47–1.51 | 1.47–1.51 | 5 | — |
| User-space CPU share | 0.383 95 % CI 0.373–0.385 | 0.373–0.385 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 6.9 MiB 95 % CI 6.2–7.2 | 6.2–7.2 | 5 | 1 / 15 |
| Database | ||||
| Database CPU per request | 756.2 µs 95 % CI 754.6–757.3 | 754.6–757.3 | 5 | 2 / 15 |
| SELECTs per request | 20.02 queries 95 % CI 20.01–20.03 | 20.01–20.03 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 909.9 J 95 % CI 897.4–916.8 | 897.4–916.8 | 5 | — |
| Package energy per request | 11.469 mJ 95 % CI 11.285–11.556 | 11.285–11.556 | 5 | 1 / 15 |
| Network | ||||
| Bytes per response | 746 B 95 % CI 746–746 | 746–746 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.89 runnable tasks 95 % CI 7.59–8.25 | 7.59–8.25 | 5 | 14 / 15 |
| CPU clock | 3,525 MHz 95 % CI 3,388–3,638 | 3,388–3,638 | 5 | — |
| Load generator CPU | 0.06 95 % CI 0.06–0.06 | 0.06–0.06 | 5 | 11 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 8,455 req/s 95 % CI 8,446–8,568 | 8,446–8,568 | 5 | 1 / 15 |
| Latency p99 | 15.91 ms 95 % CI 15.80–15.93 | 15.80–15.93 | 5 | 1 / 15 |
| CPU per request | 156.7 µs 95 % CI 153.1–157.5 | 153.1–157.5 | 5 | 1 / 15 |
| Memory under load (PSS) | 10.1 MiB 95 % CI 9.8–11.1 | 9.8–11.1 | 5 | 1 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 15.06 ms 95 % CI 14.95–15.08 | 14.95–15.08 | 5 | 1 / 15 |
| Latency p90 | 15.31 ms 95 % CI 15.25–15.35 | 15.25–15.35 | 5 | 1 / 15 |
| Latency p99.9 | 20.09 ms 95 % CI 18.54–22.29 | 18.54–22.29 | 5 | 1 / 15 |
| Latency p75 | 15.18 ms 95 % CI 15.12–15.19 | 15.12–15.19 | 5 | 1 / 15 |
| Latency p99.99 | 26.04 ms 95 % CI 21.69–26.82 | 21.69–26.82 | 5 | 1 / 15 |
| Latency mean | 15.10 ms 95 % CI 14.90–15.11 | 14.90–15.11 | 5 | 1 / 15 |
| Latency std. dev. | 0.39 ms 95 % CI 0.37–0.43 | 0.37–0.43 | 5 | 1 / 15 |
| Latency max | 28.02 ms 95 % CI 26.43–31.32 | 26.43–31.32 | 5 | 2 / 15 |
| CPU | ||||
| CPU used | 1.33 cores 95 % CI 1.29–1.35 | 1.29–1.35 | 5 | — |
| User-space CPU share | 0.387 95 % CI 0.383–0.392 | 0.383–0.392 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 6.4 MiB 95 % CI 6.0–7.3 | 6.0–7.3 | 5 | 1 / 15 |
| Database | ||||
| Database CPU per request | 472.3 µs 95 % CI 466.2–473.1 | 466.2–473.1 | 5 | 1 / 15 |
| SELECTs per request | 5.00 queries 95 % CI 5.00–5.00 | 5.00–5.00 | 5 | — |
| UPDATEs per request | 5.00 queries 95 % CI 5.00–5.00 | 5.00–5.00 | 5 | — |
| Energy | ||||
| CPU package energy | 909.5 J 95 % CI 906.1–913.7 | 906.1–913.7 | 5 | — |
| Package energy per request | 7.137 mJ 95 % CI 7.039–7.190 | 7.039–7.190 | 5 | 1 / 15 |
| Network | ||||
| Bytes per response | 269 B 95 % CI 269–269 | 269–269 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 10.26 runnable tasks 95 % CI 9.33–10.66 | 9.33–10.66 | 5 | 14 / 15 |
| CPU clock | 3,513 MHz 95 % CI 3,456–3,694 | 3,456–3,694 | 5 | — |
| Load generator CPU | 0.09 95 % CI 0.09–0.09 | 0.09–0.09 | 5 | 12 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 32,428 req/s 95 % CI 23,825–36,146 | 23,825–36,146 | 5 | 2 / 15 |
| Latency p99 | 5.05 ms 95 % CI 4.46–6.54 | 4.46–6.54 | 5 | 1 / 15 |
| CPU per request | 60.9 µs 95 % CI 55.1–81.9 | 55.1–81.9 | 5 | 2 / 15 |
| Memory under load (PSS) | 10.6 MiB 95 % CI 9.3–11.1 | 9.3–11.1 | 5 | 1 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 3.90 ms 95 % CI 3.49–5.35 | 3.49–5.35 | 5 | 2 / 15 |
| Latency p90 | 4.22 ms 95 % CI 3.80–5.74 | 3.80–5.74 | 5 | 1 / 15 |
| Latency p99.9 | 6.59 ms 95 % CI 5.56–7.50 | 5.56–7.50 | 5 | 1 / 15 |
| Latency p75 | 4.05 ms 95 % CI 3.66–5.55 | 3.66–5.55 | 5 | 2 / 15 |
| Latency p99.99 | 10.13 ms 95 % CI 8.35–12.26 | 8.35–12.26 | 5 | 2 / 15 |
| Latency mean | 3.93 ms 95 % CI 3.53–5.35 | 3.53–5.35 | 5 | 2 / 15 |
| Latency std. dev. | 0.32 ms 95 % CI 0.29–0.38 | 0.29–0.38 | 5 | 1 / 15 |
| Latency max | 11.58 ms 95 % CI 11.04–17.17 | 11.04–17.17 | 5 | 1 / 15 |
| CPU | ||||
| CPU used | 1.97 cores 95 % CI 1.95–1.99 | 1.95–1.99 | 5 | — |
| User-space CPU share | 0.696 95 % CI 0.694–0.715 | 0.694–0.715 | 5 | — |
| CPU throttling | 2.4 ms 95 % CI 0.0–30.0 | 0.0–30.0 | 5 | 8 / 15 |
| Memory | ||||
| Anonymous memory peak | 6.9 MiB 95 % CI 5.5–7.3 | 5.5–7.3 | 5 | 1 / 15 |
| Database | ||||
| Database CPU per request | 94.4 µs 95 % CI 91.0–100.2 | 91.0–100.2 | 5 | 3 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 959.4 J 95 % CI 836.4–999.3 | 836.4–999.3 | 5 | — |
| Package energy per request | 1.968 mJ 95 % CI 1.829–2.336 | 1.829–2.336 | 5 | 2 / 15 |
| Network | ||||
| Bytes per response | 4,740 B 95 % CI 4,740–4,740 | 4,740–4,740 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 10.88 runnable tasks 95 % CI 10.65–11.51 | 10.65–11.51 | 5 | 14 / 15 |
| CPU clock | 3,493 MHz 95 % CI 3,293–3,587 | 3,293–3,587 | 5 | — |
| Load generator CPU | 0.33 95 % CI 0.26–0.40 | 0.26–0.40 | 5 | 13 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 52,819 req/s 95 % CI 45,868–55,461 | 45,868–55,461 | 5 | 2 / 15 |
| Latency p99 | 3.70 ms 95 % CI 3.55–4.28 | 3.55–4.28 | 5 | 2 / 15 |
| CPU per request | 37.5 µs 95 % CI 35.6–42.9 | 35.6–42.9 | 5 | 2 / 15 |
| Memory under load (PSS) | 10.1 MiB 95 % CI 9.4–11.1 | 9.4–11.1 | 5 | 1 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 2.63 ms 95 % CI 2.46–3.06 | 2.46–3.06 | 5 | 2 / 15 |
| Latency p90 | 3.18 ms 95 % CI 2.87–3.63 | 2.87–3.63 | 5 | 2 / 15 |
| Latency p99.9 | 5.17 ms 95 % CI 4.84–5.89 | 4.84–5.89 | 5 | 2 / 15 |
| Latency p75 | 2.96 ms 95 % CI 2.74–3.47 | 2.74–3.47 | 5 | 2 / 15 |
| Latency p99.99 | 8.48 ms 95 % CI 5.25–10.85 | 5.25–10.85 | 5 | 2 / 15 |
| Latency mean | 2.40 ms 95 % CI 2.30–2.78 | 2.30–2.78 | 5 | 2 / 15 |
| Latency std. dev. | 0.65 ms 95 % CI 0.63–0.80 | 0.63–0.80 | 5 | 2 / 15 |
| Latency max | 10.88 ms 95 % CI 7.59–14.11 | 7.59–14.11 | 5 | 2 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.97–1.98 | 1.97–1.98 | 5 | — |
| User-space CPU share | 0.762 95 % CI 0.755–0.768 | 0.755–0.768 | 5 | — |
| CPU throttling | 7.0 ms 95 % CI 4.3–18.8 | 4.3–18.8 | 5 | 8 / 15 |
| Memory | ||||
| Anonymous memory peak | 6.5 MiB 95 % CI 5.6–7.3 | 5.6–7.3 | 5 | 1 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 2 / 15 |
| Energy | ||||
| CPU package energy | 727.7 J 95 % CI 691.8–730.8 | 691.8–730.8 | 5 | — |
| Package energy per request | 0.898 mJ 95 % CI 0.873–1.004 | 0.873–1.004 | 5 | 2 / 15 |
| Network | ||||
| Bytes per response | 178 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 9.32 runnable tasks 95 % CI 9.12–10.18 | 9.12–10.18 | 5 | 13 / 15 |
| CPU clock | 3,704 MHz 95 % CI 3,587–3,799 | 3,587–3,799 | 5 | — |
| Load generator CPU | 0.54 95 % CI 0.53–0.55 | 0.53–0.55 | 5 | 14 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 80,539 req/s 95 % CI 79,232–81,742 | 79,232–81,742 | 5 | 1 / 15 |
| Latency p99 | 0.29 ms 95 % CI 0.28–0.29 | 0.28–0.29 | 5 | 1 / 15 |
| CPU per request | 24.6 µs 95 % CI 24.2–25.0 | 24.2–25.0 | 5 | 1 / 15 |
| Memory under load (PSS) | 10.1 MiB 95 % CI 9.3–11.1 | 9.3–11.1 | 5 | 1 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.19 ms 95 % CI 0.19–0.20 | 0.19–0.20 | 5 | 1 / 15 |
| Latency p90 | 0.24 ms 95 % CI 0.23–0.24 | 0.23–0.24 | 5 | 1 / 15 |
| Latency p99.9 | 0.63 ms 95 % CI 0.46–0.89 | 0.46–0.89 | 5 | 1 / 15 |
| Latency p75 | 0.22 ms 95 % CI 0.21–0.22 | 0.21–0.22 | 5 | 1 / 15 |
| Latency p99.99 | 2.00 ms 95 % CI 1.40–2.93 | 1.40–2.93 | 5 | 1 / 15 |
| Latency mean | 0.19 ms 95 % CI 0.19–0.20 | 0.19–0.20 | 5 | 1 / 15 |
| Latency std. dev. | 0.05 ms 95 % CI 0.05–0.07 | 0.05–0.07 | 5 | 1 / 15 |
| Latency max | 4.02 ms 95 % CI 3.73–6.97 | 3.73–6.97 | 5 | 2 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.97–1.98 | 1.97–1.98 | 5 | — |
| User-space CPU share | 0.426 95 % CI 0.425–0.429 | 0.425–0.429 | 5 | — |
| CPU throttling | 8.0 ms 95 % CI < 0.1–14.9 | < 0.1–14.9 | 5 | 9 / 15 |
| Memory | ||||
| Anonymous memory peak | 6.3 MiB 95 % CI 5.5–7.3 | 5.5–7.3 | 5 | 1 / 15 |
| Database | ||||
| Database CPU per request | 40.9 µs 95 % CI 40.2–41.6 | 40.2–41.6 | 5 | 2 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 984.3 J 95 % CI 967.9–1,001.0 | 967.9–1,001.0 | 5 | — |
| Package energy per request | 0.809 mJ 95 % CI 0.809–0.819 | 0.809–0.819 | 5 | 1 / 15 |
| Network | ||||
| Bytes per response | 139 B 95 % CI 139–139 | 139–139 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 8.36 runnable tasks 95 % CI 7.98–8.76 | 7.98–8.76 | 5 | 13 / 15 |
| CPU clock | 3,438 MHz 95 % CI 3,318–3,500 | 3,318–3,500 | 5 | — |
| Load generator CPU | 0.55 95 % CI 0.53–0.55 | 0.53–0.55 | 5 | 14 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 75,331 req/s 95 % CI 74,415–76,164 | 74,415–76,164 | 5 | 2 / 15 |
| Latency p99 | 7.98 ms 95 % CI 7.61–9.31 | 7.61–9.31 | 5 | 1 / 15 |
| CPU per request | 26.2 µs 95 % CI 25.9–26.5 | 25.9–26.5 | 5 | 2 / 15 |
| Memory under load (PSS) | 21.6 MiB 95 % CI 20.8–22.7 | 20.8–22.7 | 5 | 1 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 6.72 ms 95 % CI 6.65–6.85 | 6.65–6.85 | 5 | 2 / 15 |
| Latency p90 | 7.01 ms 95 % CI 6.89–7.05 | 6.89–7.05 | 5 | 1 / 15 |
| Latency p99.9 | 10.35 ms 95 % CI 9.45–12.11 | 9.45–12.11 | 5 | 1 / 15 |
| Latency p75 | 6.86 ms 95 % CI 6.75–6.94 | 6.75–6.94 | 5 | 2 / 15 |
| Latency p99.99 | 15.32 ms 95 % CI 11.88–16.57 | 11.88–16.57 | 5 | 2 / 15 |
| Latency mean | 6.76 ms 95 % CI 6.69–6.85 | 6.69–6.85 | 5 | 2 / 15 |
| Latency std. dev. | 0.34 ms 95 % CI 0.30–0.52 | 0.30–0.52 | 5 | 1 / 15 |
| Latency max | 19.25 ms 95 % CI 12.97–21.53 | 12.97–21.53 | 5 | 2 / 15 |
| CPU | ||||
| CPU used | 1.97 cores 95 % CI 1.96–1.97 | 1.96–1.97 | 5 | — |
| User-space CPU share | 0.448 95 % CI 0.444–0.449 | 0.444–0.449 | 5 | — |
| CPU throttling | 4.5 ms 95 % CI 2.2–15.6 | 2.2–15.6 | 5 | 6 / 15 |
| Memory | ||||
| Anonymous memory peak | 17.8 MiB 95 % CI 17.1–18.9 | 17.1–18.9 | 5 | 1 / 15 |
| Database | ||||
| Database CPU per request | 40.9 µs 95 % CI 40.8–42.8 | 40.8–42.8 | 5 | 2 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 978.2 J 95 % CI 973.8–994.5 | 973.8–994.5 | 5 | — |
| Package energy per request | 0.867 mJ 95 % CI 0.850–0.873 | 0.850–0.873 | 5 | 2 / 15 |
| Network | ||||
| Bytes per response | 139 B 95 % CI 139–139 | 139–139 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 8.14 runnable tasks 95 % CI 7.94–8.60 | 7.94–8.60 | 5 | 13 / 15 |
| CPU clock | 3,416 MHz 95 % CI 3,300–3,513 | 3,300–3,513 | 5 | — |
| Load generator CPU | 0.55 95 % CI 0.50–0.55 | 0.50–0.55 | 5 | 13 / 15 |
Fixed rate
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,999 req/s 95 % CI 4,999–4,999 | 4,999–4,999 | 5 | 8 / 15 |
| Latency p99 | 0.93 ms 95 % CI 0.92–0.99 | 0.92–0.99 | 5 | 1 / 15 |
| CPU per request | 116.7 µs 95 % CI 115.1–118.8 | 115.1–118.8 | 5 | 1 / 15 |
| Memory under load (PSS) | 21.5 MiB 95 % CI 20.0–22.5 | 20.0–22.5 | 5 | 1 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.60 ms 95 % CI 0.59–0.64 | 0.59–0.64 | 5 | 1 / 15 |
| Latency p90 | 0.80 ms 95 % CI 0.78–0.81 | 0.78–0.81 | 5 | 1 / 15 |
| Latency p99.9 | 1.13 ms 95 % CI 1.07–1.17 | 1.07–1.17 | 5 | 1 / 15 |
| Latency p75 | 0.72 ms 95 % CI 0.70–0.73 | 0.70–0.73 | 5 | 1 / 15 |
| Latency p99.99 | 2.09 ms 95 % CI 1.97–4.33 | 1.97–4.33 | 5 | 1 / 15 |
| Latency mean | 0.59 ms 95 % CI 0.58–0.61 | 0.58–0.61 | 5 | 1 / 15 |
| Latency max | 2.73 ms 95 % CI 2.45–5.27 | 2.45–5.27 | 5 | 1 / 15 |
| CPU | ||||
| CPU used | 0.58 cores 95 % CI 0.57–0.59 | 0.57–0.59 | 5 | — |
| User-space CPU share | 0.433 95 % CI 0.389–0.475 | 0.389–0.475 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 17.7 MiB 95 % CI 16.3–18.7 | 16.3–18.7 | 5 | 1 / 15 |
| Database | ||||
| Database CPU per request | 171.7 µs 95 % CI 167.8–173.6 | 167.8–173.6 | 5 | 14 / 15 |
| SELECTs per request | 1.00 queries | — | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 384.5 J 95 % CI 372.3–388.3 | 372.3–388.3 | 5 | — |
| Package energy per request | 3.845 mJ 95 % CI 3.723–3.883 | 3.723–3.883 | 5 | 2 / 15 |
| Network | ||||
| Bytes per response | 30 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.77 runnable tasks 95 % CI 7.42–8.13 | 7.42–8.13 | 5 | 13 / 15 |
| CPU clock | 1,203 MHz 95 % CI 1,200–1,260 | 1,200–1,260 | 5 | — |
| Load generator CPU | 0.13 95 % CI 0.13–0.13 | 0.13–0.13 | 5 | 2 / 15 |