Overall
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 65.4 | — | — | 4 / 15 |
| CPU efficiency index | 59.3 | — | — | 5 / 15 |
| Peak memory | 93.2 MiB | — | — | 4 / 15 |
ASP.NET Core minimal API on .NET 10 LTS, compiled ahead of time to a native executable.
Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 65.4 | — | — | 4 / 15 |
| CPU efficiency index | 59.3 | — | — | 5 / 15 |
| Peak memory | 93.2 MiB | — | — | 4 / 15 |
Start-up
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Cold start | 690 ms 95 % CI 678–703 | 678–703 | 5 | 11 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Memory | ||||
| Memory at idle | 22.3 MiB 95 % CI 22.2–22.7 | 22.2–22.7 | 5 | 4 / 15 |
| Anonymous memory at idle | 9.5 MiB 95 % CI 9.5–9.6 | 9.5–9.6 | 5 | 7 / 15 |
| Start-up | ||||
| Cold start (fastest) | 664 ms 95 % CI 661–685 | 661–685 | 5 | 11 / 15 |
| Cold start (slowest) | 700 ms 95 % CI 699–714 | 699–714 | 5 | 11 / 15 |
| Footprint | ||||
| Image size | 199 MB | — | 5 | 3 / 15 |
Cold load
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 45,885 req/s 95 % CI 45,588–46,428 | 45,588–46,428 | 5 | 3 / 15 |
| Latency p99 | 5.43 ms 95 % CI 5.25–5.85 | 5.25–5.85 | 5 | 3 / 15 |
| CPU per request | 42.4 µs 95 % CI 42.0–42.6 | 42.0–42.6 | 5 | 4 / 15 |
| Memory under load (PSS) | 43.0 MiB 95 % CI 42.9–43.3 | 42.9–43.3 | 5 | 4 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 2.61 ms 95 % CI 2.60–2.62 | 2.60–2.62 | 5 | 4 / 15 |
| Latency p90 | 2.98 ms 95 % CI 2.88–3.09 | 2.88–3.09 | 5 | 3 / 15 |
| Latency p99.9 | 60.16 ms 95 % CI 39.04–63.73 | 39.04–63.73 | 5 | 8 / 15 |
| Latency p75 | 2.71 ms 95 % CI 2.69–2.72 | 2.69–2.72 | 5 | 3 / 15 |
| Latency p99.99 | 69.99 ms 95 % CI 51.52–79.16 | 51.52–79.16 | 5 | 7 / 15 |
| Latency mean | 2.97 ms 95 % CI 2.86–2.99 | 2.86–2.99 | 5 | 3 / 15 |
| Latency std. dev. | 3.22 ms 95 % CI 1.93–3.53 | 1.93–3.53 | 5 | 6 / 15 |
| Latency max | 75.10 ms 95 % CI 61.93–84.46 | 61.93–84.46 | 5 | 7 / 15 |
| CPU | ||||
| CPU used | 1.94 cores 95 % CI 1.93–1.95 | 1.93–1.95 | 5 | — |
| User-space CPU share | 0.552 95 % CI 0.543–0.558 | 0.543–0.558 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 29.7 MiB 95 % CI 29.5–29.8 | 29.5–29.8 | 5 | 4 / 15 |
| Database | ||||
| Database CPU per request | 51.3 µs 95 % CI 51.0–51.8 | 51.0–51.8 | 5 | 3 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Start-up | ||||
| Cold vs. warm throughput | 0.98 95 % CI 0.97–0.99 | 0.97–0.99 | 5 | 8 / 15 |
| Energy | ||||
| CPU package energy | 544.5 J 95 % CI 538.8–547.7 | 538.8–547.7 | 5 | — |
| Package energy per request | 1.179 mJ 95 % CI 1.175–1.186 | 1.175–1.186 | 5 | 3 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.32 runnable tasks 95 % CI 3.34–6.35 | 3.34–6.35 | 5 | 7 / 15 |
| CPU clock | 3,540 MHz 95 % CI 3,410–3,564 | 3,410–3,564 | 5 | — |
| Load generator CPU | 0.54 95 % CI 0.54–0.55 | 0.54–0.55 | 5 | 13 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 135,166 req/s 95 % CI 131,570–137,741 | 131,570–137,741 | 5 | 4 / 15 |
| Latency p99 | 1.93 ms 95 % CI 1.79–2.58 | 1.79–2.58 | 5 | 4 / 15 |
| CPU per request | 14.3 µs 95 % CI 14.0–14.4 | 14.0–14.4 | 5 | 5 / 15 |
| Memory under load (PSS) | 46.9 MiB 95 % CI 46.5–51.6 | 46.5–51.6 | 5 | 3 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.89 ms 95 % CI 0.88–0.90 | 0.88–0.90 | 5 | 4 / 15 |
| Latency p90 | 1.16 ms 95 % CI 1.14–1.23 | 1.14–1.23 | 5 | 4 / 15 |
| Latency p99.9 | 3.84 ms 95 % CI 3.40–4.54 | 3.40–4.54 | 5 | 4 / 15 |
| Latency p75 | 1.01 ms 95 % CI 0.99–1.04 | 0.99–1.04 | 5 | 4 / 15 |
| Latency p99.99 | 5.53 ms 95 % CI 5.15–7.39 | 5.15–7.39 | 5 | 4 / 15 |
| Latency mean | 0.92 ms 95 % CI 0.90–0.96 | 0.90–0.96 | 5 | 4 / 15 |
| Latency std. dev. | 0.30 ms 95 % CI 0.27–0.39 | 0.27–0.39 | 5 | 4 / 15 |
| Latency max | 9.90 ms 95 % CI 7.64–12.09 | 7.64–12.09 | 5 | 5 / 15 |
| CPU | ||||
| CPU used | 1.93 cores 95 % CI 1.90–1.93 | 1.90–1.93 | 5 | — |
| User-space CPU share | 0.503 95 % CI 0.496–0.506 | 0.496–0.506 | 5 | — |
| CPU throttling | 0.0 ms 95 % CI 0.0–0.1 | 0.0–0.1 | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 33.5 MiB 95 % CI 32.9–38.2 | 32.9–38.2 | 5 | 3 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 5 / 15 |
| Energy | ||||
| CPU package energy | 798.4 J 95 % CI 793.4–819.0 | 793.4–819.0 | 5 | — |
| Package energy per request | 0.391 mJ 95 % CI 0.384–0.412 | 0.384–0.412 | 5 | 4 / 15 |
| Network | ||||
| Bytes per response | 186 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.27 runnable tasks 95 % CI 5.61–7.97 | 5.61–7.97 | 5 | 12 / 15 |
| CPU clock | 3,800 MHz 95 % CI 3,744–3,800 | 3,744–3,800 | 5 | — |
| Load generator CPU | 0.63 95 % CI 0.62–0.63 | 0.62–0.63 | 5 | 12 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 46,884 req/s 95 % CI 46,722–47,146 | 46,722–47,146 | 5 | 4 / 15 |
| Latency p99 | 4.56 ms 95 % CI 4.49–4.64 | 4.49–4.64 | 5 | 4 / 15 |
| CPU per request | 41.8 µs 95 % CI 41.6–41.9 | 41.6–41.9 | 5 | 5 / 15 |
| Memory under load (PSS) | 42.7 MiB 95 % CI 39.8–46.3 | 39.8–46.3 | 5 | 3 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 2.59 ms 95 % CI 2.59–2.60 | 2.59–2.60 | 5 | 4 / 15 |
| Latency p90 | 2.90 ms 95 % CI 2.82–2.91 | 2.82–2.91 | 5 | 4 / 15 |
| Latency p99.9 | 5.90 ms 95 % CI 5.75–6.31 | 5.75–6.31 | 5 | 4 / 15 |
| Latency p75 | 2.67 ms 95 % CI 2.67–2.68 | 2.67–2.68 | 5 | 4 / 15 |
| Latency p99.99 | 8.65 ms 95 % CI 7.11–10.80 | 7.11–10.80 | 5 | 3 / 15 |
| Latency mean | 2.70 ms 95 % CI 2.69–2.71 | 2.69–2.71 | 5 | 4 / 15 |
| Latency std. dev. | 0.44 ms 95 % CI 0.44–0.45 | 0.44–0.45 | 5 | 4 / 15 |
| Latency max | 11.79 ms 95 % CI 8.97–13.29 | 8.97–13.29 | 5 | 3 / 15 |
| CPU | ||||
| CPU used | 1.96 cores 95 % CI 1.95–1.96 | 1.95–1.96 | 5 | — |
| User-space CPU share | 0.551 95 % CI 0.547–0.559 | 0.547–0.559 | 5 | — |
| CPU throttling | 0.3 ms 95 % CI 0.0–0.9 | 0.0–0.9 | 5 | 5 / 15 |
| Memory | ||||
| Anonymous memory peak | 29.0 MiB 95 % CI 26.4–32.9 | 26.4–32.9 | 5 | 3 / 15 |
| Database | ||||
| Database CPU per request | 50.5 µs 95 % CI 50.2–50.6 | 50.2–50.6 | 5 | 4 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 826.7 J 95 % CI 826.1–829.8 | 826.1–829.8 | 5 | — |
| Package energy per request | 1.174 mJ 95 % CI 1.166–1.181 | 1.166–1.181 | 5 | 4 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.46 runnable tasks 95 % CI 5.21–6.95 | 5.21–6.95 | 5 | 13 / 15 |
| CPU clock | 3,627 MHz 95 % CI 3,613–3,627 | 3,613–3,627 | 5 | — |
| Load generator CPU | 0.55 95 % CI 0.54–0.56 | 0.54–0.56 | 5 | 13 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,557 req/s 95 % CI 4,540–4,569 | 4,540–4,569 | 5 | 5 / 15 |
| Latency p99 | 32.69 ms 95 % CI 32.08–33.18 | 32.08–33.18 | 5 | 5 / 15 |
| CPU per request | 430.2 µs 95 % CI 429.8–431.2 | 429.8–431.2 | 5 | 7 / 15 |
| Memory under load (PSS) | 50.0 MiB 95 % CI 44.6–51.0 | 44.6–51.0 | 5 | 3 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 27.46 ms 95 % CI 27.35–27.55 | 27.35–27.55 | 5 | 5 / 15 |
| Latency p90 | 29.89 ms 95 % CI 29.77–30.02 | 29.77–30.02 | 5 | 5 / 15 |
| Latency p99.9 | 40.25 ms 95 % CI 35.52–44.09 | 35.52–44.09 | 5 | 5 / 15 |
| Latency p75 | 29.08 ms 95 % CI 29.04–29.15 | 29.04–29.15 | 5 | 5 / 15 |
| Latency p99.99 | 47.39 ms 95 % CI 37.23–50.94 | 37.23–50.94 | 5 | 5 / 15 |
| Latency mean | 28.00 ms 95 % CI 27.92–28.11 | 27.92–28.11 | 5 | 5 / 15 |
| Latency std. dev. | 1.57 ms 95 % CI 1.55–1.70 | 1.55–1.70 | 5 | 4 / 15 |
| Latency max | 48.82 ms 95 % CI 37.57–52.61 | 37.57–52.61 | 5 | 4 / 15 |
| CPU | ||||
| CPU used | 1.96 cores 95 % CI 1.96–1.96 | 1.96–1.96 | 5 | — |
| User-space CPU share | 0.509 95 % CI 0.503–0.511 | 0.503–0.511 | 5 | — |
| CPU throttling | 0.0 ms 95 % CI 0.0–0.6 | 0.0–0.6 | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 36.5 MiB 95 % CI 31.2–37.6 | 31.2–37.6 | 5 | 3 / 15 |
| Database | ||||
| Database CPU per request | 826.6 µs 95 % CI 824.2–827.8 | 824.2–827.8 | 5 | 12 / 15 |
| SELECTs per request | 20.04 queries 95 % CI 20.04–20.04 | 20.04–20.04 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 950.3 J 95 % CI 941.0–952.2 | 941.0–952.2 | 5 | — |
| Package energy per request | 13.836 mJ 95 % CI 13.766–13.900 | 13.766–13.900 | 5 | 5 / 15 |
| Network | ||||
| Bytes per response | 797 B 95 % CI 797–797 | 797–797 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.92 runnable tasks 95 % CI 6.86–7.54 | 6.86–7.54 | 5 | 12 / 15 |
| CPU clock | 3,627 MHz 95 % CI 3,507–3,637 | 3,507–3,637 | 5 | — |
| Load generator CPU | 0.06 95 % CI 0.06–0.06 | 0.06–0.06 | 5 | 12 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 7,753 req/s 95 % CI 7,730–7,832 | 7,730–7,832 | 5 | 4 / 15 |
| Latency p99 | 19.53 ms 95 % CI 19.13–20.39 | 19.13–20.39 | 5 | 4 / 15 |
| CPU per request | 253.0 µs 95 % CI 249.0–254.1 | 249.0–254.1 | 5 | 8 / 15 |
| Memory under load (PSS) | 42.9 MiB 95 % CI 42.3–47.7 | 42.3–47.7 | 5 | 3 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 16.06 ms 95 % CI 15.93–16.10 | 15.93–16.10 | 5 | 4 / 15 |
| Latency p90 | 18.15 ms 95 % CI 17.96–18.42 | 17.96–18.42 | 5 | 4 / 15 |
| Latency p99.9 | 22.66 ms 95 % CI 20.83–28.81 | 20.83–28.81 | 5 | 3 / 15 |
| Latency p75 | 16.75 ms 95 % CI 16.41–16.92 | 16.41–16.92 | 5 | 4 / 15 |
| Latency p99.99 | 27.50 ms 95 % CI 21.81–33.84 | 21.81–33.84 | 5 | 4 / 15 |
| Latency mean | 16.46 ms 95 % CI 16.30–16.50 | 16.30–16.50 | 5 | 4 / 15 |
| Latency std. dev. | 1.10 ms 95 % CI 0.97–1.21 | 0.97–1.21 | 5 | 3 / 15 |
| Latency max | 29.23 ms 95 % CI 22.39–36.52 | 22.39–36.52 | 5 | 4 / 15 |
| CPU | ||||
| CPU used | 1.96 cores 95 % CI 1.95–1.97 | 1.95–1.97 | 5 | — |
| User-space CPU share | 0.517 95 % CI 0.514–0.519 | 0.514–0.519 | 5 | — |
| CPU throttling | 0.0 ms 95 % CI 0.0–0.1 | 0.0–0.1 | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 29.5 MiB 95 % CI 28.9–34.3 | 28.9–34.3 | 5 | 3 / 15 |
| Database | ||||
| Database CPU per request | 499.5 µs 95 % CI 492.4–501.2 | 492.4–501.2 | 5 | 12 / 15 |
| SELECTs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| UPDATEs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| Energy | ||||
| CPU package energy | 956.2 J 95 % CI 951.0–960.5 | 951.0–960.5 | 5 | — |
| Package energy per request | 8.207 mJ 95 % CI 8.079–8.231 | 8.079–8.231 | 5 | 4 / 15 |
| Network | ||||
| Bytes per response | 319 B 95 % CI 319–319 | 319–319 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 8.45 runnable tasks 95 % CI 7.63–8.93 | 7.63–8.93 | 5 | 11 / 15 |
| CPU clock | 3,627 MHz 95 % CI 3,627–3,627 | 3,627–3,627 | 5 | — |
| Load generator CPU | 0.09 95 % CI 0.09–0.10 | 0.09–0.10 | 5 | 14 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 23,628 req/s 95 % CI 23,333–23,756 | 23,333–23,756 | 5 | 5 / 15 |
| Latency p99 | 8.09 ms 95 % CI 8.00–8.48 | 8.00–8.48 | 5 | 4 / 15 |
| CPU per request | 83.0 µs 95 % CI 82.7–84.0 | 82.7–84.0 | 5 | 5 / 15 |
| Memory under load (PSS) | 56.3 MiB 95 % CI 51.7–58.8 | 51.7–58.8 | 5 | 3 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 5.17 ms 95 % CI 5.15–5.21 | 5.15–5.21 | 5 | 5 / 15 |
| Latency p90 | 6.20 ms 95 % CI 6.15–6.55 | 6.15–6.55 | 5 | 4 / 15 |
| Latency p99.9 | 10.39 ms 95 % CI 9.95–11.97 | 9.95–11.97 | 5 | 4 / 15 |
| Latency p75 | 5.42 ms 95 % CI 5.38–5.47 | 5.38–5.47 | 5 | 4 / 15 |
| Latency p99.99 | 14.33 ms 95 % CI 11.62–20.63 | 11.62–20.63 | 5 | 4 / 15 |
| Latency mean | 5.38 ms 95 % CI 5.35–5.45 | 5.35–5.45 | 5 | 5 / 15 |
| Latency std. dev. | 0.75 ms 95 % CI 0.72–0.82 | 0.72–0.82 | 5 | 3 / 15 |
| Latency max | 16.35 ms 95 % CI 14.81–24.07 | 14.81–24.07 | 5 | 4 / 15 |
| CPU | ||||
| CPU used | 1.96 cores 95 % CI 1.96–1.96 | 1.96–1.96 | 5 | — |
| User-space CPU share | 0.719 95 % CI 0.715–0.723 | 0.715–0.723 | 5 | — |
| CPU throttling | 1.7 ms 95 % CI 0.3–2.0 | 0.3–2.0 | 5 | 5 / 15 |
| Memory | ||||
| Anonymous memory peak | 42.9 MiB 95 % CI 38.2–45.2 | 38.2–45.2 | 5 | 4 / 15 |
| Database | ||||
| Database CPU per request | 104.6 µs 95 % CI 104.1–105.8 | 104.1–105.8 | 5 | 5 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 868.3 J 95 % CI 866.0–869.7 | 866.0–869.7 | 5 | — |
| Package energy per request | 2.440 mJ 95 % CI 2.433–2.473 | 2.433–2.473 | 5 | 5 / 15 |
| Network | ||||
| Bytes per response | 4,797 B 95 % CI 4,797–4,797 | 4,797–4,797 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 10.41 runnable tasks 95 % CI 9.51–10.67 | 9.51–10.67 | 5 | 11 / 15 |
| CPU clock | 3,627 MHz 95 % CI 3,613–3,667 | 3,613–3,667 | 5 | — |
| Load generator CPU | 0.31 95 % CI 0.30–0.31 | 0.30–0.31 | 5 | 11 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 33,014 req/s 95 % CI 32,454–33,147 | 32,454–33,147 | 5 | 6 / 15 |
| Latency p99 | 6.60 ms 95 % CI 6.37–6.67 | 6.37–6.67 | 5 | 5 / 15 |
| CPU per request | 60.1 µs 95 % CI 59.7–61.0 | 59.7–61.0 | 5 | 6 / 15 |
| Memory under load (PSS) | 48.1 MiB 95 % CI 38.7–52.0 | 38.7–52.0 | 5 | 3 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 3.76 ms 95 % CI 3.70–3.80 | 3.70–3.80 | 5 | 6 / 15 |
| Latency p90 | 4.94 ms 95 % CI 4.79–5.09 | 4.79–5.09 | 5 | 6 / 15 |
| Latency p99.9 | 9.22 ms 95 % CI 9.11–9.80 | 9.11–9.80 | 5 | 4 / 15 |
| Latency p75 | 4.29 ms 95 % CI 4.26–4.35 | 4.26–4.35 | 5 | 6 / 15 |
| Latency p99.99 | 11.31 ms 95 % CI 11.19–17.54 | 11.19–17.54 | 5 | 4 / 15 |
| Latency mean | 3.72 ms 95 % CI 3.71–3.79 | 3.71–3.79 | 5 | 6 / 15 |
| Latency std. dev. | 1.06 ms 95 % CI 1.02–1.07 | 1.02–1.07 | 5 | 7 / 15 |
| Latency max | 14.64 ms 95 % CI 14.06–19.61 | 14.06–19.61 | 5 | 4 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.97–1.98 | 1.97–1.98 | 5 | — |
| User-space CPU share | 0.837 95 % CI 0.835–0.843 | 0.835–0.843 | 5 | — |
| CPU throttling | 7.2 ms 95 % CI 2.8–8.3 | 2.8–8.3 | 5 | 9 / 15 |
| Memory | ||||
| Anonymous memory peak | 34.7 MiB 95 % CI 25.1–38.6 | 25.1–38.6 | 5 | 5 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 5 / 15 |
| Energy | ||||
| CPU package energy | 723.8 J 95 % CI 717.9–725.2 | 717.9–725.2 | 5 | — |
| Package energy per request | 1.455 mJ 95 % CI 1.453–1.486 | 1.453–1.486 | 5 | 6 / 15 |
| Network | ||||
| Bytes per response | 229 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 9.06 runnable tasks 95 % CI 8.87–10.27 | 8.87–10.27 | 5 | 12 / 15 |
| CPU clock | 3,738 MHz 95 % CI 3,679–3,800 | 3,679–3,800 | 5 | — |
| Load generator CPU | 0.39 95 % CI 0.39–0.39 | 0.39–0.39 | 5 | 10 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 47,595 req/s 95 % CI 46,956–48,402 | 46,956–48,402 | 5 | 4 / 15 |
| Latency p99 | 0.86 ms 95 % CI 0.80–0.94 | 0.80–0.94 | 5 | 3 / 15 |
| CPU per request | 41.8 µs 95 % CI 41.1–42.4 | 41.1–42.4 | 5 | 5 / 15 |
| Memory under load (PSS) | 39.8 MiB 95 % CI 35.6–43.6 | 35.6–43.6 | 5 | 3 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.32 ms 95 % CI 0.31–0.32 | 0.31–0.32 | 5 | 4 / 15 |
| Latency p90 | 0.38 ms 95 % CI 0.38–0.39 | 0.38–0.39 | 5 | 4 / 15 |
| Latency p99.9 | 1.63 ms 95 % CI 1.37–1.84 | 1.37–1.84 | 5 | 4 / 15 |
| Latency p75 | 0.35 ms 95 % CI 0.34–0.35 | 0.34–0.35 | 5 | 4 / 15 |
| Latency p99.99 | 2.94 ms 95 % CI 2.56–3.57 | 2.56–3.57 | 5 | 3 / 15 |
| Latency mean | 0.33 ms 95 % CI 0.33–0.34 | 0.33–0.34 | 5 | 4 / 15 |
| Latency std. dev. | 0.12 ms 95 % CI 0.10–0.13 | 0.10–0.13 | 5 | 3 / 15 |
| Latency max | 4.80 ms 95 % CI 4.23–6.23 | 4.23–6.23 | 5 | 3 / 15 |
| CPU | ||||
| CPU used | 1.99 cores 95 % CI 1.99–1.99 | 1.99–1.99 | 5 | — |
| User-space CPU share | 0.545 95 % CI 0.541–0.548 | 0.541–0.548 | 5 | — |
| CPU throttling | 13.6 ms 95 % CI 8.8–26.6 | 8.8–26.6 | 5 | 10 / 15 |
| Memory | ||||
| Anonymous memory peak | 26.4 MiB 95 % CI 22.3–29.9 | 22.3–29.9 | 5 | 4 / 15 |
| Database | ||||
| Database CPU per request | 49.0 µs 95 % CI 47.6–49.0 | 47.6–49.0 | 5 | 4 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 838.3 J 95 % CI 830.7–850.5 | 830.7–850.5 | 5 | — |
| Package energy per request | 1.164 mJ 95 % CI 1.156–1.172 | 1.156–1.172 | 5 | 4 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.97 runnable tasks 95 % CI 7.84–8.77 | 7.84–8.77 | 5 | 12 / 15 |
| CPU clock | 3,537 MHz 95 % CI 3,437–3,593 | 3,437–3,593 | 5 | — |
| Load generator CPU | 0.55 95 % CI 0.53–0.55 | 0.53–0.55 | 5 | 13 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 43,672 req/s 95 % CI 43,324–43,854 | 43,324–43,854 | 5 | 4 / 15 |
| Latency p99 | 15.04 ms 95 % CI 14.51–15.52 | 14.51–15.52 | 5 | 4 / 15 |
| CPU per request | 45.6 µs 95 % CI 45.4–45.9 | 45.4–45.9 | 5 | 5 / 15 |
| Memory under load (PSS) | 93.2 MiB 95 % CI 90.5–98.8 | 90.5–98.8 | 5 | 4 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 11.32 ms 95 % CI 11.31–11.38 | 11.31–11.38 | 5 | 4 / 15 |
| Latency p90 | 12.45 ms 95 % CI 12.10–12.90 | 12.10–12.90 | 5 | 4 / 15 |
| Latency p99.9 | 22.41 ms 95 % CI 20.80–24.66 | 20.80–24.66 | 5 | 4 / 15 |
| Latency p75 | 11.64 ms 95 % CI 11.55–11.75 | 11.55–11.75 | 5 | 4 / 15 |
| Latency p99.99 | 28.92 ms 95 % CI 21.26–29.81 | 21.26–29.81 | 5 | 4 / 15 |
| Latency mean | 11.65 ms 95 % CI 11.60–11.75 | 11.60–11.75 | 5 | 4 / 15 |
| Latency std. dev. | 1.02 ms 95 % CI 0.96–1.09 | 0.96–1.09 | 5 | 4 / 15 |
| Latency max | 29.98 ms 95 % CI 24.82–30.31 | 24.82–30.31 | 5 | 4 / 15 |
| CPU | ||||
| CPU used | 1.99 cores 95 % CI 1.99–1.99 | 1.99–1.99 | 5 | — |
| User-space CPU share | 0.566 95 % CI 0.558–0.570 | 0.558–0.570 | 5 | — |
| CPU throttling | 8.0 ms 95 % CI 7.5–15.3 | 7.5–15.3 | 5 | 9 / 15 |
| Memory | ||||
| Anonymous memory peak | 79.8 MiB 95 % CI 77.1–85.1 | 77.1–85.1 | 5 | 6 / 15 |
| Database | ||||
| Database CPU per request | 53.9 µs 95 % CI 53.7–54.3 | 53.7–54.3 | 5 | 4 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 813.5 J 95 % CI 811.1–817.4 | 811.1–817.4 | 5 | — |
| Package energy per request | 1.236 mJ 95 % CI 1.232–1.253 | 1.232–1.253 | 5 | 4 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 8.02 runnable tasks 95 % CI 7.80–8.41 | 7.80–8.41 | 5 | 12 / 15 |
| CPU clock | 3,627 MHz 95 % CI 3,480–3,627 | 3,480–3,627 | 5 | — |
| Load generator CPU | 0.52 95 % CI 0.51–0.52 | 0.51–0.52 | 5 | 12 / 15 |
Fixed rate
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,999 req/s 95 % CI 4,999–4,999 | 4,999–4,999 | 5 | 15 / 15 |
| Latency p99 | 1.50 ms 95 % CI 1.47–1.53 | 1.47–1.53 | 5 | 4 / 15 |
| CPU per request | 221.4 µs 95 % CI 215.9–223.4 | 215.9–223.4 | 5 | 8 / 15 |
| Memory under load (PSS) | 62.3 MiB 95 % CI 58.3–63.6 | 58.3–63.6 | 5 | 4 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.70 ms 95 % CI 0.67–0.74 | 0.67–0.74 | 5 | 5 / 15 |
| Latency p90 | 1.12 ms 95 % CI 1.10–1.18 | 1.10–1.18 | 5 | 5 / 15 |
| Latency p99.9 | 5.11 ms 95 % CI 4.66–5.51 | 4.66–5.51 | 5 | 6 / 15 |
| Latency p75 | 0.95 ms 95 % CI 0.95–0.98 | 0.95–0.98 | 5 | 7 / 15 |
| Latency p99.99 | 10.44 ms 95 % CI 8.46–12.06 | 8.46–12.06 | 5 | 5 / 15 |
| Latency mean | 0.76 ms 95 % CI 0.75–0.79 | 0.75–0.79 | 5 | 5 / 15 |
| Latency max | 10.91 ms 95 % CI 9.78–13.08 | 9.78–13.08 | 5 | 3 / 15 |
| CPU | ||||
| CPU used | 1.10 cores 95 % CI 1.08–1.11 | 1.08–1.11 | 5 | — |
| User-space CPU share | 0.576 95 % CI 0.564–0.589 | 0.564–0.589 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 48.7 MiB 95 % CI 44.9–50.1 | 44.9–50.1 | 5 | 4 / 15 |
| Database | ||||
| Database CPU per request | 163.5 µs 95 % CI 161.1–165.9 | 161.1–165.9 | 5 | 12 / 15 |
| SELECTs per request | 1.00 queries | — | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 394.2 J 95 % CI 382.7–402.4 | 382.7–402.4 | 5 | — |
| Package energy per request | 3.942 mJ 95 % CI 3.828–4.024 | 3.828–4.024 | 5 | 4 / 15 |
| Network | ||||
| Bytes per response | 30 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.61 runnable tasks 95 % CI 7.24–8.06 | 7.24–8.06 | 5 | 11 / 15 |
| CPU clock | 1,220 MHz 95 % CI 1,208–1,281 | 1,208–1,281 | 5 | — |
| Load generator CPU | 0.14 95 % CI 0.14–0.14 | 0.14–0.14 | 5 | 13 / 15 |