Overall
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 73.1 | — | — | 3 / 15 |
| CPU efficiency index | 65.8 | — | — | 4 / 15 |
| Peak memory | 144.1 MiB | — | — | 8 / 15 |
ASP.NET Core minimal API on .NET 10 (LTS until November 2028) with the JIT.
Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 73.1 | — | — | 3 / 15 |
| CPU efficiency index | 65.8 | — | — | 4 / 15 |
| Peak memory | 144.1 MiB | — | — | 8 / 15 |
Start-up
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Cold start | 501 ms 95 % CI 489–536 | 489–536 | 5 | 8 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Memory | ||||
| Memory at idle | 65.3 MiB 95 % CI 65.0–65.3 | 65.0–65.3 | 5 | 7 / 15 |
| Anonymous memory at idle | 9.1 MiB 95 % CI 9.1–9.2 | 9.1–9.2 | 5 | 5 / 15 |
| Start-up | ||||
| Cold start (fastest) | 476 ms 95 % CI 460–488 | 460–488 | 5 | 8 / 15 |
| Cold start (slowest) | 519 ms 95 % CI 511–544 | 511–544 | 5 | 7 / 15 |
| Footprint | ||||
| Image size | 344 MB | — | 5 | 9 / 15 |
Cold load
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 35,373 req/s 95 % CI 34,502–36,232 | 34,502–36,232 | 5 | 6 / 15 |
| Latency p99 | 105.88 ms 95 % CI 100.35–137.52 | 100.35–137.52 | 5 | 12 / 15 |
| CPU per request | 54.8 µs 95 % CI 53.6–55.9 | 53.6–55.9 | 5 | 7 / 15 |
| Memory under load (PSS) | 96.6 MiB 95 % CI 88.6–98.3 | 88.6–98.3 | 5 | 6 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 2.47 ms 95 % CI 2.42–2.50 | 2.42–2.50 | 5 | 3 / 15 |
| Latency p90 | 7.18 ms 95 % CI 6.93–7.40 | 6.93–7.40 | 5 | 9 / 15 |
| Latency p99.9 | 205.13 ms 95 % CI 200.57–238.77 | 200.57–238.77 | 5 | 12 / 15 |
| Latency p75 | 4.81 ms 95 % CI 4.55–5.09 | 4.55–5.09 | 5 | 7 / 15 |
| Latency p99.99 | 221.88 ms 95 % CI 213.53–250.86 | 213.53–250.86 | 5 | 12 / 15 |
| Latency mean | 5.76 ms 95 % CI 5.69–6.28 | 5.69–6.28 | 5 | 7 / 15 |
| Latency std. dev. | 17.05 ms 95 % CI 16.46–20.99 | 16.46–20.99 | 5 | 12 / 15 |
| Latency max | 229.98 ms 95 % CI 218.47–259.61 | 218.47–259.61 | 5 | 11 / 15 |
| CPU | ||||
| CPU used | 1.93 cores 95 % CI 1.92–1.94 | 1.92–1.94 | 5 | — |
| User-space CPU share | 0.643 95 % CI 0.636–0.645 | 0.636–0.645 | 5 | — |
| CPU throttling | < 0.1 ms 95 % CI 0.0–0.6 | 0.0–0.6 | 5 | 6 / 15 |
| Memory | ||||
| Anonymous memory peak | 38.4 MiB 95 % CI 26.5–39.2 | 26.5–39.2 | 5 | 6 / 15 |
| Database | ||||
| Database CPU per request | 62.2 µs 95 % CI 55.9–63.0 | 55.9–63.0 | 5 | 6 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Start-up | ||||
| Cold vs. warm throughput | 0.68 95 % CI 0.65–0.69 | 0.65–0.69 | 5 | 12 / 15 |
| Energy | ||||
| CPU package energy | 522.4 J 95 % CI 516.4–526.1 | 516.4–526.1 | 5 | — |
| Package energy per request | 1.480 mJ 95 % CI 1.449–1.501 | 1.449–1.501 | 5 | 7 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.18 runnable tasks 95 % CI 3.57–4.88 | 3.57–4.88 | 5 | 4 / 15 |
| CPU clock | 3,510 MHz 95 % CI 3,440–3,600 | 3,440–3,600 | 5 | — |
| Load generator CPU | 0.40 95 % CI 0.39–0.41 | 0.39–0.41 | 5 | 10 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 145,691 req/s 95 % CI 144,395–148,514 | 144,395–148,514 | 5 | 3 / 15 |
| Latency p99 | 1.54 ms 95 % CI 1.41–1.71 | 1.41–1.71 | 5 | 3 / 15 |
| CPU per request | 13.6 µs 95 % CI 13.3–13.6 | 13.3–13.6 | 5 | 3 / 15 |
| Memory under load (PSS) | 106.3 MiB 95 % CI 104.7–108.9 | 104.7–108.9 | 5 | 6 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.84 ms 95 % CI 0.83–0.85 | 0.83–0.85 | 5 | 3 / 15 |
| Latency p90 | 1.04 ms 95 % CI 1.02–1.05 | 1.02–1.05 | 5 | 3 / 15 |
| Latency p99.9 | 3.33 ms 95 % CI 3.16–3.67 | 3.16–3.67 | 5 | 3 / 15 |
| Latency p75 | 0.93 ms 95 % CI 0.92–0.94 | 0.92–0.94 | 5 | 3 / 15 |
| Latency p99.99 | 4.52 ms 95 % CI 4.29–6.24 | 4.29–6.24 | 5 | 3 / 15 |
| Latency mean | 0.85 ms 95 % CI 0.84–0.86 | 0.84–0.86 | 5 | 3 / 15 |
| Latency std. dev. | 0.22 ms 95 % CI 0.21–0.27 | 0.21–0.27 | 5 | 3 / 15 |
| Latency max | 8.19 ms 95 % CI 7.52–10.97 | 7.52–10.97 | 5 | 3 / 15 |
| CPU | ||||
| CPU used | 1.97 cores 95 % CI 1.96–1.98 | 1.96–1.98 | 5 | — |
| User-space CPU share | 0.477 95 % CI 0.474–0.488 | 0.474–0.488 | 5 | — |
| CPU throttling | 6.7 ms 95 % CI 3.8–8.7 | 3.8–8.7 | 5 | 9 / 15 |
| Memory | ||||
| Anonymous memory peak | 41.2 MiB 95 % CI 39.7–43.7 | 39.7–43.7 | 5 | 6 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 3 / 15 |
| Energy | ||||
| CPU package energy | 806.4 J 95 % CI 802.2–822.5 | 802.2–822.5 | 5 | — |
| Package energy per request | 0.367 mJ 95 % CI 0.366–0.370 | 0.366–0.370 | 5 | 3 / 15 |
| Network | ||||
| Bytes per response | 186 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.62 runnable tasks 95 % CI 5.70–8.20 | 5.70–8.20 | 5 | 14 / 15 |
| CPU clock | 3,672 MHz 95 % CI 3,638–3,788 | 3,638–3,788 | 5 | — |
| Load generator CPU | 0.64 95 % CI 0.63–0.64 | 0.63–0.64 | 5 | 13 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 52,350 req/s 95 % CI 51,964–53,183 | 51,964–53,183 | 5 | 3 / 15 |
| Latency p99 | 3.97 ms 95 % CI 3.86–4.15 | 3.86–4.15 | 5 | 3 / 15 |
| CPU per request | 37.5 µs 95 % CI 36.9–37.8 | 36.9–37.8 | 5 | 3 / 15 |
| Memory under load (PSS) | 102.2 MiB 95 % CI 95.5–104.2 | 95.5–104.2 | 5 | 6 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 2.32 ms 95 % CI 2.28–2.32 | 2.28–2.32 | 5 | 3 / 15 |
| Latency p90 | 2.62 ms 95 % CI 2.55–2.79 | 2.55–2.79 | 5 | 3 / 15 |
| Latency p99.9 | 5.53 ms 95 % CI 5.26–6.70 | 5.26–6.70 | 5 | 3 / 15 |
| Latency p75 | 2.40 ms 95 % CI 2.36–2.41 | 2.36–2.41 | 5 | 3 / 15 |
| Latency p99.99 | 10.53 ms 95 % CI 7.48–13.19 | 7.48–13.19 | 5 | 4 / 15 |
| Latency mean | 2.42 ms 95 % CI 2.38–2.44 | 2.38–2.44 | 5 | 3 / 15 |
| Latency std. dev. | 0.40 ms 95 % CI 0.40–0.43 | 0.40–0.43 | 5 | 3 / 15 |
| Latency max | 12.08 ms 95 % CI 9.94–14.98 | 9.94–14.98 | 5 | 4 / 15 |
| CPU | ||||
| CPU used | 1.96 cores 95 % CI 1.96–1.96 | 1.96–1.96 | 5 | — |
| User-space CPU share | 0.524 95 % CI 0.523–0.532 | 0.523–0.532 | 5 | — |
| CPU throttling | 0.7 ms 95 % CI 0.2–1.6 | 0.2–1.6 | 5 | 6 / 15 |
| Memory | ||||
| Anonymous memory peak | 36.9 MiB 95 % CI 30.3–39.1 | 30.3–39.1 | 5 | 5 / 15 |
| Database | ||||
| Database CPU per request | 45.3 µs 95 % CI 44.8–45.8 | 44.8–45.8 | 5 | 3 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 880.1 J 95 % CI 872.2–883.5 | 872.2–883.5 | 5 | — |
| Package energy per request | 1.117 mJ 95 % CI 1.101–1.124 | 1.101–1.124 | 5 | 3 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.11 runnable tasks 95 % CI 5.89–8.31 | 5.89–8.31 | 5 | 12 / 15 |
| CPU clock | 3,627 MHz 95 % CI 3,613–3,713 | 3,613–3,713 | 5 | — |
| Load generator CPU | 0.57 95 % CI 0.55–0.57 | 0.55–0.57 | 5 | 14 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,803 req/s 95 % CI 4,779–4,815 | 4,779–4,815 | 5 | 3 / 15 |
| Latency p99 | 30.18 ms 95 % CI 29.62–31.14 | 29.62–31.14 | 5 | 3 / 15 |
| CPU per request | 410.0 µs 95 % CI 408.9–410.8 | 408.9–410.8 | 5 | 6 / 15 |
| Memory under load (PSS) | 108.8 MiB 95 % CI 105.3–109.9 | 105.3–109.9 | 5 | 6 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 26.23 ms 95 % CI 26.08–26.30 | 26.08–26.30 | 5 | 3 / 15 |
| Latency p90 | 28.22 ms 95 % CI 28.12–28.46 | 28.12–28.46 | 5 | 2 / 15 |
| Latency p99.9 | 36.19 ms 95 % CI 32.17–40.97 | 32.17–40.97 | 5 | 3 / 15 |
| Latency p75 | 27.44 ms 95 % CI 27.35–27.60 | 27.35–27.60 | 5 | 3 / 15 |
| Latency p99.99 | 37.65 ms 95 % CI 33.72–49.10 | 33.72–49.10 | 5 | 2 / 15 |
| Latency mean | 26.58 ms 95 % CI 26.50–26.71 | 26.50–26.71 | 5 | 3 / 15 |
| Latency std. dev. | 1.38 ms 95 % CI 1.24–1.44 | 1.24–1.44 | 5 | 2 / 15 |
| Latency max | 40.94 ms 95 % CI 34.30–51.52 | 34.30–51.52 | 5 | 3 / 15 |
| CPU | ||||
| CPU used | 1.97 cores 95 % CI 1.96–1.97 | 1.96–1.97 | 5 | — |
| User-space CPU share | 0.492 95 % CI 0.489–0.493 | 0.489–0.493 | 5 | — |
| CPU throttling | 0.1 ms 95 % CI 0.0–0.8 | 0.0–0.8 | 5 | 8 / 15 |
| Memory | ||||
| Anonymous memory peak | 43.7 MiB 95 % CI 40.1–44.6 | 40.1–44.6 | 5 | 5 / 15 |
| Database | ||||
| Database CPU per request | 807.4 µs 95 % CI 805.4–809.2 | 805.4–809.2 | 5 | 7 / 15 |
| SELECTs per request | 20.04 queries 95 % CI 20.03–20.04 | 20.03–20.04 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 936.5 J 95 % CI 935.1–942.5 | 935.1–942.5 | 5 | — |
| Package energy per request | 13.005 mJ 95 % CI 12.918–13.061 | 12.918–13.061 | 5 | 3 / 15 |
| Network | ||||
| Bytes per response | 797 B 95 % CI 797–797 | 797–797 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.95 runnable tasks 95 % CI 7.29–9.38 | 7.29–9.38 | 5 | 15 / 15 |
| CPU clock | 3,627 MHz 95 % CI 3,600–3,680 | 3,600–3,680 | 5 | — |
| Load generator CPU | 0.06 95 % CI 0.06–0.06 | 0.06–0.06 | 5 | 15 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 7,951 req/s 95 % CI 7,725–7,994 | 7,725–7,994 | 5 | 3 / 15 |
| Latency p99 | 19.02 ms 95 % CI 18.50–20.38 | 18.50–20.38 | 5 | 3 / 15 |
| CPU per request | 247.8 µs 95 % CI 246.2–255.3 | 246.2–255.3 | 5 | 6 / 15 |
| Memory under load (PSS) | 104.0 MiB 95 % CI 101.9–106.9 | 101.9–106.9 | 5 | 6 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 15.71 ms 95 % CI 15.56–16.11 | 15.56–16.11 | 5 | 3 / 15 |
| Latency p90 | 17.76 ms 95 % CI 17.29–18.23 | 17.29–18.23 | 5 | 3 / 15 |
| Latency p99.9 | 22.45 ms 95 % CI 20.94–23.88 | 20.94–23.88 | 5 | 2 / 15 |
| Latency p75 | 16.37 ms 95 % CI 16.10–16.58 | 16.10–16.58 | 5 | 3 / 15 |
| Latency p99.99 | 26.08 ms 95 % CI 24.68–27.58 | 24.68–27.58 | 5 | 2 / 15 |
| Latency mean | 16.06 ms 95 % CI 15.97–16.53 | 15.97–16.53 | 5 | 3 / 15 |
| Latency std. dev. | 1.05 ms 95 % CI 0.93–1.09 | 0.93–1.09 | 5 | 2 / 15 |
| Latency max | 28.91 ms 95 % CI 25.83–29.90 | 25.83–29.90 | 5 | 3 / 15 |
| CPU | ||||
| CPU used | 1.97 cores 95 % CI 1.95–1.97 | 1.95–1.97 | 5 | — |
| User-space CPU share | 0.487 95 % CI 0.484–0.489 | 0.484–0.489 | 5 | — |
| CPU throttling | 0.2 ms 95 % CI 0.0–1.0 | 0.0–1.0 | 5 | 8 / 15 |
| Memory | ||||
| Anonymous memory peak | 38.6 MiB 95 % CI 36.7–41.7 | 36.7–41.7 | 5 | 5 / 15 |
| Database | ||||
| Database CPU per request | 489.6 µs 95 % CI 486.4–503.3 | 486.4–503.3 | 5 | 7 / 15 |
| SELECTs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| UPDATEs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| Energy | ||||
| CPU package energy | 955.6 J 95 % CI 953.2–959.5 | 953.2–959.5 | 5 | — |
| Package energy per request | 7.987 mJ 95 % CI 7.939–8.265 | 7.939–8.265 | 5 | 3 / 15 |
| Network | ||||
| Bytes per response | 319 B 95 % CI 319–319 | 319–319 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 10.83 runnable tasks 95 % CI 10.21–11.96 | 10.21–11.96 | 5 | 15 / 15 |
| CPU clock | 3,627 MHz 95 % CI 3,547–3,627 | 3,547–3,627 | 5 | — |
| Load generator CPU | 0.10 95 % CI 0.09–0.10 | 0.09–0.10 | 5 | 15 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 28,373 req/s 95 % CI 28,307–28,478 | 28,307–28,478 | 5 | 3 / 15 |
| Latency p99 | 6.79 ms 95 % CI 6.71–6.99 | 6.71–6.99 | 5 | 3 / 15 |
| CPU per request | 69.3 µs 95 % CI 68.9–69.5 | 68.9–69.5 | 5 | 3 / 15 |
| Memory under load (PSS) | 115.5 MiB 95 % CI 114.4–117.9 | 114.4–117.9 | 5 | 7 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 4.29 ms 95 % CI 4.28–4.31 | 4.28–4.31 | 5 | 3 / 15 |
| Latency p90 | 5.25 ms 95 % CI 5.10–5.35 | 5.10–5.35 | 5 | 3 / 15 |
| Latency p99.9 | 9.40 ms 95 % CI 9.01–10.38 | 9.01–10.38 | 5 | 3 / 15 |
| Latency p75 | 4.51 ms 95 % CI 4.48–4.52 | 4.48–4.52 | 5 | 3 / 15 |
| Latency p99.99 | 14.91 ms 95 % CI 14.26–15.44 | 14.26–15.44 | 5 | 5 / 15 |
| Latency mean | 4.48 ms 95 % CI 4.46–4.49 | 4.46–4.49 | 5 | 3 / 15 |
| Latency std. dev. | 0.66 ms 95 % CI 0.63–0.76 | 0.63–0.76 | 5 | 2 / 15 |
| Latency max | 15.89 ms 95 % CI 15.26–17.07 | 15.26–17.07 | 5 | 3 / 15 |
| CPU | ||||
| CPU used | 1.96 cores 95 % CI 1.96–1.96 | 1.96–1.96 | 5 | — |
| User-space CPU share | 0.669 95 % CI 0.666–0.673 | 0.666–0.673 | 5 | — |
| CPU throttling | 0.0 ms 95 % CI 0.0–1.0 | 0.0–1.0 | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 50.4 MiB 95 % CI 49.1–52.6 | 49.1–52.6 | 5 | 7 / 15 |
| Database | ||||
| Database CPU per request | 92.2 µs 95 % CI 91.8–92.5 | 91.8–92.5 | 5 | 2 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 936.4 J 95 % CI 934.7–937.7 | 934.7–937.7 | 5 | — |
| Package energy per request | 2.193 mJ 95 % CI 2.183–2.204 | 2.183–2.204 | 5 | 3 / 15 |
| Network | ||||
| Bytes per response | 4,797 B 95 % CI 4,797–4,797 | 4,797–4,797 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 12.75 runnable tasks 95 % CI 11.22–13.25 | 11.22–13.25 | 5 | 15 / 15 |
| CPU clock | 3,630 MHz 95 % CI 3,587–3,667 | 3,587–3,667 | 5 | — |
| Load generator CPU | 0.37 95 % CI 0.36–0.37 | 0.36–0.37 | 5 | 14 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 41,210 req/s 95 % CI 41,118–41,738 | 41,118–41,738 | 5 | 4 / 15 |
| Latency p99 | 5.40 ms 95 % CI 5.23–5.48 | 5.23–5.48 | 5 | 3 / 15 |
| CPU per request | 48.1 µs 95 % CI 47.5–48.1 | 47.5–48.1 | 5 | 5 / 15 |
| Memory under load (PSS) | 104.8 MiB 95 % CI 103.2–109.6 | 103.2–109.6 | 5 | 7 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 2.97 ms 95 % CI 2.93–2.98 | 2.93–2.98 | 5 | 4 / 15 |
| Latency p90 | 3.90 ms 95 % CI 3.85–3.91 | 3.85–3.91 | 5 | 4 / 15 |
| Latency p99.9 | 7.57 ms 95 % CI 7.28–8.02 | 7.28–8.02 | 5 | 3 / 15 |
| Latency p75 | 3.42 ms 95 % CI 3.37–3.43 | 3.37–3.43 | 5 | 4 / 15 |
| Latency p99.99 | 9.21 ms 95 % CI 9.00–10.10 | 9.00–10.10 | 5 | 3 / 15 |
| Latency mean | 2.96 ms 95 % CI 2.91–2.97 | 2.91–2.97 | 5 | 3 / 15 |
| Latency std. dev. | 0.84 ms 95 % CI 0.83–0.85 | 0.83–0.85 | 5 | 3 / 15 |
| Latency max | 13.26 ms 95 % CI 13.09–14.50 | 13.09–14.50 | 5 | 3 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.98–1.98 | 1.98–1.98 | 5 | — |
| User-space CPU share | 0.793 95 % CI 0.793–0.799 | 0.793–0.799 | 5 | — |
| CPU throttling | 6.9 ms 95 % CI 3.5–15.0 | 3.5–15.0 | 5 | 7 / 15 |
| Memory | ||||
| Anonymous memory peak | 39.7 MiB 95 % CI 37.9–41.7 | 37.9–41.7 | 5 | 7 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 3 / 15 |
| Energy | ||||
| CPU package energy | 724.2 J 95 % CI 719.8–736.0 | 719.8–736.0 | 5 | — |
| Package energy per request | 1.168 mJ 95 % CI 1.162–1.171 | 1.162–1.171 | 5 | 4 / 15 |
| Network | ||||
| Bytes per response | 229 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 11.17 runnable tasks 95 % CI 9.69–11.73 | 9.69–11.73 | 5 | 15 / 15 |
| CPU clock | 3,653 MHz 95 % CI 3,642–3,750 | 3,642–3,750 | 5 | — |
| Load generator CPU | 0.48 95 % CI 0.48–0.48 | 0.48–0.48 | 5 | 13 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 54,335 req/s 95 % CI 53,651–55,215 | 53,651–55,215 | 5 | 3 / 15 |
| Latency p99 | 0.93 ms 95 % CI 0.87–0.96 | 0.87–0.96 | 5 | 5 / 15 |
| CPU per request | 36.6 µs 95 % CI 36.1–37.2 | 36.1–37.2 | 5 | 3 / 15 |
| Memory under load (PSS) | 100.8 MiB 95 % CI 99.3–101.8 | 99.3–101.8 | 5 | 6 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.28 ms 95 % CI 0.27–0.28 | 0.27–0.28 | 5 | 3 / 15 |
| Latency p90 | 0.34 ms 95 % CI 0.33–0.34 | 0.33–0.34 | 5 | 3 / 15 |
| Latency p99.9 | 1.74 ms 95 % CI 1.66–2.21 | 1.66–2.21 | 5 | 5 / 15 |
| Latency p75 | 0.30 ms 95 % CI 0.30–0.31 | 0.30–0.31 | 5 | 3 / 15 |
| Latency p99.99 | 3.43 ms 95 % CI 3.21–5.48 | 3.21–5.48 | 5 | 4 / 15 |
| Latency mean | 0.30 ms 95 % CI 0.29–0.30 | 0.29–0.30 | 5 | 3 / 15 |
| Latency std. dev. | 0.13 ms 95 % CI 0.13–0.16 | 0.13–0.16 | 5 | 4 / 15 |
| Latency max | 6.28 ms 95 % CI 5.32–10.87 | 5.32–10.87 | 5 | 4 / 15 |
| CPU | ||||
| CPU used | 1.99 cores 95 % CI 1.98–1.99 | 1.98–1.99 | 5 | — |
| User-space CPU share | 0.510 95 % CI 0.503–0.513 | 0.503–0.513 | 5 | — |
| CPU throttling | 14.8 ms 95 % CI 8.2–24.0 | 8.2–24.0 | 5 | 11 / 15 |
| Memory | ||||
| Anonymous memory peak | 35.6 MiB 95 % CI 34.1–36.5 | 34.1–36.5 | 5 | 6 / 15 |
| Database | ||||
| Database CPU per request | 43.3 µs 95 % CI 42.7–43.8 | 42.7–43.8 | 5 | 3 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 903.9 J 95 % CI 893.5–920.1 | 893.5–920.1 | 5 | — |
| Package energy per request | 1.103 mJ 95 % CI 1.102–1.107 | 1.102–1.107 | 5 | 3 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 9.23 runnable tasks 95 % CI 8.36–10.61 | 8.36–10.61 | 5 | 15 / 15 |
| CPU clock | 3,507 MHz 95 % CI 3,440–3,587 | 3,440–3,587 | 5 | — |
| Load generator CPU | 0.55 95 % CI 0.54–0.55 | 0.54–0.55 | 5 | 15 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 47,914 req/s 95 % CI 47,409–48,134 | 47,409–48,134 | 5 | 3 / 15 |
| Latency p99 | 13.90 ms 95 % CI 13.43–14.41 | 13.43–14.41 | 5 | 3 / 15 |
| CPU per request | 41.5 µs 95 % CI 41.4–42.0 | 41.4–42.0 | 5 | 3 / 15 |
| Memory under load (PSS) | 144.1 MiB 95 % CI 142.9–147.0 | 142.9–147.0 | 5 | 8 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 10.35 ms 95 % CI 10.27–10.51 | 10.27–10.51 | 5 | 3 / 15 |
| Latency p90 | 11.50 ms 95 % CI 11.26–11.80 | 11.26–11.80 | 5 | 3 / 15 |
| Latency p99.9 | 20.69 ms 95 % CI 19.01–21.99 | 19.01–21.99 | 5 | 3 / 15 |
| Latency p75 | 10.62 ms 95 % CI 10.60–10.75 | 10.60–10.75 | 5 | 3 / 15 |
| Latency p99.99 | 23.07 ms 95 % CI 22.09–23.92 | 22.09–23.92 | 5 | 3 / 15 |
| Latency mean | 10.62 ms 95 % CI 10.57–10.73 | 10.57–10.73 | 5 | 3 / 15 |
| Latency std. dev. | 0.93 ms 95 % CI 0.90–0.99 | 0.90–0.99 | 5 | 3 / 15 |
| Latency max | 23.48 ms 95 % CI 22.34–24.14 | 22.34–24.14 | 5 | 3 / 15 |
| CPU | ||||
| CPU used | 1.99 cores 95 % CI 1.99–1.99 | 1.99–1.99 | 5 | — |
| User-space CPU share | 0.534 95 % CI 0.533–0.539 | 0.533–0.539 | 5 | — |
| CPU throttling | 7.4 ms 95 % CI 5.5–12.3 | 5.5–12.3 | 5 | 8 / 15 |
| Memory | ||||
| Anonymous memory peak | 78.9 MiB 95 % CI 77.8–81.9 | 77.8–81.9 | 5 | 5 / 15 |
| Database | ||||
| Database CPU per request | 49.2 µs 95 % CI 49.1–49.8 | 49.1–49.8 | 5 | 3 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 840.8 J 95 % CI 830.7–851.0 | 830.7–851.0 | 5 | — |
| Package energy per request | 1.167 mJ 95 % CI 1.163–1.176 | 1.163–1.176 | 5 | 3 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 8.97 runnable tasks 95 % CI 8.49–9.66 | 8.49–9.66 | 5 | 15 / 15 |
| CPU clock | 3,507 MHz 95 % CI 3,493–3,587 | 3,493–3,587 | 5 | — |
| Load generator CPU | 0.55 95 % CI 0.54–0.55 | 0.54–0.55 | 5 | 14 / 15 |
Fixed rate
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,999 req/s 95 % CI 4,999–4,999 | 4,999–4,999 | 5 | 4 / 15 |
| Latency p99 | 1.34 ms 95 % CI 1.33–1.37 | 1.33–1.37 | 5 | 3 / 15 |
| CPU per request | 239.4 µs 95 % CI 235.3–242.2 | 235.3–242.2 | 5 | 10 / 15 |
| Memory under load (PSS) | 124.1 MiB 95 % CI 119.2–125.0 | 119.2–125.0 | 5 | 6 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.68 ms 95 % CI 0.66–0.71 | 0.66–0.71 | 5 | 4 / 15 |
| Latency p90 | 1.00 ms 95 % CI 1.00–1.06 | 1.00–1.06 | 5 | 4 / 15 |
| Latency p99.9 | 4.55 ms 95 % CI 4.19–7.09 | 4.19–7.09 | 5 | 5 / 15 |
| Latency p75 | 0.89 ms 95 % CI 0.88–0.91 | 0.88–0.91 | 5 | 4 / 15 |
| Latency p99.99 | 10.89 ms 95 % CI 7.75–11.32 | 7.75–11.32 | 5 | 6 / 15 |
| Latency mean | 0.70 ms 95 % CI 0.70–0.72 | 0.70–0.72 | 5 | 4 / 15 |
| Latency max | 11.57 ms 95 % CI 8.73–12.17 | 8.73–12.17 | 5 | 5 / 15 |
| CPU | ||||
| CPU used | 1.19 cores 95 % CI 1.17–1.21 | 1.17–1.21 | 5 | — |
| User-space CPU share | 0.556 95 % CI 0.550–0.568 | 0.550–0.568 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 59.0 MiB 95 % CI 53.9–59.9 | 53.9–59.9 | 5 | 6 / 15 |
| Database | ||||
| Database CPU per request | 170.0 µs 95 % CI 168.8–171.6 | 168.8–171.6 | 5 | 13 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 401.4 J 95 % CI 387.2–402.8 | 387.2–402.8 | 5 | — |
| Package energy per request | 4.014 mJ 95 % CI 3.872–4.028 | 3.872–4.028 | 5 | 8 / 15 |
| Network | ||||
| Bytes per response | 30 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 8.72 runnable tasks 95 % CI 8.09–9.25 | 8.09–9.25 | 5 | 15 / 15 |
| CPU clock | 1,344 MHz 95 % CI 1,337–1,467 | 1,337–1,467 | 5 | — |
| Load generator CPU | 0.14 95 % CI 0.14–0.14 | 0.14–0.14 | 5 | 15 / 15 |