Overall
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 52.6 | — | — | 8 / 15 |
| CPU efficiency index | 55.7 | — | — | 7 / 15 |
| Peak memory | 97.2 MiB | — | — | 5 / 15 |
The same ASP.NET Core minimal API on .NET 11, compiled ahead of time to a native executable.
Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 52.6 | — | — | 8 / 15 |
| CPU efficiency index | 55.7 | — | — | 7 / 15 |
| Peak memory | 97.2 MiB | — | — | 5 / 15 |
Start-up
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Cold start | 215 ms 95 % CI 200–234 | 200–234 | 5 | 4 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Memory | ||||
| Memory at idle | 21.8 MiB 95 % CI 21.7–21.9 | 21.7–21.9 | 5 | 3 / 15 |
| Anonymous memory at idle | 8.4 MiB 95 % CI 8.3–8.4 | 8.3–8.4 | 5 | 4 / 15 |
| Start-up | ||||
| Cold start (fastest) | 198 ms 95 % CI 186–213 | 186–213 | 5 | 4 / 15 |
| Cold start (slowest) | 236 ms 95 % CI 219–251 | 219–251 | 5 | 4 / 15 |
| Footprint | ||||
| Image size | 245 MB | — | 5 | 4 / 15 |
Cold load
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 31,122 req/s 95 % CI 29,999–32,778 | 29,999–32,778 | 5 | 7 / 15 |
| Latency p99 | 9.35 ms 95 % CI 7.70–10.81 | 7.70–10.81 | 5 | 6 / 15 |
| CPU per request | 49.3 µs 95 % CI 48.8–53.1 | 48.8–53.1 | 5 | 5 / 15 |
| Memory under load (PSS) | 36.9 MiB 95 % CI 36.8–37.3 | 36.8–37.3 | 5 | 3 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 4.01 ms 95 % CI 3.66–4.23 | 3.66–4.23 | 5 | 7 / 15 |
| Latency p90 | 5.09 ms 95 % CI 4.72–5.28 | 4.72–5.28 | 5 | 6 / 15 |
| Latency p99.9 | 50.18 ms 95 % CI 29.68–58.51 | 29.68–58.51 | 5 | 6 / 15 |
| Latency p75 | 4.51 ms 95 % CI 4.19–4.60 | 4.19–4.60 | 5 | 6 / 15 |
| Latency p99.99 | 65.64 ms 95 % CI 40.78–71.98 | 40.78–71.98 | 5 | 6 / 15 |
| Latency mean | 4.17 ms 95 % CI 3.97–4.44 | 3.97–4.44 | 5 | 5 / 15 |
| Latency std. dev. | 2.67 ms 95 % CI 1.55–3.23 | 1.55–3.23 | 5 | 5 / 15 |
| Latency max | 69.77 ms 95 % CI 56.61–75.95 | 56.61–75.95 | 5 | 6 / 15 |
| CPU | ||||
| CPU used | 1.51 cores 95 % CI 1.48–1.73 | 1.48–1.73 | 5 | — |
| User-space CPU share | 0.577 95 % CI 0.566–0.619 | 0.566–0.619 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 23.0 MiB 95 % CI 22.8–23.2 | 22.8–23.2 | 5 | 3 / 15 |
| Database | ||||
| Database CPU per request | 73.3 µs 95 % CI 57.5–75.9 | 57.5–75.9 | 5 | 8 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Start-up | ||||
| Cold vs. warm throughput | 0.91 95 % CI 0.84–0.96 | 0.84–0.96 | 5 | 11 / 15 |
| Energy | ||||
| CPU package energy | 454.5 J 95 % CI 442.1–566.8 | 442.1–566.8 | 5 | — |
| Package energy per request | 1.468 mJ 95 % CI 1.412–1.734 | 1.412–1.734 | 5 | 6 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.16 runnable tasks 95 % CI 3.08–5.90 | 3.08–5.90 | 5 | 3 / 15 |
| CPU clock | 3,073 MHz 95 % CI 2,760–3,518 | 2,760–3,518 | 5 | — |
| Load generator CPU | 0.37 95 % CI 0.27–0.40 | 0.27–0.40 | 5 | 9 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 100,704 req/s 95 % CI 99,205–105,749 | 99,205–105,749 | 5 | 8 / 15 |
| Latency p99 | 4.62 ms 95 % CI 4.29–4.82 | 4.29–4.82 | 5 | 11 / 15 |
| CPU per request | 15.8 µs 95 % CI 15.2–16.3 | 15.2–16.3 | 5 | 6 / 15 |
| Memory under load (PSS) | 51.0 MiB 95 % CI 46.3–56.9 | 46.3–56.9 | 5 | 4 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.12 ms 95 % CI 1.07–1.14 | 1.07–1.14 | 5 | 8 / 15 |
| Latency p90 | 1.97 ms 95 % CI 1.91–2.04 | 1.91–2.04 | 5 | 7 / 15 |
| Latency p99.9 | 7.39 ms 95 % CI 7.34–7.74 | 7.34–7.74 | 5 | 8 / 15 |
| Latency p75 | 1.55 ms 95 % CI 1.49–1.58 | 1.49–1.58 | 5 | 7 / 15 |
| Latency p99.99 | 9.71 ms 95 % CI 8.84–10.17 | 8.84–10.17 | 5 | 7 / 15 |
| Latency mean | 1.30 ms 95 % CI 1.24–1.33 | 1.24–1.33 | 5 | 8 / 15 |
| Latency std. dev. | 0.78 ms 95 % CI 0.74–0.82 | 0.74–0.82 | 5 | 7 / 15 |
| Latency max | 13.87 ms 95 % CI 12.97–14.81 | 12.97–14.81 | 5 | 6 / 15 |
| CPU | ||||
| CPU used | 1.59 cores 95 % CI 1.56–1.65 | 1.56–1.65 | 5 | — |
| User-space CPU share | 0.515 95 % CI 0.501–0.522 | 0.501–0.522 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 36.9 MiB 95 % CI 32.2–43.0 | 32.2–43.0 | 5 | 5 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 7 / 15 |
| Energy | ||||
| CPU package energy | 686.6 J 95 % CI 679.0–793.5 | 679.0–793.5 | 5 | — |
| Package energy per request | 0.456 mJ 95 % CI 0.443–0.516 | 0.443–0.516 | 5 | 6 / 15 |
| Network | ||||
| Bytes per response | 186 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.53 runnable tasks 95 % CI 4.27–5.94 | 4.27–5.94 | 5 | 11 / 15 |
| CPU clock | 3,347 MHz 95 % CI 3,112–3,538 | 3,112–3,538 | 5 | — |
| Load generator CPU | 0.62 95 % CI 0.61–0.62 | 0.61–0.62 | 5 | 10 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 35,025 req/s 95 % CI 33,600–35,938 | 33,600–35,938 | 5 | 8 / 15 |
| Latency p99 | 6.59 ms 95 % CI 6.16–7.78 | 6.16–7.78 | 5 | 6 / 15 |
| CPU per request | 47.6 µs 95 % CI 47.4–50.3 | 47.4–50.3 | 5 | 7 / 15 |
| Memory under load (PSS) | 45.2 MiB 95 % CI 43.5–50.4 | 43.5–50.4 | 5 | 4 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 3.44 ms 95 % CI 3.36–3.57 | 3.36–3.57 | 5 | 7 / 15 |
| Latency p90 | 4.58 ms 95 % CI 4.37–4.91 | 4.37–4.91 | 5 | 8 / 15 |
| Latency p99.9 | 10.45 ms 95 % CI 7.45–11.02 | 7.45–11.02 | 5 | 8 / 15 |
| Latency p75 | 3.96 ms 95 % CI 3.77–4.29 | 3.77–4.29 | 5 | 8 / 15 |
| Latency p99.99 | 12.63 ms 95 % CI 9.90–14.17 | 9.90–14.17 | 5 | 7 / 15 |
| Latency mean | 3.64 ms 95 % CI 3.54–3.81 | 3.54–3.81 | 5 | 8 / 15 |
| Latency std. dev. | 0.88 ms 95 % CI 0.73–1.06 | 0.73–1.06 | 5 | 7 / 15 |
| Latency max | 17.61 ms 95 % CI 14.21–22.59 | 14.21–22.59 | 5 | 7 / 15 |
| CPU | ||||
| CPU used | 1.69 cores 95 % CI 1.61–1.71 | 1.61–1.71 | 5 | — |
| User-space CPU share | 0.595 95 % CI 0.586–0.609 | 0.586–0.609 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 31.1 MiB 95 % CI 29.4–36.4 | 29.4–36.4 | 5 | 4 / 15 |
| Database | ||||
| Database CPU per request | 65.0 µs 95 % CI 62.0–68.8 | 62.0–68.8 | 5 | 8 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 737.5 J 95 % CI 707.0–811.8 | 707.0–811.8 | 5 | — |
| Package energy per request | 1.376 mJ 95 % CI 1.374–1.590 | 1.374–1.590 | 5 | 7 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.39 runnable tasks 95 % CI 4.88–6.66 | 4.88–6.66 | 5 | 7 / 15 |
| CPU clock | 3,587 MHz 95 % CI 3,328–3,663 | 3,328–3,663 | 5 | — |
| Load generator CPU | 0.41 95 % CI 0.35–0.43 | 0.35–0.43 | 5 | 8 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 3,453 req/s 95 % CI 3,284–3,642 | 3,284–3,642 | 5 | 13 / 15 |
| Latency p99 | 46.76 ms 95 % CI 43.96–50.23 | 43.96–50.23 | 5 | 8 / 15 |
| CPU per request | 450.2 µs 95 % CI 443.6–470.6 | 443.6–470.6 | 5 | 8 / 15 |
| Memory under load (PSS) | 51.6 MiB 95 % CI 50.2–54.4 | 50.2–54.4 | 5 | 4 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 36.06 ms 95 % CI 34.51–38.88 | 34.51–38.88 | 5 | 12 / 15 |
| Latency p90 | 42.75 ms 95 % CI 38.81–44.32 | 38.81–44.32 | 5 | 10 / 15 |
| Latency p99.9 | 50.52 ms 95 % CI 50.23–59.86 | 50.23–59.86 | 5 | 6 / 15 |
| Latency p75 | 40.00 ms 95 % CI 36.39–41.82 | 36.39–41.82 | 5 | 10 / 15 |
| Latency p99.99 | 55.27 ms 95 % CI 52.06–63.14 | 52.06–63.14 | 5 | 6 / 15 |
| Latency mean | 36.94 ms 95 % CI 35.04–38.86 | 35.04–38.86 | 5 | 13 / 15 |
| Latency std. dev. | 3.95 ms 95 % CI 2.90–4.40 | 2.90–4.40 | 5 | 9 / 15 |
| Latency max | 57.91 ms 95 % CI 53.86–65.35 | 53.86–65.35 | 5 | 7 / 15 |
| CPU | ||||
| CPU used | 1.57 cores 95 % CI 1.54–1.61 | 1.54–1.61 | 5 | — |
| User-space CPU share | 0.547 95 % CI 0.539–0.553 | 0.539–0.553 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 37.7 MiB 95 % CI 36.0–40.3 | 36.0–40.3 | 5 | 4 / 15 |
| Database | ||||
| Database CPU per request | 824.1 µs 95 % CI 823.9–831.5 | 823.9–831.5 | 5 | 11 / 15 |
| SELECTs per request | 20.05 queries 95 % CI 20.05–20.05 | 20.05–20.05 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 871.9 J 95 % CI 858.6–899.0 | 858.6–899.0 | 5 | — |
| Package energy per request | 16.586 mJ 95 % CI 16.050–18.213 | 16.050–18.213 | 5 | 11 / 15 |
| Network | ||||
| Bytes per response | 797 B 95 % CI 797–797 | 797–797 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.52 runnable tasks 95 % CI 5.09–7.18 | 5.09–7.18 | 5 | 11 / 15 |
| CPU clock | 3,310 MHz 95 % CI 3,097–3,513 | 3,097–3,513 | 5 | — |
| Load generator CPU | 0.04 95 % CI 0.04–0.05 | 0.04–0.05 | 5 | 5 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 6,115 req/s 95 % CI 5,913–6,318 | 5,913–6,318 | 5 | 12 / 15 |
| Latency p99 | 26.81 ms 95 % CI 24.60–28.77 | 24.60–28.77 | 5 | 9 / 15 |
| CPU per request | 252.2 µs 95 % CI 250.3–266.7 | 250.3–266.7 | 5 | 7 / 15 |
| Memory under load (PSS) | 52.4 MiB 95 % CI 48.4–52.8 | 48.4–52.8 | 5 | 4 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 20.69 ms 95 % CI 19.88–21.43 | 19.88–21.43 | 5 | 12 / 15 |
| Latency p90 | 23.99 ms 95 % CI 22.33–24.79 | 22.33–24.79 | 5 | 9 / 15 |
| Latency p99.9 | 29.07 ms 95 % CI 25.75–35.24 | 25.75–35.24 | 5 | 6 / 15 |
| Latency p75 | 22.17 ms 95 % CI 21.21–22.87 | 21.21–22.87 | 5 | 9 / 15 |
| Latency p99.99 | 32.43 ms 95 % CI 26.51–36.90 | 26.51–36.90 | 5 | 5 / 15 |
| Latency mean | 20.87 ms 95 % CI 20.19–21.58 | 20.19–21.58 | 5 | 12 / 15 |
| Latency std. dev. | 2.22 ms 95 % CI 1.60–2.49 | 1.60–2.49 | 5 | 8 / 15 |
| Latency max | 34.52 ms 95 % CI 28.84–39.54 | 28.84–39.54 | 5 | 5 / 15 |
| CPU | ||||
| CPU used | 1.57 cores 95 % CI 1.51–1.59 | 1.51–1.59 | 5 | — |
| User-space CPU share | 0.572 95 % CI 0.554–0.587 | 0.554–0.587 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 38.3 MiB 95 % CI 34.3–38.8 | 34.3–38.8 | 5 | 4 / 15 |
| Database | ||||
| Database CPU per request | 496.7 µs 95 % CI 495.4–500.6 | 495.4–500.6 | 5 | 10 / 15 |
| SELECTs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| UPDATEs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| Energy | ||||
| CPU package energy | 885.4 J 95 % CI 856.5–921.2 | 856.5–921.2 | 5 | — |
| Package energy per request | 9.451 mJ 95 % CI 9.347–10.359 | 9.347–10.359 | 5 | 9 / 15 |
| Network | ||||
| Bytes per response | 319 B 95 % CI 319–319 | 319–319 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.57 runnable tasks 95 % CI 5.89–7.31 | 5.89–7.31 | 5 | 7 / 15 |
| CPU clock | 3,402 MHz 95 % CI 3,103–3,506 | 3,103–3,506 | 5 | — |
| Load generator CPU | 0.07 95 % CI 0.06–0.07 | 0.06–0.07 | 5 | 5 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 20,129 req/s 95 % CI 19,189–20,184 | 19,189–20,184 | 5 | 7 / 15 |
| Latency p99 | 9.92 ms 95 % CI 9.90–11.51 | 9.90–11.51 | 5 | 6 / 15 |
| CPU per request | 89.1 µs 95 % CI 88.7–93.6 | 88.7–93.6 | 5 | 7 / 15 |
| Memory under load (PSS) | 61.9 MiB 95 % CI 58.6–64.2 | 58.6–64.2 | 5 | 4 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 6.08 ms 95 % CI 6.02–6.28 | 6.02–6.28 | 5 | 8 / 15 |
| Latency p90 | 7.88 ms 95 % CI 7.76–8.46 | 7.76–8.46 | 5 | 7 / 15 |
| Latency p99.9 | 12.40 ms 95 % CI 11.92–14.25 | 11.92–14.25 | 5 | 6 / 15 |
| Latency p75 | 6.76 ms 95 % CI 6.74–7.22 | 6.74–7.22 | 5 | 7 / 15 |
| Latency p99.99 | 14.24 ms 95 % CI 13.86–16.47 | 13.86–16.47 | 5 | 3 / 15 |
| Latency mean | 6.34 ms 95 % CI 6.31–6.64 | 6.31–6.64 | 5 | 7 / 15 |
| Latency std. dev. | 1.09 ms 95 % CI 1.05–1.37 | 1.05–1.37 | 5 | 7 / 15 |
| Latency max | 17.87 ms 95 % CI 15.72–19.45 | 15.72–19.45 | 5 | 6 / 15 |
| CPU | ||||
| CPU used | 1.79 cores 95 % CI 1.76–1.80 | 1.76–1.80 | 5 | — |
| User-space CPU share | 0.740 95 % CI 0.736–0.743 | 0.736–0.743 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 47.8 MiB 95 % CI 44.7–50.1 | 44.7–50.1 | 5 | 5 / 15 |
| Database | ||||
| Database CPU per request | 120.9 µs 95 % CI 120.5–123.7 | 120.5–123.7 | 5 | 7 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 806.7 J 95 % CI 792.0–839.6 | 792.0–839.6 | 5 | — |
| Package energy per request | 2.667 mJ 95 % CI 2.639–2.910 | 2.639–2.910 | 5 | 7 / 15 |
| Network | ||||
| Bytes per response | 4,797 B 95 % CI 4,797–4,797 | 4,797–4,797 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.07 runnable tasks 95 % CI 6.21–8.33 | 6.21–8.33 | 5 | 8 / 15 |
| CPU clock | 3,534 MHz 95 % CI 3,444–3,627 | 3,444–3,627 | 5 | — |
| Load generator CPU | 0.26 95 % CI 0.23–0.26 | 0.23–0.26 | 5 | 9 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 31,597 req/s 95 % CI 28,347–31,760 | 28,347–31,760 | 5 | 7 / 15 |
| Latency p99 | 8.13 ms 95 % CI 7.98–9.55 | 7.98–9.55 | 5 | 9 / 15 |
| CPU per request | 61.5 µs 95 % CI 61.1–68.5 | 61.1–68.5 | 5 | 7 / 15 |
| Memory under load (PSS) | 48.3 MiB 95 % CI 34.7–56.8 | 34.7–56.8 | 5 | 4 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 3.92 ms 95 % CI 3.86–4.26 | 3.86–4.26 | 5 | 7 / 15 |
| Latency p90 | 5.53 ms 95 % CI 5.41–6.54 | 5.41–6.54 | 5 | 7 / 15 |
| Latency p99.9 | 12.23 ms 95 % CI 11.67–12.90 | 11.67–12.90 | 5 | 8 / 15 |
| Latency p75 | 4.67 ms 95 % CI 4.66–5.25 | 4.66–5.25 | 5 | 7 / 15 |
| Latency p99.99 | 15.20 ms 95 % CI 14.01–18.23 | 14.01–18.23 | 5 | 8 / 15 |
| Latency mean | 3.97 ms 95 % CI 3.94–4.44 | 3.94–4.44 | 5 | 7 / 15 |
| Latency std. dev. | 1.33 ms 95 % CI 1.31–1.65 | 1.31–1.65 | 5 | 9 / 15 |
| Latency max | 16.63 ms 95 % CI 15.44–23.17 | 15.44–23.17 | 5 | 6 / 15 |
| CPU | ||||
| CPU used | 1.94 cores 95 % CI 1.92–1.94 | 1.92–1.94 | 5 | — |
| User-space CPU share | 0.844 95 % CI 0.839–0.848 | 0.839–0.848 | 5 | — |
| CPU throttling | 4.7 ms 95 % CI 0.4–10.1 | 0.4–10.1 | 5 | 5 / 15 |
| Memory | ||||
| Anonymous memory peak | 34.2 MiB 95 % CI 20.8–42.7 | 20.8–42.7 | 5 | 4 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 9 / 15 |
| Energy | ||||
| CPU package energy | 716.7 J 95 % CI 709.5–809.1 | 709.5–809.1 | 5 | — |
| Package energy per request | 1.509 mJ 95 % CI 1.500–1.899 | 1.500–1.899 | 5 | 7 / 15 |
| Network | ||||
| Bytes per response | 229 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.08 runnable tasks 95 % CI 6.14–7.54 | 6.14–7.54 | 5 | 9 / 15 |
| CPU clock | 3,800 MHz 95 % CI 3,598–3,800 | 3,598–3,800 | 5 | — |
| Load generator CPU | 0.36 95 % CI 0.31–0.38 | 0.31–0.38 | 5 | 9 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 32,416 req/s 95 % CI 30,765–32,763 | 30,765–32,763 | 5 | 8 / 15 |
| Latency p99 | 3.03 ms 95 % CI 1.77–3.84 | 1.77–3.84 | 5 | 10 / 15 |
| CPU per request | 48.6 µs 95 % CI 47.6–52.8 | 47.6–52.8 | 5 | 7 / 15 |
| Memory under load (PSS) | 40.2 MiB 95 % CI 38.9–49.7 | 38.9–49.7 | 5 | 4 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.47 ms 95 % CI 0.46–0.49 | 0.46–0.49 | 5 | 8 / 15 |
| Latency p90 | 0.66 ms 95 % CI 0.63–0.71 | 0.63–0.71 | 5 | 7 / 15 |
| Latency p99.9 | 6.33 ms 95 % CI 4.82–7.40 | 4.82–7.40 | 5 | 12 / 15 |
| Latency p75 | 0.54 ms 95 % CI 0.53–0.55 | 0.53–0.55 | 5 | 7 / 15 |
| Latency p99.99 | 9.79 ms 95 % CI 7.15–12.41 | 7.15–12.41 | 5 | 14 / 15 |
| Latency mean | 0.54 ms 95 % CI 0.50–0.60 | 0.50–0.60 | 5 | 9 / 15 |
| Latency std. dev. | 0.52 ms 95 % CI 0.33–0.66 | 0.33–0.66 | 5 | 11 / 15 |
| Latency max | 19.26 ms 95 % CI 9.48–21.15 | 9.48–21.15 | 5 | 14 / 15 |
| CPU | ||||
| CPU used | 1.54 cores 95 % CI 1.50–1.72 | 1.50–1.72 | 5 | — |
| User-space CPU share | 0.572 95 % CI 0.570–0.608 | 0.570–0.608 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 26.1 MiB 95 % CI 24.9–35.6 | 24.9–35.6 | 5 | 3 / 15 |
| Database | ||||
| Database CPU per request | 69.2 µs 95 % CI 55.5–73.9 | 55.5–73.9 | 5 | 8 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 698.6 J 95 % CI 675.5–883.7 | 675.5–883.7 | 5 | — |
| Package energy per request | 1.454 mJ 95 % CI 1.427–1.796 | 1.427–1.796 | 5 | 8 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.27 runnable tasks 95 % CI 5.61–7.25 | 5.61–7.25 | 5 | 7 / 15 |
| CPU clock | 3,194 MHz 95 % CI 2,891–3,604 | 2,891–3,604 | 5 | — |
| Load generator CPU | 0.39 95 % CI 0.24–0.40 | 0.24–0.40 | 5 | 9 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 32,465 req/s 95 % CI 31,243–33,784 | 31,243–33,784 | 5 | 8 / 15 |
| Latency p99 | 23.75 ms 95 % CI 21.67–25.37 | 21.67–25.37 | 5 | 8 / 15 |
| CPU per request | 51.7 µs 95 % CI 51.5–55.3 | 51.5–55.3 | 5 | 7 / 15 |
| Memory under load (PSS) | 97.2 MiB 95 % CI 95.9–97.7 | 95.9–97.7 | 5 | 5 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 14.76 ms 95 % CI 14.45–15.62 | 14.45–15.62 | 5 | 8 / 15 |
| Latency p90 | 19.69 ms 95 % CI 18.14–20.00 | 18.14–20.00 | 5 | 8 / 15 |
| Latency p99.9 | 32.93 ms 95 % CI 26.95–35.08 | 26.95–35.08 | 5 | 8 / 15 |
| Latency p75 | 16.63 ms 95 % CI 15.60–17.74 | 15.60–17.74 | 5 | 8 / 15 |
| Latency p99.99 | 34.42 ms 95 % CI 30.65–36.98 | 30.65–36.98 | 5 | 7 / 15 |
| Latency mean | 15.70 ms 95 % CI 15.09–16.30 | 15.09–16.30 | 5 | 8 / 15 |
| Latency std. dev. | 2.58 ms 95 % CI 2.18–2.72 | 2.18–2.72 | 5 | 8 / 15 |
| Latency max | 36.29 ms 95 % CI 32.59–38.79 | 32.59–38.79 | 5 | 6 / 15 |
| CPU | ||||
| CPU used | 1.69 cores 95 % CI 1.67–1.74 | 1.67–1.74 | 5 | — |
| User-space CPU share | 0.606 95 % CI 0.600–0.610 | 0.600–0.610 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 83.3 MiB 95 % CI 81.8–83.5 | 81.8–83.5 | 5 | 7 / 15 |
| Database | ||||
| Database CPU per request | 70.5 µs 95 % CI 66.9–70.9 | 66.9–70.9 | 5 | 8 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 719.7 J 95 % CI 712.3–799.3 | 712.3–799.3 | 5 | — |
| Package energy per request | 1.458 mJ 95 % CI 1.443–1.699 | 1.443–1.699 | 5 | 7 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.08 runnable tasks 95 % CI 5.77–7.26 | 5.77–7.26 | 5 | 11 / 15 |
| CPU clock | 3,450 MHz 95 % CI 3,297–3,490 | 3,297–3,490 | 5 | — |
| Load generator CPU | 0.39 95 % CI 0.32–0.40 | 0.32–0.40 | 5 | 8 / 15 |
Fixed rate
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,999 req/s 95 % CI 4,999–4,999 | 4,999–4,999 | 5 | 14 / 15 |
| Latency p99 | 1.78 ms 95 % CI 1.77–1.81 | 1.77–1.81 | 5 | 6 / 15 |
| CPU per request | 224.9 µs 95 % CI 170.5–228.7 | 170.5–228.7 | 5 | 9 / 15 |
| Memory under load (PSS) | 65.1 MiB 95 % CI 62.4–66.7 | 62.4–66.7 | 5 | 5 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.83 ms 95 % CI 0.58–0.86 | 0.58–0.86 | 5 | 9 / 15 |
| Latency p90 | 1.33 ms 95 % CI 1.03–1.36 | 1.03–1.36 | 5 | 9 / 15 |
| Latency p99.9 | 5.54 ms 95 % CI 4.80–5.94 | 4.80–5.94 | 5 | 7 / 15 |
| Latency p75 | 1.11 ms 95 % CI 0.80–1.13 | 0.80–1.13 | 5 | 10 / 15 |
| Latency p99.99 | 10.38 ms 95 % CI 7.42–12.27 | 7.42–12.27 | 5 | 4 / 15 |
| Latency mean | 0.91 ms 95 % CI 0.66–0.93 | 0.66–0.93 | 5 | 9 / 15 |
| Latency max | 11.33 ms 95 % CI 8.65–14.72 | 8.65–14.72 | 5 | 4 / 15 |
| CPU | ||||
| CPU used | 1.12 cores 95 % CI 0.85–1.14 | 0.85–1.14 | 5 | — |
| User-space CPU share | 0.684 95 % CI 0.665–0.718 | 0.665–0.718 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 51.0 MiB 95 % CI 48.1–52.6 | 48.1–52.6 | 5 | 5 / 15 |
| Database | ||||
| Database CPU per request | 152.4 µs 95 % CI 123.6–155.6 | 123.6–155.6 | 5 | 8 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 401.0 J 95 % CI 384.7–645.5 | 384.7–645.5 | 5 | — |
| Package energy per request | 4.010 mJ 95 % CI 3.847–6.456 | 3.847–6.456 | 5 | 7 / 15 |
| Network | ||||
| Bytes per response | 30 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.64 runnable tasks 95 % CI 6.45–7.85 | 6.45–7.85 | 5 | 12 / 15 |
| CPU clock | 1,262 MHz 95 % CI 1,250–2,269 | 1,250–2,269 | 5 | — |
| Load generator CPU | 0.14 95 % CI 0.10–0.14 | 0.10–0.14 | 5 | 7 / 15 |