Overall
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 59.2 | — | — | 5 / 15 |
| CPU efficiency index | 66.0 | — | — | 3 / 15 |
| Peak memory | 155.6 MiB | — | — | 9 / 15 |
ASP.NET Core minimal API on .NET 11 (STS) with the JIT, Npgsql and System.Text.Json source generation.
Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 59.2 | — | — | 5 / 15 |
| CPU efficiency index | 66.0 | — | — | 3 / 15 |
| Peak memory | 155.6 MiB | — | — | 9 / 15 |
Start-up
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Cold start | 496 ms 95 % CI 473–543 | 473–543 | 5 | 7 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Memory | ||||
| Memory at idle | 65.2 MiB 95 % CI 65.0–65.4 | 65.0–65.4 | 5 | 6 / 15 |
| Anonymous memory at idle | 9.1 MiB 95 % CI 9.0–9.1 | 9.0–9.1 | 5 | 6 / 15 |
| Start-up | ||||
| Cold start (fastest) | 470 ms 95 % CI 461–476 | 461–476 | 5 | 7 / 15 |
| Cold start (slowest) | 521 ms 95 % CI 506–552 | 506–552 | 5 | 8 / 15 |
| Footprint | ||||
| Image size | 392 MB | — | 5 | 12 / 15 |
Cold load
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 22,393 req/s 95 % CI 21,525–24,449 | 21,525–24,449 | 5 | 9 / 15 |
| Latency p99 | 137.07 ms 95 % CI 122.32–167.01 | 122.32–167.01 | 5 | 13 / 15 |
| CPU per request | 76.5 µs 95 % CI 68.6–82.1 | 68.6–82.1 | 5 | 8 / 15 |
| Memory under load (PSS) | 100.8 MiB 95 % CI 98.2–102.0 | 98.2–102.0 | 5 | 7 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 4.30 ms 95 % CI 3.86–4.44 | 3.86–4.44 | 5 | 8 / 15 |
| Latency p90 | 9.60 ms 95 % CI 9.24–11.18 | 9.24–11.18 | 5 | 10 / 15 |
| Latency p99.9 | 233.39 ms 95 % CI 219.45–266.11 | 219.45–266.11 | 5 | 13 / 15 |
| Latency p75 | 7.74 ms 95 % CI 7.26–8.31 | 7.26–8.31 | 5 | 10 / 15 |
| Latency p99.99 | 244.89 ms 95 % CI 232.81–280.48 | 232.81–280.48 | 5 | 13 / 15 |
| Latency mean | 8.26 ms 95 % CI 7.69–9.18 | 7.69–9.18 | 5 | 10 / 15 |
| Latency std. dev. | 20.58 ms 95 % CI 18.81–24.54 | 18.81–24.54 | 5 | 13 / 15 |
| Latency max | 249.04 ms 95 % CI 238.78–286.66 | 238.78–286.66 | 5 | 13 / 15 |
| CPU | ||||
| CPU used | 1.69 cores 95 % CI 1.67–1.76 | 1.67–1.76 | 5 | — |
| User-space CPU share | 0.724 95 % CI 0.687–0.735 | 0.687–0.735 | 5 | — |
| CPU throttling | 0.0 ms 95 % CI 0.0–1.9 | 0.0–1.9 | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 38.9 MiB 95 % CI 36.8–40.9 | 36.8–40.9 | 5 | 7 / 15 |
| Database | ||||
| Database CPU per request | 81.0 µs 95 % CI 65.1–86.5 | 65.1–86.5 | 5 | 9 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Start-up | ||||
| Cold vs. warm throughput | 0.63 95 % CI 0.61–0.68 | 0.61–0.68 | 5 | 13 / 15 |
| Energy | ||||
| CPU package energy | 455.1 J 95 % CI 452.2–540.4 | 452.2–540.4 | 5 | — |
| Package energy per request | 2.023 mJ 95 % CI 1.856–2.504 | 1.856–2.504 | 5 | 9 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.87 runnable tasks 95 % CI 3.93–5.20 | 3.93–5.20 | 5 | 11 / 15 |
| CPU clock | 3,350 MHz 95 % CI 3,130–3,480 | 3,130–3,480 | 5 | — |
| Load generator CPU | 0.28 95 % CI 0.20–0.30 | 0.20–0.30 | 5 | 8 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 116,063 req/s 95 % CI 110,265–119,541 | 110,265–119,541 | 5 | 5 / 15 |
| Latency p99 | 4.72 ms 95 % CI 4.58–5.03 | 4.58–5.03 | 5 | 12 / 15 |
| CPU per request | 13.8 µs 95 % CI 13.6–14.5 | 13.6–14.5 | 5 | 4 / 15 |
| Memory under load (PSS) | 114.5 MiB 95 % CI 114.0–115.8 | 114.0–115.8 | 5 | 8 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.97 ms 95 % CI 0.95–1.02 | 0.95–1.02 | 5 | 5 / 15 |
| Latency p90 | 1.81 ms 95 % CI 1.72–1.98 | 1.72–1.98 | 5 | 6 / 15 |
| Latency p99.9 | 8.01 ms 95 % CI 7.59–8.47 | 7.59–8.47 | 5 | 9 / 15 |
| Latency p75 | 1.34 ms 95 % CI 1.29–1.41 | 1.29–1.41 | 5 | 6 / 15 |
| Latency p99.99 | 10.20 ms 95 % CI 9.92–12.27 | 9.92–12.27 | 5 | 8 / 15 |
| Latency mean | 1.17 ms 95 % CI 1.13–1.23 | 1.13–1.23 | 5 | 5 / 15 |
| Latency std. dev. | 0.83 ms 95 % CI 0.79–0.88 | 0.79–0.88 | 5 | 8 / 15 |
| Latency max | 14.98 ms 95 % CI 12.44–18.60 | 12.44–18.60 | 5 | 8 / 15 |
| CPU | ||||
| CPU used | 1.60 cores 95 % CI 1.56–1.62 | 1.56–1.62 | 5 | — |
| User-space CPU share | 0.472 95 % CI 0.462–0.478 | 0.462–0.478 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 48.4 MiB 95 % CI 47.8–49.6 | 47.8–49.6 | 5 | 7 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 6 / 15 |
| Energy | ||||
| CPU package energy | 724.6 J 95 % CI 698.0–772.8 | 698.0–772.8 | 5 | — |
| Package energy per request | 0.413 mJ 95 % CI 0.409–0.464 | 0.409–0.464 | 5 | 5 / 15 |
| Network | ||||
| Bytes per response | 186 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.37 runnable tasks 95 % CI 5.08–7.52 | 5.08–7.52 | 5 | 8 / 15 |
| CPU clock | 3,404 MHz 95 % CI 3,317–3,637 | 3,317–3,637 | 5 | — |
| Load generator CPU | 0.62 95 % CI 0.62–0.62 | 0.62–0.62 | 5 | 11 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 35,760 req/s 95 % CI 34,487–36,578 | 34,487–36,578 | 5 | 7 / 15 |
| Latency p99 | 7.82 ms 95 % CI 7.24–8.33 | 7.24–8.33 | 5 | 9 / 15 |
| CPU per request | 42.0 µs 95 % CI 41.8–46.7 | 41.8–46.7 | 5 | 6 / 15 |
| Memory under load (PSS) | 110.7 MiB 95 % CI 106.8–112.8 | 106.8–112.8 | 5 | 8 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 3.54 ms 95 % CI 3.46–3.56 | 3.46–3.56 | 5 | 8 / 15 |
| Latency p90 | 4.43 ms 95 % CI 4.30–4.87 | 4.30–4.87 | 5 | 7 / 15 |
| Latency p99.9 | 10.68 ms 95 % CI 10.22–11.15 | 10.22–11.15 | 5 | 9 / 15 |
| Latency p75 | 3.79 ms 95 % CI 3.76–4.03 | 3.76–4.03 | 5 | 7 / 15 |
| Latency p99.99 | 13.78 ms 95 % CI 12.19–14.95 | 12.19–14.95 | 5 | 8 / 15 |
| Latency mean | 3.57 ms 95 % CI 3.50–3.70 | 3.50–3.70 | 5 | 7 / 15 |
| Latency std. dev. | 1.04 ms 95 % CI 1.02–1.10 | 1.02–1.10 | 5 | 10 / 15 |
| Latency max | 18.92 ms 95 % CI 16.36–21.33 | 16.36–21.33 | 5 | 8 / 15 |
| CPU | ||||
| CPU used | 1.51 cores 95 % CI 1.50–1.61 | 1.50–1.61 | 5 | — |
| User-space CPU share | 0.527 95 % CI 0.518–0.570 | 0.518–0.570 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 44.5 MiB 95 % CI 40.6–46.7 | 40.6–46.7 | 5 | 7 / 15 |
| Database | ||||
| Database CPU per request | 64.5 µs 95 % CI 61.8–65.3 | 61.8–65.3 | 5 | 7 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 702.5 J 95 % CI 700.1–815.1 | 700.1–815.1 | 5 | — |
| Package energy per request | 1.303 mJ 95 % CI 1.284–1.572 | 1.284–1.572 | 5 | 6 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.80 runnable tasks 95 % CI 5.25–6.71 | 5.25–6.71 | 5 | 11 / 15 |
| CPU clock | 3,020 MHz 95 % CI 2,763–3,523 | 2,763–3,523 | 5 | — |
| Load generator CPU | 0.42 95 % CI 0.31–0.44 | 0.31–0.44 | 5 | 9 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 3,735 req/s 95 % CI 3,505–3,810 | 3,505–3,810 | 5 | 9 / 15 |
| Latency p99 | 42.53 ms 95 % CI 39.94–49.28 | 39.94–49.28 | 5 | 6 / 15 |
| CPU per request | 379.8 µs 95 % CI 373.9–410.6 | 373.9–410.6 | 5 | 3 / 15 |
| Memory under load (PSS) | 113.9 MiB 95 % CI 112.0–117.3 | 112.0–117.3 | 5 | 8 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 33.64 ms 95 % CI 33.20–35.56 | 33.20–35.56 | 5 | 10 / 15 |
| Latency p90 | 37.65 ms 95 % CI 36.17–42.24 | 36.17–42.24 | 5 | 7 / 15 |
| Latency p99.9 | 53.27 ms 95 % CI 42.85–63.40 | 42.85–63.40 | 5 | 7 / 15 |
| Latency p75 | 35.90 ms 95 % CI 34.80–38.36 | 34.80–38.36 | 5 | 7 / 15 |
| Latency p99.99 | 55.51 ms 95 % CI 47.06–64.89 | 47.06–64.89 | 5 | 7 / 15 |
| Latency mean | 34.18 ms 95 % CI 33.49–36.42 | 33.49–36.42 | 5 | 7 / 15 |
| Latency std. dev. | 2.86 ms 95 % CI 2.27–4.14 | 2.27–4.14 | 5 | 6 / 15 |
| Latency max | 56.90 ms 95 % CI 50.23–68.33 | 50.23–68.33 | 5 | 6 / 15 |
| CPU | ||||
| CPU used | 1.42 cores 95 % CI 1.41–1.44 | 1.41–1.44 | 5 | — |
| User-space CPU share | 0.482 95 % CI 0.477–0.501 | 0.477–0.501 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 47.0 MiB 95 % CI 45.3–49.0 | 45.3–49.0 | 5 | 7 / 15 |
| Database | ||||
| Database CPU per request | 822.2 µs 95 % CI 820.2–830.7 | 820.2–830.7 | 5 | 10 / 15 |
| SELECTs per request | 20.04 queries 95 % CI 20.04–20.05 | 20.04–20.05 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 852.6 J 95 % CI 847.9–916.3 | 847.9–916.3 | 5 | — |
| Package energy per request | 15.167 mJ 95 % CI 14.942–17.398 | 14.942–17.398 | 5 | 7 / 15 |
| Network | ||||
| Bytes per response | 797 B 95 % CI 797–797 | 797–797 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.18 runnable tasks 95 % CI 6.15–7.84 | 6.15–7.84 | 5 | 9 / 15 |
| CPU clock | 2,890 MHz 95 % CI 2,790–3,187 | 2,790–3,187 | 5 | — |
| Load generator CPU | 0.05 95 % CI 0.03–0.05 | 0.03–0.05 | 5 | 8 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 6,506 req/s 95 % CI 6,231–6,629 | 6,231–6,629 | 5 | 10 / 15 |
| Latency p99 | 25.34 ms 95 % CI 25.08–28.06 | 25.08–28.06 | 5 | 7 / 15 |
| CPU per request | 218.7 µs 95 % CI 214.3–227.2 | 214.3–227.2 | 5 | 4 / 15 |
| Memory under load (PSS) | 108.4 MiB 95 % CI 107.7–116.8 | 107.7–116.8 | 5 | 7 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 19.14 ms 95 % CI 18.78–19.74 | 18.78–19.74 | 5 | 10 / 15 |
| Latency p90 | 22.07 ms 95 % CI 21.66–23.60 | 21.66–23.60 | 5 | 6 / 15 |
| Latency p99.9 | 30.48 ms 95 % CI 28.51–34.04 | 28.51–34.04 | 5 | 7 / 15 |
| Latency p75 | 20.64 ms 95 % CI 20.15–21.75 | 20.15–21.75 | 5 | 6 / 15 |
| Latency p99.99 | 33.22 ms 95 % CI 31.62–36.15 | 31.62–36.15 | 5 | 7 / 15 |
| Latency mean | 19.63 ms 95 % CI 19.25–20.48 | 19.25–20.48 | 5 | 8 / 15 |
| Latency std. dev. | 1.84 ms 95 % CI 1.76–2.40 | 1.76–2.40 | 5 | 7 / 15 |
| Latency max | 36.12 ms 95 % CI 34.88–41.47 | 34.88–41.47 | 5 | 6 / 15 |
| CPU | ||||
| CPU used | 1.42 cores 95 % CI 1.39–1.45 | 1.39–1.45 | 5 | — |
| User-space CPU share | 0.502 95 % CI 0.489–0.515 | 0.489–0.515 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 41.7 MiB 95 % CI 41.5–50.5 | 41.5–50.5 | 5 | 6 / 15 |
| Database | ||||
| Database CPU per request | 496.4 µs 95 % CI 478.5–502.7 | 478.5–502.7 | 5 | 9 / 15 |
| SELECTs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| UPDATEs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| Energy | ||||
| CPU package energy | 844.6 J 95 % CI 839.5–898.9 | 839.5–898.9 | 5 | — |
| Package energy per request | 8.743 mJ 95 % CI 8.426–9.592 | 8.426–9.592 | 5 | 8 / 15 |
| Network | ||||
| Bytes per response | 319 B 95 % CI 319–319 | 319–319 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.28 runnable tasks 95 % CI 6.04–8.78 | 6.04–8.78 | 5 | 9 / 15 |
| CPU clock | 2,696 MHz 95 % CI 2,677–3,025 | 2,677–3,025 | 5 | — |
| Load generator CPU | 0.08 95 % CI 0.06–0.08 | 0.06–0.08 | 5 | 6 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 23,901 req/s 95 % CI 21,824–24,375 | 21,824–24,375 | 5 | 4 / 15 |
| Latency p99 | 8.42 ms 95 % CI 8.31–10.52 | 8.31–10.52 | 5 | 5 / 15 |
| CPU per request | 74.4 µs 95 % CI 73.2–80.4 | 73.2–80.4 | 5 | 4 / 15 |
| Memory under load (PSS) | 122.0 MiB 95 % CI 116.7–125.4 | 116.7–125.4 | 5 | 8 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 5.14 ms 95 % CI 5.00–5.52 | 5.00–5.52 | 5 | 4 / 15 |
| Latency p90 | 6.58 ms 95 % CI 6.47–7.48 | 6.47–7.48 | 5 | 5 / 15 |
| Latency p99.9 | 11.60 ms 95 % CI 10.66–15.05 | 10.66–15.05 | 5 | 5 / 15 |
| Latency p75 | 5.75 ms 95 % CI 5.58–6.40 | 5.58–6.40 | 5 | 5 / 15 |
| Latency p99.99 | 15.80 ms 95 % CI 11.72–17.11 | 11.72–17.11 | 5 | 6 / 15 |
| Latency mean | 5.33 ms 95 % CI 5.23–5.85 | 5.23–5.85 | 5 | 4 / 15 |
| Latency std. dev. | 0.98 ms 95 % CI 0.90–1.31 | 0.90–1.31 | 5 | 5 / 15 |
| Latency max | 17.47 ms 95 % CI 15.58–19.61 | 15.58–19.61 | 5 | 5 / 15 |
| CPU | ||||
| CPU used | 1.78 cores 95 % CI 1.75–1.79 | 1.75–1.79 | 5 | — |
| User-space CPU share | 0.699 95 % CI 0.697–0.712 | 0.697–0.712 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 55.7 MiB 95 % CI 50.1–59.1 | 50.1–59.1 | 5 | 8 / 15 |
| Database | ||||
| Database CPU per request | 102.7 µs 95 % CI 101.4–110.2 | 101.4–110.2 | 5 | 4 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 852.6 J 95 % CI 831.1–866.2 | 831.1–866.2 | 5 | — |
| Package energy per request | 2.364 mJ 95 % CI 2.360–2.617 | 2.360–2.617 | 5 | 4 / 15 |
| Network | ||||
| Bytes per response | 4,797 B 95 % CI 4,797–4,797 | 4,797–4,797 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.91 runnable tasks 95 % CI 6.29–8.62 | 6.29–8.62 | 5 | 7 / 15 |
| CPU clock | 3,517 MHz 95 % CI 3,447–3,607 | 3,447–3,607 | 5 | — |
| Load generator CPU | 0.31 95 % CI 0.26–0.32 | 0.26–0.32 | 5 | 12 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 39,800 req/s 95 % CI 38,577–40,659 | 38,577–40,659 | 5 | 5 / 15 |
| Latency p99 | 7.13 ms 95 % CI 6.83–7.53 | 6.83–7.53 | 5 | 6 / 15 |
| CPU per request | 47.4 µs 95 % CI 46.7–49.3 | 46.7–49.3 | 5 | 3 / 15 |
| Memory under load (PSS) | 100.3 MiB 95 % CI 99.5–104.1 | 99.5–104.1 | 5 | 6 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 2.98 ms 95 % CI 2.94–3.08 | 2.94–3.08 | 5 | 5 / 15 |
| Latency p90 | 4.50 ms 95 % CI 4.32–4.67 | 4.32–4.67 | 5 | 5 / 15 |
| Latency p99.9 | 10.60 ms 95 % CI 10.40–11.25 | 10.40–11.25 | 5 | 7 / 15 |
| Latency p75 | 3.68 ms 95 % CI 3.60–3.82 | 3.60–3.82 | 5 | 5 / 15 |
| Latency p99.99 | 13.61 ms 95 % CI 12.70–15.12 | 12.70–15.12 | 5 | 6 / 15 |
| Latency mean | 3.13 ms 95 % CI 3.06–3.24 | 3.06–3.24 | 5 | 5 / 15 |
| Latency std. dev. | 1.21 ms 95 % CI 1.13–1.22 | 1.13–1.22 | 5 | 8 / 15 |
| Latency max | 18.78 ms 95 % CI 16.61–19.46 | 16.61–19.46 | 5 | 7 / 15 |
| CPU | ||||
| CPU used | 1.89 cores 95 % CI 1.87–1.90 | 1.87–1.90 | 5 | — |
| User-space CPU share | 0.803 95 % CI 0.798–0.807 | 0.798–0.807 | 5 | — |
| CPU throttling | 1.4 ms 95 % CI 0.0–2.1 | 0.0–2.1 | 5 | 3 / 15 |
| Memory | ||||
| Anonymous memory peak | 34.1 MiB 95 % CI 32.9–37.8 | 32.9–37.8 | 5 | 3 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 4 / 15 |
| Energy | ||||
| CPU package energy | 718.3 J 95 % CI 714.2–740.9 | 714.2–740.9 | 5 | — |
| Package energy per request | 1.196 mJ 95 % CI 1.174–1.278 | 1.174–1.278 | 5 | 5 / 15 |
| Network | ||||
| Bytes per response | 229 B 95 % CI 229–229 | 229–229 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.95 runnable tasks 95 % CI 6.51–7.76 | 6.51–7.76 | 5 | 8 / 15 |
| CPU clock | 3,710 MHz 95 % CI 3,653–3,721 | 3,653–3,721 | 5 | — |
| Load generator CPU | 0.46 95 % CI 0.44–0.47 | 0.44–0.47 | 5 | 12 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 37,072 req/s 95 % CI 35,786–39,777 | 35,786–39,777 | 5 | 6 / 15 |
| Latency p99 | 3.46 ms 95 % CI 2.60–4.40 | 2.60–4.40 | 5 | 12 / 15 |
| CPU per request | 40.8 µs 95 % CI 39.8–41.6 | 39.8–41.6 | 5 | 4 / 15 |
| Memory under load (PSS) | 106.0 MiB 95 % CI 98.8–111.8 | 98.8–111.8 | 5 | 8 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.40 ms 95 % CI 0.38–0.40 | 0.38–0.40 | 5 | 6 / 15 |
| Latency p90 | 0.59 ms 95 % CI 0.52–0.69 | 0.52–0.69 | 5 | 5 / 15 |
| Latency p99.9 | 6.58 ms 95 % CI 6.07–7.68 | 6.07–7.68 | 5 | 13 / 15 |
| Latency p75 | 0.45 ms 95 % CI 0.44–0.48 | 0.44–0.48 | 5 | 5 / 15 |
| Latency p99.99 | 9.66 ms 95 % CI 9.42–11.46 | 9.42–11.46 | 5 | 13 / 15 |
| Latency mean | 0.50 ms 95 % CI 0.44–0.57 | 0.44–0.57 | 5 | 6 / 15 |
| Latency std. dev. | 0.59 ms 95 % CI 0.45–0.75 | 0.45–0.75 | 5 | 12 / 15 |
| Latency max | 15.34 ms 95 % CI 15.16–16.71 | 15.16–16.71 | 5 | 13 / 15 |
| CPU | ||||
| CPU used | 1.51 cores 95 % CI 1.46–1.58 | 1.46–1.58 | 5 | — |
| User-space CPU share | 0.516 95 % CI 0.510–0.520 | 0.510–0.520 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 39.7 MiB 95 % CI 32.2–45.6 | 32.2–45.6 | 5 | 7 / 15 |
| Database | ||||
| Database CPU per request | 61.2 µs 95 % CI 57.2–63.3 | 57.2–63.3 | 5 | 6 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 726.3 J 95 % CI 683.8–745.1 | 683.8–745.1 | 5 | — |
| Package energy per request | 1.262 mJ 95 % CI 1.238–1.379 | 1.238–1.379 | 5 | 5 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.31 runnable tasks 95 % CI 5.92–7.74 | 5.92–7.74 | 5 | 8 / 15 |
| CPU clock | 3,116 MHz 95 % CI 2,773–3,327 | 2,773–3,327 | 5 | — |
| Load generator CPU | 0.44 95 % CI 0.36–0.48 | 0.36–0.48 | 5 | 11 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 35,200 req/s 95 % CI 32,874–37,690 | 32,874–37,690 | 5 | 6 / 15 |
| Latency p99 | 22.69 ms 95 % CI 18.60–24.06 | 18.60–24.06 | 5 | 7 / 15 |
| CPU per request | 46.6 µs 95 % CI 45.2–47.8 | 45.2–47.8 | 5 | 6 / 15 |
| Memory under load (PSS) | 155.6 MiB 95 % CI 152.8–168.0 | 152.8–168.0 | 5 | 9 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 13.73 ms 95 % CI 13.16–15.50 | 13.16–15.50 | 5 | 6 / 15 |
| Latency p90 | 17.68 ms 95 % CI 15.63–18.43 | 15.63–18.43 | 5 | 7 / 15 |
| Latency p99.9 | 29.43 ms 95 % CI 26.48–30.45 | 26.48–30.45 | 5 | 6 / 15 |
| Latency p75 | 15.62 ms 95 % CI 14.15–16.97 | 14.15–16.97 | 5 | 6 / 15 |
| Latency p99.99 | 33.63 ms 95 % CI 28.62–35.66 | 28.62–35.66 | 5 | 6 / 15 |
| Latency mean | 14.47 ms 95 % CI 13.52–15.48 | 13.52–15.48 | 5 | 6 / 15 |
| Latency std. dev. | 2.57 ms 95 % CI 1.63–2.64 | 1.63–2.64 | 5 | 7 / 15 |
| Latency max | 36.48 ms 95 % CI 30.86–42.51 | 30.86–42.51 | 5 | 7 / 15 |
| CPU | ||||
| CPU used | 1.68 cores 95 % CI 1.53–1.72 | 1.53–1.72 | 5 | — |
| User-space CPU share | 0.565 95 % CI 0.549–0.579 | 0.549–0.579 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 89.4 MiB 95 % CI 86.4–101.7 | 86.4–101.7 | 5 | 8 / 15 |
| Database | ||||
| Database CPU per request | 62.7 µs 95 % CI 61.5–69.9 | 61.5–69.9 | 5 | 6 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 746.3 J 95 % CI 691.1–786.8 | 691.1–786.8 | 5 | — |
| Package energy per request | 1.377 mJ 95 % CI 1.334–1.485 | 1.334–1.485 | 5 | 6 / 15 |
| Network | ||||
| Bytes per response | 190 B 95 % CI 190–190 | 190–190 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.51 runnable tasks 95 % CI 6.10–7.47 | 6.10–7.47 | 5 | 10 / 15 |
| CPU clock | 3,393 MHz 95 % CI 2,930–3,537 | 2,930–3,537 | 5 | — |
| Load generator CPU | 0.41 95 % CI 0.38–0.45 | 0.38–0.45 | 5 | 10 / 15 |
Fixed rate
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,999 req/s 95 % CI 4,999–4,999 | 4,999–4,999 | 5 | 3 / 15 |
| Latency p99 | 1.70 ms 95 % CI 1.58–1.88 | 1.58–1.88 | 5 | 5 / 15 |
| CPU per request | 213.9 µs 95 % CI 191.2–216.7 | 191.2–216.7 | 5 | 7 / 15 |
| Memory under load (PSS) | 129.4 MiB 95 % CI 126.9–131.7 | 126.9–131.7 | 5 | 7 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.78 ms 95 % CI 0.70–0.78 | 0.70–0.78 | 5 | 8 / 15 |
| Latency p90 | 1.19 ms 95 % CI 1.17–1.21 | 1.17–1.21 | 5 | 8 / 15 |
| Latency p99.9 | 5.94 ms 95 % CI 5.25–6.59 | 5.25–6.59 | 5 | 9 / 15 |
| Latency p75 | 0.99 ms 95 % CI 0.92–0.99 | 0.92–0.99 | 5 | 8 / 15 |
| Latency p99.99 | 10.93 ms 95 % CI 10.42–13.32 | 10.42–13.32 | 5 | 7 / 15 |
| Latency mean | 0.83 ms 95 % CI 0.77–0.84 | 0.77–0.84 | 5 | 6 / 15 |
| Latency max | 13.34 ms 95 % CI 11.83–13.94 | 11.83–13.94 | 5 | 6 / 15 |
| CPU | ||||
| CPU used | 1.07 cores 95 % CI 0.95–1.08 | 0.95–1.08 | 5 | — |
| User-space CPU share | 0.695 95 % CI 0.657–0.709 | 0.657–0.709 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 63.0 MiB 95 % CI 60.7–65.4 | 60.7–65.4 | 5 | 7 / 15 |
| Database | ||||
| Database CPU per request | 155.9 µs 95 % CI 140.9–157.9 | 140.9–157.9 | 5 | 11 / 15 |
| SELECTs per request | 1.00 queries | — | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 394.4 J 95 % CI 382.9–524.8 | 382.9–524.8 | 5 | — |
| Package energy per request | 3.945 mJ 95 % CI 3.829–5.248 | 3.829–5.248 | 5 | 5 / 15 |
| Network | ||||
| Bytes per response | 30 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.96 runnable tasks 95 % CI 6.76–7.33 | 6.76–7.33 | 5 | 10 / 15 |
| CPU clock | 1,237 MHz 95 % CI 1,207–1,952 | 1,207–1,952 | 5 | — |
| Load generator CPU | 0.14 95 % CI 0.12–0.14 | 0.12–0.14 | 5 | 9 / 15 |