Overall
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 55.3 | — | — | 7 / 15 |
| CPU efficiency index | 57.7 | — | — | 6 / 15 |
| Peak memory | 41.9 MiB | — | — | 2 / 15 |
Go standard library HTTP server (method routing since Go 1.22) with the pgx connection pool.
Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 55.3 | — | — | 7 / 15 |
| CPU efficiency index | 57.7 | — | — | 6 / 15 |
| Peak memory | 41.9 MiB | — | — | 2 / 15 |
Start-up
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Cold start | 170 ms 95 % CI 166–279 | 166–279 | 5 | 1 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Memory | ||||
| Memory at idle | 8.7 MiB 95 % CI 8.5–8.7 | 8.5–8.7 | 5 | 2 / 15 |
| Anonymous memory at idle | 1.1 MiB 95 % CI 1.0–1.2 | 1.0–1.2 | 5 | 2 / 15 |
| Start-up | ||||
| Cold start (fastest) | 166 ms 95 % CI 146–251 | 146–251 | 5 | 1 / 15 |
| Cold start (slowest) | 182 ms 95 % CI 172–280 | 172–280 | 5 | 1 / 15 |
| Footprint | ||||
| Image size | 22 MB | — | 5 | 1 / 15 |
Cold load
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 41,792 req/s 95 % CI 37,109–42,304 | 37,109–42,304 | 5 | 4 / 15 |
| Latency p99 | 7.14 ms 95 % CI 7.00–8.01 | 7.00–8.01 | 5 | 4 / 15 |
| CPU per request | 40.7 µs 95 % CI 40.4–43.7 | 40.4–43.7 | 5 | 3 / 15 |
| Memory under load (PSS) | 22.0 MiB 95 % CI 21.7–22.1 | 21.7–22.1 | 5 | 2 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 2.66 ms 95 % CI 2.61–3.14 | 2.61–3.14 | 5 | 5 / 15 |
| Latency p90 | 4.21 ms 95 % CI 4.16–5.05 | 4.16–5.05 | 5 | 5 / 15 |
| Latency p99.9 | 40.79 ms 95 % CI 31.78–46.89 | 31.78–46.89 | 5 | 5 / 15 |
| Latency p75 | 3.71 ms 95 % CI 3.68–4.01 | 3.68–4.01 | 5 | 5 / 15 |
| Latency p99.99 | 54.76 ms 95 % CI 49.96–60.84 | 49.96–60.84 | 5 | 5 / 15 |
| Latency mean | 3.16 ms 95 % CI 3.07–3.55 | 3.07–3.55 | 5 | 4 / 15 |
| Latency std. dev. | 2.18 ms 95 % CI 1.76–2.49 | 1.76–2.49 | 5 | 4 / 15 |
| Latency max | 64.78 ms 95 % CI 64.32–68.53 | 64.32–68.53 | 5 | 5 / 15 |
| CPU | ||||
| CPU used | 1.69 cores 95 % CI 1.62–1.71 | 1.62–1.71 | 5 | — |
| User-space CPU share | 0.564 95 % CI 0.559–0.572 | 0.559–0.572 | 5 | — |
| CPU throttling | 0.0 ms 95 % CI 0.0–0.4 | 0.0–0.4 | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 12.7 MiB 95 % CI 12.5–12.8 | 12.5–12.8 | 5 | 2 / 15 |
| Database | ||||
| Database CPU per request | 55.4 µs 95 % CI 53.8–55.7 | 53.8–55.7 | 5 | 4 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Start-up | ||||
| Cold vs. warm throughput | 1.01 95 % CI 0.89–1.04 | 0.89–1.04 | 5 | 4 / 15 |
| Energy | ||||
| CPU package energy | 505.5 J 95 % CI 498.5–543.3 | 498.5–543.3 | 5 | — |
| Package energy per request | 1.191 mJ 95 % CI 1.183–1.460 | 1.183–1.460 | 5 | 4 / 15 |
| Network | ||||
| Bytes per response | 140 B 95 % CI 140–140 | 140–140 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.37 runnable tasks 95 % CI 3.19–6.48 | 3.19–6.48 | 5 | 8 / 15 |
| CPU clock | 3,337 MHz 95 % CI 3,300–3,420 | 3,300–3,420 | 5 | — |
| Load generator CPU | 0.46 95 % CI 0.34–0.46 | 0.34–0.46 | 5 | 12 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 111,930 req/s 95 % CI 105,894–113,206 | 105,894–113,206 | 5 | 6 / 15 |
| Latency p99 | 3.64 ms 95 % CI 3.55–3.94 | 3.55–3.94 | 5 | 6 / 15 |
| CPU per request | 17.8 µs 95 % CI 17.5–18.8 | 17.5–18.8 | 5 | 7 / 15 |
| Memory under load (PSS) | 23.5 MiB 95 % CI 23.2–23.9 | 23.2–23.9 | 5 | 2 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.11 ms 95 % CI 1.10–1.17 | 1.10–1.17 | 5 | 6 / 15 |
| Latency p90 | 2.37 ms 95 % CI 2.33–2.51 | 2.33–2.51 | 5 | 8 / 15 |
| Latency p99.9 | 4.91 ms 95 % CI 4.78–5.23 | 4.78–5.23 | 5 | 7 / 15 |
| Latency p75 | 1.71 ms 95 % CI 1.69–1.82 | 1.69–1.82 | 5 | 8 / 15 |
| Latency p99.99 | 6.55 ms 95 % CI 6.34–7.75 | 6.34–7.75 | 5 | 5 / 15 |
| Latency mean | 1.20 ms 95 % CI 1.18–1.27 | 1.18–1.27 | 5 | 7 / 15 |
| Latency std. dev. | 0.85 ms 95 % CI 0.83–0.91 | 0.83–0.91 | 5 | 9 / 15 |
| Latency max | 8.60 ms 95 % CI 7.99–10.66 | 7.99–10.66 | 5 | 4 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.98–1.99 | 1.98–1.99 | 5 | — |
| User-space CPU share | 0.610 95 % CI 0.604–0.618 | 0.604–0.618 | 5 | — |
| CPU throttling | 8.7 ms 95 % CI 7.6–37.9 | 7.6–37.9 | 5 | 10 / 15 |
| Memory | ||||
| Anonymous memory peak | 14.0 MiB 95 % CI 13.8–14.3 | 13.8–14.3 | 5 | 2 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 4 / 15 |
| Energy | ||||
| CPU package energy | 810.7 J 95 % CI 794.8–816.4 | 794.8–816.4 | 5 | — |
| Package energy per request | 0.478 mJ 95 % CI 0.476–0.513 | 0.476–0.513 | 5 | 8 / 15 |
| Network | ||||
| Bytes per response | 136 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.33 runnable tasks 95 % CI 4.13–6.27 | 4.13–6.27 | 5 | 7 / 15 |
| CPU clock | 3,706 MHz 95 % CI 3,660–3,800 | 3,660–3,800 | 5 | — |
| Load generator CPU | 0.55 95 % CI 0.55–0.56 | 0.55–0.56 | 5 | 6 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 41,772 req/s 95 % CI 40,549–41,955 | 40,549–41,955 | 5 | 5 / 15 |
| Latency p99 | 6.75 ms 95 % CI 6.71–7.06 | 6.71–7.06 | 5 | 7 / 15 |
| CPU per request | 41.1 µs 95 % CI 40.7–41.7 | 40.7–41.7 | 5 | 4 / 15 |
| Memory under load (PSS) | 24.4 MiB 95 % CI 24.3–24.6 | 24.3–24.6 | 5 | 2 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 2.66 ms 95 % CI 2.64–2.74 | 2.64–2.74 | 5 | 5 / 15 |
| Latency p90 | 4.32 ms 95 % CI 4.24–4.45 | 4.24–4.45 | 5 | 6 / 15 |
| Latency p99.9 | 9.09 ms 95 % CI 8.43–9.83 | 8.43–9.83 | 5 | 6 / 15 |
| Latency p75 | 3.72 ms 95 % CI 3.63–3.82 | 3.63–3.82 | 5 | 6 / 15 |
| Latency p99.99 | 11.33 ms 95 % CI 10.27–15.89 | 10.27–15.89 | 5 | 5 / 15 |
| Latency mean | 3.06 ms 95 % CI 3.05–3.15 | 3.05–3.15 | 5 | 5 / 15 |
| Latency std. dev. | 1.01 ms 95 % CI 0.98–1.10 | 0.98–1.10 | 5 | 8 / 15 |
| Latency max | 13.62 ms 95 % CI 12.18–16.72 | 12.18–16.72 | 5 | 5 / 15 |
| CPU | ||||
| CPU used | 1.70 cores 95 % CI 1.68–1.74 | 1.68–1.74 | 5 | — |
| User-space CPU share | 0.567 95 % CI 0.565–0.570 | 0.565–0.570 | 5 | — |
| CPU throttling | 0.0 ms 95 % CI 0.0–0.6 | 0.0–0.6 | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 14.9 MiB 95 % CI 14.8–15.0 | 14.8–15.0 | 5 | 2 / 15 |
| Database | ||||
| Database CPU per request | 56.4 µs 95 % CI 54.6–57.1 | 54.6–57.1 | 5 | 6 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 758.7 J 95 % CI 743.1–795.8 | 743.1–795.8 | 5 | — |
| Package energy per request | 1.203 mJ 95 % CI 1.200–1.268 | 1.200–1.268 | 5 | 5 / 15 |
| Network | ||||
| Bytes per response | 140 B 95 % CI 140–140 | 140–140 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.27 runnable tasks 95 % CI 4.37–6.02 | 4.37–6.02 | 5 | 6 / 15 |
| CPU clock | 3,340 MHz 95 % CI 3,243–3,490 | 3,243–3,490 | 5 | — |
| Load generator CPU | 0.45 95 % CI 0.41–0.46 | 0.41–0.46 | 5 | 11 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 3,588 req/s 95 % CI 3,461–3,614 | 3,461–3,614 | 5 | 10 / 15 |
| Latency p99 | 50.76 ms 95 % CI 49.49–52.63 | 49.49–52.63 | 5 | 9 / 15 |
| CPU per request | 391.4 µs 95 % CI 389.5–402.6 | 389.5–402.6 | 5 | 4 / 15 |
| Memory under load (PSS) | 24.4 MiB 95 % CI 24.0–24.5 | 24.0–24.5 | 5 | 2 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 34.68 ms 95 % CI 34.53–35.54 | 34.53–35.54 | 5 | 11 / 15 |
| Latency p90 | 40.78 ms 95 % CI 40.07–44.40 | 40.07–44.40 | 5 | 9 / 15 |
| Latency p99.9 | 65.98 ms 95 % CI 64.99–68.61 | 64.99–68.61 | 5 | 10 / 15 |
| Latency p75 | 37.11 ms 95 % CI 36.88–39.04 | 36.88–39.04 | 5 | 8 / 15 |
| Latency p99.99 | 80.62 ms 95 % CI 77.39–90.04 | 77.39–90.04 | 5 | 11 / 15 |
| Latency mean | 35.56 ms 95 % CI 35.31–36.85 | 35.31–36.85 | 5 | 10 / 15 |
| Latency std. dev. | 4.35 ms 95 % CI 4.08–5.24 | 4.08–5.24 | 5 | 10 / 15 |
| Latency max | 84.05 ms 95 % CI 81.86–92.67 | 81.86–92.67 | 5 | 11 / 15 |
| CPU | ||||
| CPU used | 1.40 cores 95 % CI 1.39–1.41 | 1.39–1.41 | 5 | — |
| User-space CPU share | 0.504 95 % CI 0.502–0.514 | 0.502–0.514 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 14.9 MiB 95 % CI 14.6–15.0 | 14.6–15.0 | 5 | 2 / 15 |
| Database | ||||
| Database CPU per request | 798.1 µs 95 % CI 794.1–806.5 | 794.1–806.5 | 5 | 3 / 15 |
| SELECTs per request | 20.04 queries 95 % CI 20.04–20.05 | 20.04–20.05 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 806.9 J 95 % CI 802.8–836.9 | 802.8–836.9 | 5 | — |
| Package energy per request | 14.880 mJ 95 % CI 14.862–16.071 | 14.862–16.071 | 5 | 6 / 15 |
| Network | ||||
| Bytes per response | 747 B 95 % CI 747–747 | 747–747 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.53 runnable tasks 95 % CI 5.12–6.54 | 5.12–6.54 | 5 | 6 / 15 |
| CPU clock | 2,798 MHz 95 % CI 2,773–2,853 | 2,773–2,853 | 5 | — |
| Load generator CPU | 0.04 95 % CI 0.04–0.04 | 0.04–0.04 | 5 | 4 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 6,222 req/s 95 % CI 6,144–6,276 | 6,144–6,276 | 5 | 11 / 15 |
| Latency p99 | 29.99 ms 95 % CI 29.02–30.64 | 29.02–30.64 | 5 | 11 / 15 |
| CPU per request | 218.6 µs 95 % CI 217.4–221.9 | 217.4–221.9 | 5 | 3 / 15 |
| Memory under load (PSS) | 23.6 MiB 95 % CI 22.8–24.0 | 22.8–24.0 | 5 | 2 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 19.84 ms 95 % CI 19.74–20.08 | 19.74–20.08 | 5 | 11 / 15 |
| Latency p90 | 24.43 ms 95 % CI 24.06–24.78 | 24.06–24.78 | 5 | 10 / 15 |
| Latency p99.9 | 35.02 ms 95 % CI 33.85–38.18 | 33.85–38.18 | 5 | 9 / 15 |
| Latency p75 | 21.85 ms 95 % CI 21.62–22.14 | 21.62–22.14 | 5 | 8 / 15 |
| Latency p99.99 | 38.36 ms 95 % CI 36.24–43.58 | 36.24–43.58 | 5 | 8 / 15 |
| Latency mean | 20.52 ms 95 % CI 20.34–20.77 | 20.34–20.77 | 5 | 9 / 15 |
| Latency std. dev. | 2.87 ms 95 % CI 2.77–3.02 | 2.77–3.02 | 5 | 9 / 15 |
| Latency max | 41.58 ms 95 % CI 39.15–50.85 | 39.15–50.85 | 5 | 8 / 15 |
| CPU | ||||
| CPU used | 1.36 cores 95 % CI 1.34–1.37 | 1.34–1.37 | 5 | — |
| User-space CPU share | 0.507 95 % CI 0.502–0.512 | 0.502–0.512 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 14.1 MiB 95 % CI 13.3–14.5 | 13.3–14.5 | 5 | 2 / 15 |
| Database | ||||
| Database CPU per request | 479.8 µs 95 % CI 478.9–482.5 | 478.9–482.5 | 5 | 3 / 15 |
| SELECTs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| UPDATEs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| Energy | ||||
| CPU package energy | 816.8 J 95 % CI 805.7–842.5 | 805.7–842.5 | 5 | — |
| Package energy per request | 8.712 mJ 95 % CI 8.660–9.122 | 8.660–9.122 | 5 | 6 / 15 |
| Network | ||||
| Bytes per response | 270 B 95 % CI 270–270 | 270–270 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.03 runnable tasks 95 % CI 4.99–6.90 | 4.99–6.90 | 5 | 6 / 15 |
| CPU clock | 2,820 MHz 95 % CI 2,708–3,049 | 2,708–3,049 | 5 | — |
| Load generator CPU | 0.07 95 % CI 0.06–0.07 | 0.06–0.07 | 5 | 4 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 21,798 req/s 95 % CI 19,903–22,048 | 19,903–22,048 | 5 | 6 / 15 |
| Latency p99 | 10.72 ms 95 % CI 10.59–12.30 | 10.59–12.30 | 5 | 7 / 15 |
| CPU per request | 86.2 µs 95 % CI 85.6–94.3 | 85.6–94.3 | 5 | 6 / 15 |
| Memory under load (PSS) | 24.1 MiB 95 % CI 23.7–24.8 | 23.7–24.8 | 5 | 2 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 5.22 ms 95 % CI 5.17–6.03 | 5.17–6.03 | 5 | 6 / 15 |
| Latency p90 | 7.68 ms 95 % CI 7.62–8.74 | 7.62–8.74 | 5 | 6 / 15 |
| Latency p99.9 | 13.49 ms 95 % CI 13.01–16.38 | 13.01–16.38 | 5 | 7 / 15 |
| Latency p75 | 6.75 ms 95 % CI 6.69–7.29 | 6.69–7.29 | 5 | 6 / 15 |
| Latency p99.99 | 15.80 ms 95 % CI 14.67–18.55 | 14.67–18.55 | 5 | 7 / 15 |
| Latency mean | 5.84 ms 95 % CI 5.79–6.43 | 5.79–6.43 | 5 | 6 / 15 |
| Latency std. dev. | 1.49 ms 95 % CI 1.43–1.80 | 1.43–1.80 | 5 | 8 / 15 |
| Latency max | 19.03 ms 95 % CI 17.47–20.85 | 17.47–20.85 | 5 | 7 / 15 |
| CPU | ||||
| CPU used | 1.88 cores 95 % CI 1.87–1.89 | 1.87–1.89 | 5 | — |
| User-space CPU share | 0.723 95 % CI 0.718–0.734 | 0.718–0.734 | 5 | — |
| CPU throttling | 2.3 ms 95 % CI 1.1–6.1 | 1.1–6.1 | 5 | 7 / 15 |
| Memory | ||||
| Anonymous memory peak | 14.6 MiB 95 % CI 14.1–15.3 | 14.1–15.3 | 5 | 2 / 15 |
| Database | ||||
| Database CPU per request | 112.5 µs 95 % CI 110.7–118.4 | 110.7–118.4 | 5 | 6 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 834.7 J 95 % CI 823.0–862.6 | 823.0–862.6 | 5 | — |
| Package energy per request | 2.526 mJ 95 % CI 2.505–2.885 | 2.505–2.885 | 5 | 6 / 15 |
| Network | ||||
| Bytes per response | 4,760 B 95 % CI 4,760–4,760 | 4,760–4,760 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.31 runnable tasks 95 % CI 5.40–7.47 | 5.40–7.47 | 5 | 5 / 15 |
| CPU clock | 3,550 MHz 95 % CI 3,528–3,620 | 3,528–3,620 | 5 | — |
| Load generator CPU | 0.30 95 % CI 0.23–0.30 | 0.23–0.30 | 5 | 10 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 28,170 req/s 95 % CI 26,954–28,865 | 26,954–28,865 | 5 | 8 / 15 |
| Latency p99 | 12.21 ms 95 % CI 12.01–13.41 | 12.01–13.41 | 5 | 12 / 15 |
| CPU per request | 70.3 µs 95 % CI 68.6–73.5 | 68.6–73.5 | 5 | 8 / 15 |
| Memory under load (PSS) | 24.3 MiB 95 % CI 23.6–25.3 | 23.6–25.3 | 5 | 2 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 4.59 ms 95 % CI 4.46–4.79 | 4.46–4.79 | 5 | 8 / 15 |
| Latency p90 | 9.04 ms 95 % CI 8.87–9.43 | 8.87–9.43 | 5 | 11 / 15 |
| Latency p99.9 | 14.85 ms 95 % CI 13.96–18.25 | 13.96–18.25 | 5 | 10 / 15 |
| Latency p75 | 6.89 ms 95 % CI 6.72–7.21 | 6.72–7.21 | 5 | 11 / 15 |
| Latency p99.99 | 18.39 ms 95 % CI 16.74–23.01 | 16.74–23.01 | 5 | 10 / 15 |
| Latency mean | 4.67 ms 95 % CI 4.56–4.90 | 4.56–4.90 | 5 | 8 / 15 |
| Latency std. dev. | 3.15 ms 95 % CI 3.11–3.38 | 3.11–3.38 | 5 | 13 / 15 |
| Latency max | 27.20 ms 95 % CI 23.42–33.24 | 23.42–33.24 | 5 | 9 / 15 |
| CPU | ||||
| CPU used | 1.98 cores 95 % CI 1.98–1.98 | 1.98–1.98 | 5 | — |
| User-space CPU share | 0.864 95 % CI 0.862–0.867 | 0.862–0.867 | 5 | — |
| CPU throttling | 14.8 ms 95 % CI 12.6–20.7 | 12.6–20.7 | 5 | 10 / 15 |
| Memory | ||||
| Anonymous memory peak | 14.8 MiB 95 % CI 14.1–15.8 | 14.1–15.8 | 5 | 2 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–0.1 | < 0.1–0.1 | 5 | 6 / 15 |
| Energy | ||||
| CPU package energy | 719.2 J 95 % CI 701.8–752.2 | 701.8–752.2 | 5 | — |
| Package energy per request | 1.668 mJ 95 % CI 1.650–1.848 | 1.650–1.848 | 5 | 8 / 15 |
| Network | ||||
| Bytes per response | 179 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.69 runnable tasks 95 % CI 5.32–8.39 | 5.32–8.39 | 5 | 6 / 15 |
| CPU clock | 3,725 MHz 95 % CI 3,647–3,800 | 3,647–3,800 | 5 | — |
| Load generator CPU | 0.32 95 % CI 0.29–0.32 | 0.29–0.32 | 5 | 6 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 35,572 req/s 95 % CI 35,284–35,901 | 35,284–35,901 | 5 | 7 / 15 |
| Latency p99 | 3.58 ms 95 % CI 3.55–3.60 | 3.55–3.60 | 5 | 13 / 15 |
| CPU per request | 42.4 µs 95 % CI 42.2–43.6 | 42.2–43.6 | 5 | 6 / 15 |
| Memory under load (PSS) | 20.4 MiB 95 % CI 20.3–21.0 | 20.3–21.0 | 5 | 2 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.37 ms 95 % CI 0.37–0.38 | 0.37–0.38 | 5 | 5 / 15 |
| Latency p90 | 1.13 ms 95 % CI 1.08–1.15 | 1.08–1.15 | 5 | 12 / 15 |
| Latency p99.9 | 5.97 ms 95 % CI 5.91–6.29 | 5.91–6.29 | 5 | 11 / 15 |
| Latency p75 | 0.56 ms 95 % CI 0.55–0.57 | 0.55–0.57 | 5 | 8 / 15 |
| Latency p99.99 | 7.57 ms 95 % CI 6.84–10.99 | 6.84–10.99 | 5 | 9 / 15 |
| Latency mean | 0.60 ms 95 % CI 0.58–0.60 | 0.58–0.60 | 5 | 10 / 15 |
| Latency std. dev. | 0.71 ms 95 % CI 0.69–0.72 | 0.69–0.72 | 5 | 13 / 15 |
| Latency max | 13.51 ms 95 % CI 7.56–15.14 | 7.56–15.14 | 5 | 11 / 15 |
| CPU | ||||
| CPU used | 1.51 cores 95 % CI 1.50–1.54 | 1.50–1.54 | 5 | — |
| User-space CPU share | 0.559 95 % CI 0.552–0.567 | 0.552–0.567 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 10.9 MiB 95 % CI 10.8–11.5 | 10.8–11.5 | 5 | 2 / 15 |
| Database | ||||
| Database CPU per request | 62.9 µs 95 % CI 57.5–63.8 | 57.5–63.8 | 5 | 7 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 694.0 J 95 % CI 680.4–796.5 | 680.4–796.5 | 5 | — |
| Package energy per request | 1.292 mJ 95 % CI 1.263–1.491 | 1.263–1.491 | 5 | 6 / 15 |
| Network | ||||
| Bytes per response | 140 B 95 % CI 140–140 | 140–140 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.71 runnable tasks 95 % CI 4.90–7.53 | 4.90–7.53 | 5 | 6 / 15 |
| CPU clock | 3,176 MHz 95 % CI 2,925–3,391 | 2,925–3,391 | 5 | — |
| Load generator CPU | 0.38 95 % CI 0.30–0.39 | 0.30–0.39 | 5 | 8 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 39,523 req/s 95 % CI 37,445–40,319 | 37,445–40,319 | 5 | 5 / 15 |
| Latency p99 | 20.88 ms 95 % CI 20.64–24.45 | 20.64–24.45 | 5 | 6 / 15 |
| CPU per request | 43.6 µs 95 % CI 43.3–45.7 | 43.3–45.7 | 5 | 4 / 15 |
| Memory under load (PSS) | 41.9 MiB 95 % CI 41.6–42.3 | 41.6–42.3 | 5 | 2 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 12.10 ms 95 % CI 11.75–12.73 | 11.75–12.73 | 5 | 5 / 15 |
| Latency p90 | 17.14 ms 95 % CI 16.88–18.54 | 16.88–18.54 | 5 | 6 / 15 |
| Latency p99.9 | 26.00 ms 95 % CI 24.50–30.73 | 24.50–30.73 | 5 | 5 / 15 |
| Latency p75 | 14.79 ms 95 % CI 14.29–15.63 | 14.29–15.63 | 5 | 5 / 15 |
| Latency p99.99 | 29.88 ms 95 % CI 29.40–44.75 | 29.40–44.75 | 5 | 5 / 15 |
| Latency mean | 12.88 ms 95 % CI 12.64–13.61 | 12.64–13.61 | 5 | 5 / 15 |
| Latency std. dev. | 2.96 ms 95 % CI 2.88–3.54 | 2.88–3.54 | 5 | 9 / 15 |
| Latency max | 32.99 ms 95 % CI 32.23–51.11 | 32.23–51.11 | 5 | 5 / 15 |
| CPU | ||||
| CPU used | 1.72 cores 95 % CI 1.71–1.74 | 1.71–1.74 | 5 | — |
| User-space CPU share | 0.573 95 % CI 0.572–0.583 | 0.572–0.583 | 5 | — |
| CPU throttling | 0.0 ms 95 % CI 0.0–0.2 | 0.0–0.2 | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 32.4 MiB 95 % CI 32.1–32.8 | 32.1–32.8 | 5 | 2 / 15 |
| Database | ||||
| Database CPU per request | 59.1 µs 95 % CI 57.3–59.3 | 57.3–59.3 | 5 | 5 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 754.6 J 95 % CI 745.0–808.0 | 745.0–808.0 | 5 | — |
| Package energy per request | 1.263 mJ 95 % CI 1.243–1.433 | 1.243–1.433 | 5 | 5 / 15 |
| Network | ||||
| Bytes per response | 140 B 95 % CI 140–140 | 140–140 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.99 runnable tasks 95 % CI 5.03–7.41 | 5.03–7.41 | 5 | 7 / 15 |
| CPU clock | 3,409 MHz 95 % CI 3,231–3,603 | 3,231–3,603 | 5 | — |
| Load generator CPU | 0.44 95 % CI 0.35–0.44 | 0.35–0.44 | 5 | 11 / 15 |
Fixed rate
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,999 req/s 95 % CI 4,999–5,000 | 4,999–5,000 | 5 | 6 / 15 |
| Latency p99 | 1.86 ms 95 % CI 1.65–1.93 | 1.65–1.93 | 5 | 7 / 15 |
| CPU per request | 170.9 µs 95 % CI 163.9–172.8 | 163.9–172.8 | 5 | 3 / 15 |
| Memory under load (PSS) | 41.9 MiB 95 % CI 40.9–42.3 | 40.9–42.3 | 5 | 2 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.66 ms 95 % CI 0.62–0.69 | 0.62–0.69 | 5 | 3 / 15 |
| Latency p90 | 0.94 ms 95 % CI 0.93–0.97 | 0.93–0.97 | 5 | 3 / 15 |
| Latency p99.9 | 4.01 ms 95 % CI 3.29–4.48 | 3.29–4.48 | 5 | 3 / 15 |
| Latency p75 | 0.81 ms 95 % CI 0.78–0.82 | 0.78–0.82 | 5 | 3 / 15 |
| Latency p99.99 | 6.40 ms 95 % CI 4.98–14.09 | 4.98–14.09 | 5 | 3 / 15 |
| Latency mean | 0.69 ms 95 % CI 0.66–0.71 | 0.66–0.71 | 5 | 3 / 15 |
| Latency max | 16.26 ms 95 % CI 7.17–34.31 | 7.17–34.31 | 5 | 7 / 15 |
| CPU | ||||
| CPU used | 0.85 cores 95 % CI 0.82–0.86 | 0.82–0.86 | 5 | — |
| User-space CPU share | 0.552 95 % CI 0.543–0.580 | 0.543–0.580 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 32.4 MiB 95 % CI 31.4–32.8 | 31.4–32.8 | 5 | 3 / 15 |
| Database | ||||
| Database CPU per request | 153.0 µs 95 % CI 145.0–154.9 | 145.0–154.9 | 5 | 9 / 15 |
| SELECTs per request | 1.00 queries | — | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 394.1 J 95 % CI 375.9–455.5 | 375.9–455.5 | 5 | — |
| Package energy per request | 3.941 mJ 95 % CI 3.759–4.555 | 3.759–4.555 | 5 | 3 / 15 |
| Network | ||||
| Bytes per response | 31 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.71 runnable tasks 95 % CI 5.37–7.55 | 5.37–7.55 | 5 | 8 / 15 |
| CPU clock | 1,210 MHz 95 % CI 1,200–1,296 | 1,200–1,296 | 5 | — |
| Load generator CPU | 0.13 95 % CI 0.12–0.14 | 0.12–0.14 | 5 | 5 / 15 |