Overall
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 99.2 | — | — | 1 / 15 |
| CPU efficiency index | 91.5 | — | — | 2 / 15 |
| Peak memory | 75.9 MiB | — | — | 3 / 15 |
Bun's built-in HTTP server and built-in PostgreSQL client (Bun.SQL), no dependencies.
Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 99.2 | — | — | 1 / 15 |
| CPU efficiency index | 91.5 | — | — | 2 / 15 |
| Peak memory | 75.9 MiB | — | — | 3 / 15 |
Start-up
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Cold start | 200 ms 95 % CI 197–209 | 197–209 | 5 | 3 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Memory | ||||
| Memory at idle | 28.7 MiB 95 % CI 28.6–28.8 | 28.6–28.8 | 5 | 5 / 15 |
| Anonymous memory at idle | 8.1 MiB 95 % CI 8.1–8.1 | 8.1–8.1 | 5 | 3 / 15 |
| Start-up | ||||
| Cold start (fastest) | 187 ms 95 % CI 181–193 | 181–193 | 5 | 3 / 15 |
| Cold start (slowest) | 213 ms 95 % CI 205–222 | 205–222 | 5 | 3 / 15 |
| Footprint | ||||
| Image size | 284 MB | — | 5 | 8 / 15 |
Cold load
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 77,620 req/s 95 % CI 68,487–78,408 | 68,487–78,408 | 5 | 2 / 15 |
| Latency p99 | 3.63 ms 95 % CI 3.21–5.60 | 3.21–5.60 | 5 | 2 / 15 |
| CPU per request | 25.6 µs 95 % CI 25.5–28.9 | 25.5–28.9 | 5 | 2 / 15 |
| Memory under load (PSS) | 65.5 MiB 95 % CI 64.6–65.8 | 64.6–65.8 | 5 | 5 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.57 ms 95 % CI 1.56–1.72 | 1.56–1.72 | 5 | 2 / 15 |
| Latency p90 | 1.92 ms 95 % CI 1.90–2.64 | 1.90–2.64 | 5 | 2 / 15 |
| Latency p99.9 | 13.96 ms 95 % CI 7.93–24.97 | 7.93–24.97 | 5 | 1 / 15 |
| Latency p75 | 1.72 ms 95 % CI 1.69–2.06 | 1.69–2.06 | 5 | 2 / 15 |
| Latency p99.99 | 30.53 ms 95 % CI 19.73–46.22 | 19.73–46.22 | 5 | 1 / 15 |
| Latency mean | 1.66 ms 95 % CI 1.62–1.92 | 1.62–1.92 | 5 | 2 / 15 |
| Latency std. dev. | 0.87 ms 95 % CI 0.55–1.32 | 0.55–1.32 | 5 | 1 / 15 |
| Latency max | 38.03 ms 95 % CI 26.33–57.90 | 26.33–57.90 | 5 | 1 / 15 |
| CPU | ||||
| CPU used | 1.99 cores 95 % CI 1.97–1.99 | 1.97–1.99 | 5 | — |
| User-space CPU share | 0.482 95 % CI 0.476–0.509 | 0.476–0.509 | 5 | — |
| CPU throttling | 11.6 ms 95 % CI 7.2–21.3 | 7.2–21.3 | 5 | 11 / 15 |
| Memory | ||||
| Anonymous memory peak | 34.9 MiB 95 % CI 34.1–35.1 | 34.1–35.1 | 5 | 5 / 15 |
| Database | ||||
| Database CPU per request | 38.4 µs 95 % CI 38.2–39.4 | 38.2–39.4 | 5 | 1 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Start-up | ||||
| Cold vs. warm throughput | 0.99 95 % CI 0.88–1.00 | 0.88–1.00 | 5 | 7 / 15 |
| Energy | ||||
| CPU package energy | 628.2 J 95 % CI 617.4–648.4 | 617.4–648.4 | 5 | — |
| Package energy per request | 0.802 mJ 95 % CI 0.793–0.945 | 0.793–0.945 | 5 | 1 / 15 |
| Network | ||||
| Bytes per response | 153 B 95 % CI 153–153 | 153–153 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.29 runnable tasks 95 % CI 3.09–5.51 | 3.09–5.51 | 5 | 5 / 15 |
| CPU clock | 3,200 MHz 95 % CI 3,200–3,240 | 3,200–3,240 | 5 | — |
| Load generator CPU | 0.58 95 % CI 0.47–0.59 | 0.47–0.59 | 5 | 15 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 220,562 req/s 95 % CI 220,309–221,642 | 220,309–221,642 | 5 | 1 / 15 |
| Latency p99 | 1.17 ms 95 % CI 1.12–1.30 | 1.12–1.30 | 5 | 2 / 15 |
| CPU per request | 9.1 µs 95 % CI 9.0–9.1 | 9.0–9.1 | 5 | 1 / 15 |
| Memory under load (PSS) | 66.7 MiB 95 % CI 66.4–67.2 | 66.4–67.2 | 5 | 5 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.54 ms 95 % CI 0.53–0.59 | 0.53–0.59 | 5 | 1 / 15 |
| Latency p90 | 0.64 ms 95 % CI 0.62–0.72 | 0.62–0.72 | 5 | 1 / 15 |
| Latency p99.9 | 1.92 ms 95 % CI 1.85–2.00 | 1.85–2.00 | 5 | 2 / 15 |
| Latency p75 | 0.57 ms 95 % CI 0.56–0.65 | 0.56–0.65 | 5 | 1 / 15 |
| Latency p99.99 | 3.07 ms 95 % CI 2.89–3.35 | 2.89–3.35 | 5 | 2 / 15 |
| Latency mean | 0.57 ms 95 % CI 0.57–0.57 | 0.57–0.57 | 5 | 1 / 15 |
| Latency std. dev. | 0.17 ms 95 % CI 0.16–0.20 | 0.16–0.20 | 5 | 1 / 15 |
| Latency max | 4.53 ms 95 % CI 3.96–5.69 | 3.96–5.69 | 5 | 1 / 15 |
| CPU | ||||
| CPU used | 1.99 cores 95 % CI 1.99–1.99 | 1.99–1.99 | 5 | — |
| User-space CPU share | 0.367 95 % CI 0.365–0.375 | 0.365–0.375 | 5 | — |
| CPU throttling | 24.2 ms 95 % CI 8.8–34.2 | 8.8–34.2 | 5 | 14 / 15 |
| Memory | ||||
| Anonymous memory peak | 35.0 MiB 95 % CI 34.7–35.6 | 34.7–35.6 | 5 | 4 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 1 / 15 |
| Energy | ||||
| CPU package energy | 906.9 J 95 % CI 905.5–910.4 | 905.5–910.4 | 5 | — |
| Package energy per request | 0.273 mJ 95 % CI 0.271–0.274 | 0.271–0.274 | 5 | 1 / 15 |
| Network | ||||
| Bytes per response | 149 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.64 runnable tasks 95 % CI 6.22–8.26 | 6.22–8.26 | 5 | 15 / 15 |
| CPU clock | 3,372 MHz 95 % CI 3,334–3,425 | 3,334–3,425 | 5 | — |
| Load generator CPU | 0.76 95 % CI 0.75–0.76 | 0.75–0.76 | 5 | 14 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 78,458 req/s 95 % CI 78,216–78,973 | 78,216–78,973 | 5 | 2 / 15 |
| Latency p99 | 2.57 ms 95 % CI 2.53–2.68 | 2.53–2.68 | 5 | 2 / 15 |
| CPU per request | 25.5 µs 95 % CI 25.3–25.5 | 25.3–25.5 | 5 | 2 / 15 |
| Memory under load (PSS) | 73.9 MiB 95 % CI 71.0–77.2 | 71.0–77.2 | 5 | 5 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.58 ms 95 % CI 1.56–1.58 | 1.56–1.58 | 5 | 2 / 15 |
| Latency p90 | 1.97 ms 95 % CI 1.87–2.05 | 1.87–2.05 | 5 | 2 / 15 |
| Latency p99.9 | 3.54 ms 95 % CI 3.44–4.13 | 3.44–4.13 | 5 | 2 / 15 |
| Latency p75 | 1.78 ms 95 % CI 1.70–1.85 | 1.70–1.85 | 5 | 2 / 15 |
| Latency p99.99 | 4.63 ms 95 % CI 4.41–7.64 | 4.41–7.64 | 5 | 2 / 15 |
| Latency mean | 1.60 ms 95 % CI 1.59–1.61 | 1.59–1.61 | 5 | 2 / 15 |
| Latency std. dev. | 0.32 ms 95 % CI 0.27–0.40 | 0.27–0.40 | 5 | 2 / 15 |
| Latency max | 6.14 ms 95 % CI 5.66–14.63 | 5.66–14.63 | 5 | 1 / 15 |
| CPU | ||||
| CPU used | 2.00 cores 95 % CI 1.99–2.00 | 1.99–2.00 | 5 | — |
| User-space CPU share | 0.484 95 % CI 0.478–0.486 | 0.478–0.486 | 5 | — |
| CPU throttling | 18.8 ms 95 % CI 10.7–25.8 | 10.7–25.8 | 5 | 12 / 15 |
| Memory | ||||
| Anonymous memory peak | 42.2 MiB 95 % CI 39.3–45.4 | 39.3–45.4 | 5 | 6 / 15 |
| Database | ||||
| Database CPU per request | 38.3 µs 95 % CI 38.2–38.9 | 38.2–38.9 | 5 | 1 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 943.1 J 95 % CI 935.3–961.8 | 935.3–961.8 | 5 | — |
| Package energy per request | 0.796 mJ 95 % CI 0.791–0.814 | 0.791–0.814 | 5 | 1 / 15 |
| Network | ||||
| Bytes per response | 153 B 95 % CI 153–153 | 153–153 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.59 runnable tasks 95 % CI 6.20–7.34 | 6.20–7.34 | 5 | 14 / 15 |
| CPU clock | 3,253 MHz 95 % CI 3,253–3,288 | 3,253–3,288 | 5 | — |
| Load generator CPU | 0.58 95 % CI 0.53–0.59 | 0.53–0.59 | 5 | 15 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 5,293 req/s 95 % CI 5,290–5,296 | 5,290–5,296 | 5 | 1 / 15 |
| Latency p99 | 29.79 ms 95 % CI 27.14–33.09 | 27.14–33.09 | 5 | 2 / 15 |
| CPU per request | 358.0 µs 95 % CI 356.7–359.0 | 356.7–359.0 | 5 | 2 / 15 |
| Memory under load (PSS) | 75.9 MiB 95 % CI 75.4–79.8 | 75.4–79.8 | 5 | 5 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 24.08 ms 95 % CI 22.39–25.40 | 22.39–25.40 | 5 | 1 / 15 |
| Latency p90 | 28.27 ms 95 % CI 25.62–31.61 | 25.62–31.61 | 5 | 3 / 15 |
| Latency p99.9 | 30.95 ms 95 % CI 29.30–38.26 | 29.30–38.26 | 5 | 2 / 15 |
| Latency p75 | 27.51 ms 95 % CI 24.91–30.87 | 24.91–30.87 | 5 | 4 / 15 |
| Latency p99.99 | 37.92 ms 95 % CI 33.57–43.15 | 33.57–43.15 | 5 | 3 / 15 |
| Latency mean | 24.12 ms 95 % CI 24.10–24.13 | 24.10–24.13 | 5 | 1 / 15 |
| Latency std. dev. | 3.63 ms 95 % CI 1.28–6.88 | 1.28–6.88 | 5 | 8 / 15 |
| Latency max | 40.16 ms 95 % CI 34.77–44.17 | 34.77–44.17 | 5 | 2 / 15 |
| CPU | ||||
| CPU used | 1.89 cores 95 % CI 1.88–1.90 | 1.88–1.90 | 5 | — |
| User-space CPU share | 0.486 95 % CI 0.481–0.487 | 0.481–0.487 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 44.2 MiB 95 % CI 43.6–48.1 | 43.6–48.1 | 5 | 6 / 15 |
| Database | ||||
| Database CPU per request | 748.7 µs 95 % CI 748.2–748.9 | 748.2–748.9 | 5 | 1 / 15 |
| SELECTs per request | 20.03 queries 95 % CI 20.03–20.03 | 20.03–20.03 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 919.4 J 95 % CI 918.7–925.0 | 918.7–925.0 | 5 | — |
| Package energy per request | 11.559 mJ 95 % CI 11.552–11.629 | 11.552–11.629 | 5 | 2 / 15 |
| Network | ||||
| Bytes per response | 760 B 95 % CI 760–760 | 760–760 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 7.73 runnable tasks 95 % CI 7.21–8.52 | 7.21–8.52 | 5 | 13 / 15 |
| CPU clock | 3,253 MHz 95 % CI 3,253–3,253 | 3,253–3,253 | 5 | — |
| Load generator CPU | 0.06 95 % CI 0.06–0.06 | 0.06–0.06 | 5 | 14 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 8,376 req/s 95 % CI 8,353–8,402 | 8,353–8,402 | 5 | 2 / 15 |
| Latency p99 | 18.81 ms 95 % CI 18.10–18.93 | 18.10–18.93 | 5 | 2 / 15 |
| CPU per request | 201.2 µs 95 % CI 200.8–202.2 | 200.8–202.2 | 5 | 2 / 15 |
| Memory under load (PSS) | 75.0 MiB 95 % CI 73.8–76.4 | 73.8–76.4 | 5 | 5 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 15.21 ms 95 % CI 15.12–15.29 | 15.12–15.29 | 5 | 2 / 15 |
| Latency p90 | 16.35 ms 95 % CI 16.13–17.20 | 16.13–17.20 | 5 | 2 / 15 |
| Latency p99.9 | 22.94 ms 95 % CI 21.38–24.22 | 21.38–24.22 | 5 | 4 / 15 |
| Latency p75 | 15.77 ms 95 % CI 15.59–16.63 | 15.59–16.63 | 5 | 2 / 15 |
| Latency p99.99 | 26.70 ms 95 % CI 22.51–28.57 | 22.51–28.57 | 5 | 3 / 15 |
| Latency mean | 15.22 ms 95 % CI 15.19–15.27 | 15.19–15.27 | 5 | 2 / 15 |
| Latency std. dev. | 1.21 ms 95 % CI 0.99–1.73 | 0.99–1.73 | 5 | 4 / 15 |
| Latency max | 28.00 ms 95 % CI 23.22–30.71 | 23.22–30.71 | 5 | 1 / 15 |
| CPU | ||||
| CPU used | 1.69 cores 95 % CI 1.68–1.69 | 1.68–1.69 | 5 | — |
| User-space CPU share | 0.488 95 % CI 0.484–0.493 | 0.484–0.493 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 43.3 MiB 95 % CI 41.9–44.7 | 41.9–44.7 | 5 | 7 / 15 |
| Database | ||||
| Database CPU per request | 474.1 µs 95 % CI 472.2–474.7 | 472.2–474.7 | 5 | 2 / 15 |
| SELECTs per request | 5.00 queries 95 % CI 5.00–5.00 | 5.00–5.00 | 5 | — |
| UPDATEs per request | 5.00 queries 95 % CI 5.00–5.00 | 5.00–5.00 | 5 | — |
| Energy | ||||
| CPU package energy | 922.2 J 95 % CI 918.6–924.8 | 918.6–924.8 | 5 | — |
| Package energy per request | 7.312 mJ 95 % CI 7.304–7.320 | 7.304–7.320 | 5 | 2 / 15 |
| Network | ||||
| Bytes per response | 283 B 95 % CI 283–283 | 283–283 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 9.97 runnable tasks 95 % CI 9.42–10.16 | 9.42–10.16 | 5 | 13 / 15 |
| CPU clock | 3,253 MHz 95 % CI 3,253–3,267 | 3,253–3,267 | 5 | — |
| Load generator CPU | 0.09 95 % CI 0.09–0.09 | 0.09–0.09 | 5 | 13 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 37,235 req/s 95 % CI 36,639–37,497 | 36,639–37,497 | 5 | 1 / 15 |
| Latency p99 | 6.05 ms 95 % CI 5.85–6.13 | 5.85–6.13 | 5 | 2 / 15 |
| CPU per request | 53.7 µs 95 % CI 53.3–54.5 | 53.3–54.5 | 5 | 1 / 15 |
| Memory under load (PSS) | 71.5 MiB 95 % CI 70.3–71.7 | 70.3–71.7 | 5 | 5 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 3.27 ms 95 % CI 3.27–3.33 | 3.27–3.33 | 5 | 1 / 15 |
| Latency p90 | 4.60 ms 95 % CI 4.59–4.70 | 4.59–4.70 | 5 | 2 / 15 |
| Latency p99.9 | 7.29 ms 95 % CI 6.94–7.63 | 6.94–7.63 | 5 | 2 / 15 |
| Latency p75 | 3.90 ms 95 % CI 3.85–3.96 | 3.85–3.96 | 5 | 1 / 15 |
| Latency p99.99 | 8.76 ms 95 % CI 8.11–11.49 | 8.11–11.49 | 5 | 1 / 15 |
| Latency mean | 3.40 ms 95 % CI 3.38–3.47 | 3.38–3.47 | 5 | 1 / 15 |
| Latency std. dev. | 0.91 ms 95 % CI 0.87–0.95 | 0.87–0.95 | 5 | 4 / 15 |
| Latency max | 11.78 ms 95 % CI 10.46–15.76 | 10.46–15.76 | 5 | 2 / 15 |
| CPU | ||||
| CPU used | 2.00 cores 95 % CI 1.99–2.00 | 1.99–2.00 | 5 | — |
| User-space CPU share | 0.708 95 % CI 0.703–0.712 | 0.703–0.712 | 5 | — |
| CPU throttling | 21.7 ms 95 % CI 11.8–28.4 | 11.8–28.4 | 5 | 14 / 15 |
| Memory | ||||
| Anonymous memory peak | 39.8 MiB 95 % CI 38.7–40.0 | 38.7–40.0 | 5 | 3 / 15 |
| Database | ||||
| Database CPU per request | 81.4 µs 95 % CI 81.2–81.6 | 81.2–81.6 | 5 | 1 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 964.8 J 95 % CI 960.2–971.6 | 960.2–971.6 | 5 | — |
| Package energy per request | 1.721 mJ 95 % CI 1.703–1.743 | 1.703–1.743 | 5 | 1 / 15 |
| Network | ||||
| Bytes per response | 4,754 B 95 % CI 4,754–4,754 | 4,754–4,754 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 10.78 runnable tasks 95 % CI 10.55–11.63 | 10.55–11.63 | 5 | 13 / 15 |
| CPU clock | 3,253 MHz 95 % CI 3,253–3,293 | 3,253–3,293 | 5 | — |
| Load generator CPU | 0.44 95 % CI 0.43–0.44 | 0.43–0.44 | 5 | 15 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 74,921 req/s 95 % CI 74,412–75,442 | 74,412–75,442 | 5 | 1 / 15 |
| Latency p99 | 3.45 ms 95 % CI 3.30–3.76 | 3.30–3.76 | 5 | 1 / 15 |
| CPU per request | 26.7 µs 95 % CI 26.5–26.9 | 26.5–26.9 | 5 | 1 / 15 |
| Memory under load (PSS) | 67.0 MiB 95 % CI 65.2–68.8 | 65.2–68.8 | 5 | 5 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.66 ms 95 % CI 1.61–1.83 | 1.61–1.83 | 5 | 1 / 15 |
| Latency p90 | 1.89 ms 95 % CI 1.85–2.07 | 1.85–2.07 | 5 | 1 / 15 |
| Latency p99.9 | 3.89 ms 95 % CI 3.68–4.21 | 3.68–4.21 | 5 | 1 / 15 |
| Latency p75 | 1.78 ms 95 % CI 1.69–1.98 | 1.69–1.98 | 5 | 1 / 15 |
| Latency p99.99 | 4.73 ms 95 % CI 4.51–5.00 | 4.51–5.00 | 5 | 1 / 15 |
| Latency mean | 1.69 ms 95 % CI 1.68–1.70 | 1.68–1.70 | 5 | 1 / 15 |
| Latency std. dev. | 0.37 ms 95 % CI 0.32–0.46 | 0.32–0.46 | 5 | 1 / 15 |
| Latency max | 6.55 ms 95 % CI 6.06–6.61 | 6.06–6.61 | 5 | 1 / 15 |
| CPU | ||||
| CPU used | 2.00 cores 95 % CI 2.00–2.00 | 2.00–2.00 | 5 | — |
| User-space CPU share | 0.717 95 % CI 0.716–0.720 | 0.716–0.720 | 5 | — |
| CPU throttling | 20.0 ms 95 % CI 14.9–29.9 | 14.9–29.9 | 5 | 13 / 15 |
| Memory | ||||
| Anonymous memory peak | 35.4 MiB 95 % CI 33.5–36.9 | 33.5–36.9 | 5 | 6 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 1 / 15 |
| Energy | ||||
| CPU package energy | 713.7 J 95 % CI 710.3–728.3 | 710.3–728.3 | 5 | — |
| Package energy per request | 0.632 mJ 95 % CI 0.624–0.646 | 0.624–0.646 | 5 | 1 / 15 |
| Network | ||||
| Bytes per response | 192 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 10.43 runnable tasks 95 % CI 9.70–11.24 | 9.70–11.24 | 5 | 14 / 15 |
| CPU clock | 3,400 MHz 95 % CI 3,341–3,427 | 3,341–3,427 | 5 | — |
| Load generator CPU | 0.58 95 % CI 0.57–0.58 | 0.57–0.58 | 5 | 15 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 68,340 req/s 95 % CI 68,020–68,973 | 68,020–68,973 | 5 | 2 / 15 |
| Latency p99 | 0.44 ms 95 % CI 0.42–0.46 | 0.42–0.46 | 5 | 2 / 15 |
| CPU per request | 29.3 µs 95 % CI 29.0–29.4 | 29.0–29.4 | 5 | 2 / 15 |
| Memory under load (PSS) | 65.6 MiB 95 % CI 65.0–69.5 | 65.0–69.5 | 5 | 5 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.22 ms 95 % CI 0.21–0.23 | 0.21–0.23 | 5 | 2 / 15 |
| Latency p90 | 0.28 ms 95 % CI 0.27–0.32 | 0.27–0.32 | 5 | 2 / 15 |
| Latency p99.9 | 1.35 ms 95 % CI 1.23–1.47 | 1.23–1.47 | 5 | 2 / 15 |
| Latency p75 | 0.26 ms 95 % CI 0.24–0.29 | 0.24–0.29 | 5 | 2 / 15 |
| Latency p99.99 | 2.19 ms 95 % CI 1.92–3.46 | 1.92–3.46 | 5 | 2 / 15 |
| Latency mean | 0.23 ms 95 % CI 0.23–0.23 | 0.23–0.23 | 5 | 2 / 15 |
| Latency std. dev. | 0.08 ms 95 % CI 0.07–0.11 | 0.07–0.11 | 5 | 2 / 15 |
| Latency max | 3.98 ms 95 % CI 3.66–5.69 | 3.66–5.69 | 5 | 1 / 15 |
| CPU | ||||
| CPU used | 2.00 cores 95 % CI 2.00–2.00 | 2.00–2.00 | 5 | — |
| User-space CPU share | 0.512 95 % CI 0.505–0.513 | 0.505–0.513 | 5 | — |
| CPU throttling | 18.2 ms 95 % CI 11.0–27.9 | 11.0–27.9 | 5 | 13 / 15 |
| Memory | ||||
| Anonymous memory peak | 33.9 MiB 95 % CI 33.2–37.6 | 33.2–37.6 | 5 | 5 / 15 |
| Database | ||||
| Database CPU per request | 39.2 µs 95 % CI 38.9–41.2 | 38.9–41.2 | 5 | 1 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 960.7 J 95 % CI 942.4–972.3 | 942.4–972.3 | 5 | — |
| Package energy per request | 0.923 mJ 95 % CI 0.918–0.934 | 0.918–0.934 | 5 | 2 / 15 |
| Network | ||||
| Bytes per response | 153 B 95 % CI 153–153 | 153–153 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 8.61 runnable tasks 95 % CI 8.39–9.71 | 8.39–9.71 | 5 | 14 / 15 |
| CPU clock | 3,275 MHz 95 % CI 3,253–3,363 | 3,253–3,363 | 5 | — |
| Load generator CPU | 0.49 95 % CI 0.42–0.54 | 0.42–0.54 | 5 | 12 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 78,903 req/s 95 % CI 78,562–79,178 | 78,562–79,178 | 5 | 1 / 15 |
| Latency p99 | 8.67 ms 95 % CI 8.47–9.24 | 8.47–9.24 | 5 | 2 / 15 |
| CPU per request | 25.3 µs 95 % CI 25.2–25.4 | 25.2–25.4 | 5 | 1 / 15 |
| Memory under load (PSS) | 69.1 MiB 95 % CI 68.9–69.4 | 68.9–69.4 | 5 | 3 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 6.35 ms 95 % CI 6.32–6.37 | 6.32–6.37 | 5 | 1 / 15 |
| Latency p90 | 7.32 ms 95 % CI 7.29–7.82 | 7.29–7.82 | 5 | 2 / 15 |
| Latency p99.9 | 10.60 ms 95 % CI 10.27–11.06 | 10.27–11.06 | 5 | 2 / 15 |
| Latency p75 | 6.83 ms 95 % CI 6.81–7.18 | 6.81–7.18 | 5 | 1 / 15 |
| Latency p99.99 | 14.78 ms 95 % CI 12.73–18.35 | 12.73–18.35 | 5 | 1 / 15 |
| Latency mean | 6.40 ms 95 % CI 6.38–6.42 | 6.38–6.42 | 5 | 1 / 15 |
| Latency std. dev. | 0.79 ms 95 % CI 0.78–1.11 | 0.78–1.11 | 5 | 2 / 15 |
| Latency max | 18.62 ms 95 % CI 16.42–23.57 | 16.42–23.57 | 5 | 1 / 15 |
| CPU | ||||
| CPU used | 1.99 cores 95 % CI 1.99–1.99 | 1.99–1.99 | 5 | — |
| User-space CPU share | 0.493 95 % CI 0.491–0.496 | 0.491–0.496 | 5 | — |
| CPU throttling | 22.3 ms 95 % CI 14.9–34.7 | 14.9–34.7 | 5 | 14 / 15 |
| Memory | ||||
| Anonymous memory peak | 37.4 MiB 95 % CI 37.1–37.5 | 37.1–37.5 | 5 | 3 / 15 |
| Database | ||||
| Database CPU per request | 35.7 µs 95 % CI 35.6–35.8 | 35.6–35.8 | 5 | 1 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 932.4 J 95 % CI 927.6–941.2 | 927.6–941.2 | 5 | — |
| Package energy per request | 0.786 mJ 95 % CI 0.780–0.792 | 0.780–0.792 | 5 | 1 / 15 |
| Network | ||||
| Bytes per response | 153 B 95 % CI 153–153 | 153–153 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 8.50 runnable tasks 95 % CI 8.05–9.13 | 8.05–9.13 | 5 | 14 / 15 |
| CPU clock | 3,253 MHz 95 % CI 3,253–3,253 | 3,253–3,253 | 5 | — |
| Load generator CPU | 0.60 95 % CI 0.56–0.61 | 0.56–0.61 | 5 | 15 / 15 |
Fixed rate
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,999 req/s 95 % CI 4,999–4,999 | 4,999–4,999 | 5 | 12 / 15 |
| Latency p99 | 1.27 ms 95 % CI 1.16–1.31 | 1.16–1.31 | 5 | 2 / 15 |
| CPU per request | 134.9 µs 95 % CI 126.6–135.4 | 126.6–135.4 | 5 | 2 / 15 |
| Memory under load (PSS) | 59.8 MiB 95 % CI 57.8–60.9 | 57.8–60.9 | 5 | 3 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 0.65 ms 95 % CI 0.56–0.66 | 0.56–0.66 | 5 | 2 / 15 |
| Latency p90 | 0.90 ms 95 % CI 0.86–0.90 | 0.86–0.90 | 5 | 2 / 15 |
| Latency p99.9 | 2.81 ms 95 % CI 2.29–3.23 | 2.29–3.23 | 5 | 2 / 15 |
| Latency p75 | 0.77 ms 95 % CI 0.72–0.78 | 0.72–0.78 | 5 | 2 / 15 |
| Latency p99.99 | 4.09 ms 95 % CI 3.91–4.30 | 3.91–4.30 | 5 | 2 / 15 |
| Latency mean | 0.64 ms 95 % CI 0.59–0.66 | 0.59–0.66 | 5 | 2 / 15 |
| Latency max | 4.54 ms 95 % CI 4.21–5.82 | 4.21–5.82 | 5 | 2 / 15 |
| CPU | ||||
| CPU used | 0.67 cores 95 % CI 0.63–0.67 | 0.63–0.67 | 5 | — |
| User-space CPU share | 0.540 95 % CI 0.520–0.576 | 0.520–0.576 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 28.0 MiB 95 % CI 26.0–29.2 | 26.0–29.2 | 5 | 2 / 15 |
| Database | ||||
| Database CPU per request | 155.8 µs 95 % CI 144.2–160.3 | 144.2–160.3 | 5 | 10 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 377.6 J 95 % CI 370.4–463.7 | 370.4–463.7 | 5 | — |
| Package energy per request | 3.776 mJ 95 % CI 3.704–4.637 | 3.704–4.637 | 5 | 1 / 15 |
| Network | ||||
| Bytes per response | 30 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 8.61 runnable tasks 95 % CI 8.08–10.47 | 8.08–10.47 | 5 | 14 / 15 |
| CPU clock | 1,217 MHz 95 % CI 1,200–1,268 | 1,200–1,268 | 5 | — |
| Load generator CPU | 0.14 95 % CI 0.13–0.14 | 0.13–0.14 | 5 | 6 / 15 |