Overall
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 25.5 | — | — | 13 / 15 |
| CPU efficiency index | 29.5 | — | — | 12 / 15 |
| Peak memory | 134.8 MiB | — | — | 6 / 15 |
Plain PHP with PDO in FrankenPHP worker mode: no framework. Laravel or Symfony would add considerable overhead.
Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 25.5 | — | — | 13 / 15 |
| CPU efficiency index | 29.5 | — | — | 12 / 15 |
| Peak memory | 134.8 MiB | — | — | 6 / 15 |
Start-up
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Cold start | 307 ms 95 % CI 296–321 | 296–321 | 5 | 6 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Memory | ||||
| Memory at idle | 93.6 MiB 95 % CI 93.6–94.5 | 93.6–94.5 | 5 | 8 / 15 |
| Anonymous memory at idle | 33.7 MiB 95 % CI 33.4–34.2 | 33.4–34.2 | 5 | 8 / 15 |
| Start-up | ||||
| Cold start (fastest) | 284 ms 95 % CI 232–305 | 232–305 | 5 | 6 / 15 |
| Cold start (slowest) | 339 ms 95 % CI 327–347 | 327–347 | 5 | 6 / 15 |
| Footprint | ||||
| Image size | 875 MB | — | 5 | 15 / 15 |
Cold load
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 9,172 req/s 95 % CI 8,528–9,294 | 8,528–9,294 | 5 | 12 / 15 |
| Latency p99 | 28.45 ms 95 % CI 27.84–29.16 | 27.84–29.16 | 5 | 7 / 15 |
| CPU per request | 132.1 µs 95 % CI 129.5–140.0 | 129.5–140.0 | 5 | 11 / 15 |
| Memory under load (PSS) | 108.2 MiB 95 % CI 107.7–108.5 | 107.7–108.5 | 5 | 8 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 13.77 ms 95 % CI 13.67–14.68 | 13.67–14.68 | 5 | 13 / 15 |
| Latency p90 | 20.62 ms 95 % CI 20.45–21.15 | 20.45–21.15 | 5 | 13 / 15 |
| Latency p99.9 | 34.87 ms 95 % CI 33.47–35.20 | 33.47–35.20 | 5 | 4 / 15 |
| Latency p75 | 17.22 ms 95 % CI 17.21–17.99 | 17.21–17.99 | 5 | 13 / 15 |
| Latency p99.99 | 39.88 ms 95 % CI 38.32–41.46 | 38.32–41.46 | 5 | 3 / 15 |
| Latency mean | 13.91 ms 95 % CI 13.76–14.97 | 13.76–14.97 | 5 | 12 / 15 |
| Latency std. dev. | 5.28 ms 95 % CI 4.95–5.59 | 4.95–5.59 | 5 | 8 / 15 |
| Latency max | 45.38 ms 95 % CI 40.43–48.53 | 40.43–48.53 | 5 | 2 / 15 |
| CPU | ||||
| CPU used | 1.20 cores 95 % CI 1.19–1.21 | 1.19–1.21 | 5 | — |
| User-space CPU share | 0.657 95 % CI 0.654–0.668 | 0.654–0.668 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 47.7 MiB 95 % CI 47.3–47.7 | 47.3–47.7 | 5 | 8 / 15 |
| Database | ||||
| Database CPU per request | 89.5 µs 95 % CI 78.9–93.2 | 78.9–93.2 | 5 | 11 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Start-up | ||||
| Cold vs. warm throughput | 1.05 95 % CI 0.99–1.10 | 0.99–1.10 | 5 | 1 / 15 |
| Energy | ||||
| CPU package energy | 273.4 J 95 % CI 259.0–306.5 | 259.0–306.5 | 5 | — |
| Package energy per request | 3.022 mJ 95 % CI 2.913–3.328 | 2.913–3.328 | 5 | 11 / 15 |
| Network | ||||
| Bytes per response | 191 B 95 % CI 191–191 | 191–191 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB 95 % CI 0–8 | 0–8 | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.08 runnable tasks 95 % CI 3.40–8.15 | 3.40–8.15 | 5 | 13 / 15 |
| CPU clock | 2,487 MHz 95 % CI 2,375–2,624 | 2,375–2,624 | 5 | — |
| Load generator CPU | 0.11 95 % CI 0.10–0.11 | 0.10–0.11 | 5 | 3 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 24,214 req/s 95 % CI 21,797–24,232 | 21,797–24,232 | 5 | 13 / 15 |
| Latency p99 | 12.16 ms 95 % CI 12.09–14.31 | 12.09–14.31 | 5 | 13 / 15 |
| CPU per request | 63.9 µs 95 % CI 63.6–70.6 | 63.6–70.6 | 5 | 13 / 15 |
| Memory under load (PSS) | 110.8 MiB 95 % CI 110.2–110.9 | 110.2–110.9 | 5 | 7 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 5.21 ms 95 % CI 5.21–5.72 | 5.21–5.72 | 5 | 14 / 15 |
| Latency p90 | 8.64 ms 95 % CI 8.62–9.78 | 8.62–9.78 | 5 | 15 / 15 |
| Latency p99.9 | 14.32 ms 95 % CI 13.86–18.53 | 13.86–18.53 | 5 | 11 / 15 |
| Latency p75 | 6.96 ms 95 % CI 6.95–7.71 | 6.95–7.71 | 5 | 14 / 15 |
| Latency p99.99 | 19.07 ms 95 % CI 15.97–21.84 | 15.97–21.84 | 5 | 9 / 15 |
| Latency mean | 5.31 ms 95 % CI 5.29–5.93 | 5.29–5.93 | 5 | 13 / 15 |
| Latency std. dev. | 2.60 ms 95 % CI 2.58–3.00 | 2.58–3.00 | 5 | 14 / 15 |
| Latency max | 23.84 ms 95 % CI 18.61–28.21 | 18.61–28.21 | 5 | 9 / 15 |
| CPU | ||||
| CPU used | 1.54 cores 95 % CI 1.54–1.54 | 1.54–1.54 | 5 | — |
| User-space CPU share | 0.692 95 % CI 0.687–0.702 | 0.687–0.702 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 49.7 MiB 95 % CI 49.4–49.9 | 49.4–49.9 | 5 | 8 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–< 0.1 | < 0.1–< 0.1 | 5 | 11 / 15 |
| Energy | ||||
| CPU package energy | 652.2 J 95 % CI 642.8–726.2 | 642.8–726.2 | 5 | — |
| Package energy per request | 1.796 mJ 95 % CI 1.766–2.217 | 1.766–2.217 | 5 | 13 / 15 |
| Network | ||||
| Bytes per response | 187 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.38 runnable tasks 95 % CI 4.30–8.40 | 4.30–8.40 | 5 | 9 / 15 |
| CPU clock | 3,700 MHz 95 % CI 3,690–3,790 | 3,690–3,790 | 5 | — |
| Load generator CPU | 0.27 95 % CI 0.23–0.27 | 0.23–0.27 | 5 | 2 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 8,439 req/s 95 % CI 8,340–9,223 | 8,340–9,223 | 5 | 14 / 15 |
| Latency p99 | 29.37 ms 95 % CI 28.00–30.06 | 28.00–30.06 | 5 | 13 / 15 |
| CPU per request | 141.1 µs 95 % CI 131.0–142.8 | 131.0–142.8 | 5 | 14 / 15 |
| Memory under load (PSS) | 110.6 MiB 95 % CI 109.9–111.3 | 109.9–111.3 | 5 | 7 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 14.78 ms 95 % CI 13.65–15.00 | 13.65–15.00 | 5 | 14 / 15 |
| Latency p90 | 21.39 ms 95 % CI 20.47–21.82 | 20.47–21.82 | 5 | 14 / 15 |
| Latency p99.9 | 35.22 ms 95 % CI 33.49–36.51 | 33.49–36.51 | 5 | 13 / 15 |
| Latency p75 | 18.17 ms 95 % CI 17.18–18.45 | 17.18–18.45 | 5 | 15 / 15 |
| Latency p99.99 | 39.73 ms 95 % CI 37.88–40.97 | 37.88–40.97 | 5 | 13 / 15 |
| Latency mean | 15.14 ms 95 % CI 13.86–15.32 | 13.86–15.32 | 5 | 14 / 15 |
| Latency std. dev. | 5.05 ms 95 % CI 4.97–5.28 | 4.97–5.28 | 5 | 13 / 15 |
| Latency max | 44.29 ms 95 % CI 41.99–45.65 | 41.99–45.65 | 5 | 12 / 15 |
| CPU | ||||
| CPU used | 1.19 cores 95 % CI 1.19–1.21 | 1.19–1.21 | 5 | — |
| User-space CPU share | 0.662 95 % CI 0.656–0.675 | 0.656–0.675 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 49.3 MiB 95 % CI 48.9–50.1 | 48.9–50.1 | 5 | 8 / 15 |
| Database | ||||
| Database CPU per request | 88.8 µs 95 % CI 77.7–92.7 | 77.7–92.7 | 5 | 12 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 378.3 J 95 % CI 369.5–556.7 | 369.5–556.7 | 5 | — |
| Package energy per request | 2.973 mJ 95 % CI 2.906–4.014 | 2.906–4.014 | 5 | 13 / 15 |
| Network | ||||
| Bytes per response | 191 B 95 % CI 191–191 | 191–191 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.89 runnable tasks 95 % CI 3.98–7.77 | 3.98–7.77 | 5 | 5 / 15 |
| CPU clock | 2,383 MHz 95 % CI 2,348–2,801 | 2,348–2,801 | 5 | — |
| Load generator CPU | 0.10 95 % CI 0.09–0.10 | 0.09–0.10 | 5 | 1 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,739 req/s 95 % CI 4,545–4,758 | 4,545–4,758 | 5 | 4 / 15 |
| Latency p99 | 31.92 ms 95 % CI 30.86–37.81 | 30.86–37.81 | 5 | 4 / 15 |
| CPU per request | 392.5 µs 95 % CI 388.1–417.3 | 388.1–417.3 | 5 | 5 / 15 |
| Memory under load (PSS) | 112.4 MiB 95 % CI 112.0–118.0 | 112.0–118.0 | 5 | 7 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 26.73 ms 95 % CI 26.65–27.29 | 26.65–27.29 | 5 | 4 / 15 |
| Latency p90 | 28.33 ms 95 % CI 28.14–31.28 | 28.14–31.28 | 5 | 4 / 15 |
| Latency p99.9 | 39.56 ms 95 % CI 37.73–46.39 | 37.73–46.39 | 5 | 4 / 15 |
| Latency p75 | 27.35 ms 95 % CI 27.26–28.82 | 27.26–28.82 | 5 | 2 / 15 |
| Latency p99.99 | 47.19 ms 95 % CI 41.45–54.55 | 41.45–54.55 | 5 | 4 / 15 |
| Latency mean | 26.91 ms 95 % CI 26.82–28.09 | 26.82–28.09 | 5 | 4 / 15 |
| Latency std. dev. | 1.46 ms 95 % CI 1.30–2.63 | 1.30–2.63 | 5 | 3 / 15 |
| Latency max | 49.92 ms 95 % CI 43.15–56.43 | 43.15–56.43 | 5 | 5 / 15 |
| CPU | ||||
| CPU used | 1.86 cores 95 % CI 1.84–1.89 | 1.84–1.89 | 5 | — |
| User-space CPU share | 0.400 95 % CI 0.398–0.408 | 0.398–0.408 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 51.3 MiB 95 % CI 50.9–53.8 | 50.9–53.8 | 5 | 8 / 15 |
| Database | ||||
| Database CPU per request | 831.7 µs 95 % CI 829.7–847.1 | 829.7–847.1 | 5 | 13 / 15 |
| SELECTs per request | 20.03 queries 95 % CI 20.02–20.03 | 20.02–20.03 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 942.0 J 95 % CI 939.6–987.3 | 939.6–987.3 | 5 | — |
| Package energy per request | 13.227 mJ 95 % CI 13.180–14.457 | 13.180–14.457 | 5 | 4 / 15 |
| Network | ||||
| Bytes per response | 798 B 95 % CI 798–798 | 798–798 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.34 runnable tasks 95 % CI 4.98–8.40 | 4.98–8.40 | 5 | 5 / 15 |
| CPU clock | 3,533 MHz 95 % CI 3,493–3,613 | 3,493–3,613 | 5 | — |
| Load generator CPU | 0.06 95 % CI 0.05–0.06 | 0.05–0.06 | 5 | 13 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 7,627 req/s 95 % CI 7,465–7,759 | 7,465–7,759 | 5 | 5 / 15 |
| Latency p99 | 22.12 ms 95 % CI 21.76–25.18 | 21.76–25.18 | 5 | 5 / 15 |
| CPU per request | 238.5 µs 95 % CI 234.8–245.8 | 234.8–245.8 | 5 | 5 / 15 |
| Memory under load (PSS) | 112.0 MiB 95 % CI 111.5–112.3 | 111.5–112.3 | 5 | 8 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 16.44 ms 95 % CI 16.22–16.55 | 16.22–16.55 | 5 | 5 / 15 |
| Latency p90 | 18.74 ms 95 % CI 18.43–19.82 | 18.43–19.82 | 5 | 5 / 15 |
| Latency p99.9 | 26.43 ms 95 % CI 25.68–30.42 | 25.68–30.42 | 5 | 5 / 15 |
| Latency p75 | 16.97 ms 95 % CI 16.74–17.52 | 16.74–17.52 | 5 | 5 / 15 |
| Latency p99.99 | 33.16 ms 95 % CI 30.55–34.06 | 30.55–34.06 | 5 | 6 / 15 |
| Latency mean | 16.74 ms 95 % CI 16.45–17.08 | 16.45–17.08 | 5 | 5 / 15 |
| Latency std. dev. | 1.59 ms 95 % CI 1.55–2.20 | 1.55–2.20 | 5 | 6 / 15 |
| Latency max | 39.03 ms 95 % CI 33.45–40.81 | 33.45–40.81 | 5 | 7 / 15 |
| CPU | ||||
| CPU used | 1.82 cores 95 % CI 1.81–1.83 | 1.81–1.83 | 5 | — |
| User-space CPU share | 0.459 95 % CI 0.451–0.468 | 0.451–0.468 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 50.9 MiB 95 % CI 50.6–51.0 | 50.6–51.0 | 5 | 8 / 15 |
| Database | ||||
| Database CPU per request | 510.6 µs 95 % CI 502.3–512.5 | 502.3–512.5 | 5 | 13 / 15 |
| SELECTs per request | 5.01 queries 95 % CI 5.00–5.01 | 5.00–5.01 | 5 | — |
| UPDATEs per request | 5.01 queries 95 % CI 5.00–5.01 | 5.00–5.01 | 5 | — |
| Energy | ||||
| CPU package energy | 954.2 J 95 % CI 941.6–982.2 | 941.6–982.2 | 5 | — |
| Package energy per request | 8.285 mJ 95 % CI 8.177–8.744 | 8.177–8.744 | 5 | 5 / 15 |
| Network | ||||
| Bytes per response | 321 B 95 % CI 321–321 | 321–321 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 9.14 runnable tasks 95 % CI 8.17–11.67 | 8.17–11.67 | 5 | 12 / 15 |
| CPU clock | 3,560 MHz 95 % CI 3,480–3,627 | 3,480–3,627 | 5 | — |
| Load generator CPU | 0.09 95 % CI 0.07–0.09 | 0.07–0.09 | 5 | 11 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 5,538 req/s 95 % CI 4,177–6,959 | 4,177–6,959 | 5 | 13 / 15 |
| Latency p99 | 57.30 ms 95 % CI 53.18–60.81 | 53.18–60.81 | 5 | 13 / 15 |
| CPU per request | 236.6 µs 95 % CI 197.5–299.0 | 197.5–299.0 | 5 | 13 / 15 |
| Memory under load (PSS) | 111.0 MiB 95 % CI 110.5–111.2 | 110.5–111.2 | 5 | 6 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 20.20 ms 95 % CI 16.46–31.79 | 16.46–31.79 | 5 | 13 / 15 |
| Latency p90 | 43.38 ms 95 % CI 37.16–47.00 | 37.16–47.00 | 5 | 13 / 15 |
| Latency p99.9 | 68.75 ms 95 % CI 64.23–74.56 | 64.23–74.56 | 5 | 13 / 15 |
| Latency p75 | 33.90 ms 95 % CI 24.46–40.20 | 24.46–40.20 | 5 | 14 / 15 |
| Latency p99.99 | 79.82 ms 95 % CI 73.08–84.57 | 73.08–84.57 | 5 | 13 / 15 |
| Latency mean | 23.41 ms 95 % CI 19.12–30.59 | 19.12–30.59 | 5 | 13 / 15 |
| Latency std. dev. | 13.43 ms 95 % CI 11.72–13.80 | 11.72–13.80 | 5 | 14 / 15 |
| Latency max | 89.38 ms 95 % CI 80.94–91.78 | 80.94–91.78 | 5 | 13 / 15 |
| CPU | ||||
| CPU used | 1.31 cores 95 % CI 1.25–1.37 | 1.25–1.37 | 5 | — |
| User-space CPU share | 0.729 95 % CI 0.727–0.731 | 0.727–0.731 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 49.7 MiB 95 % CI 49.2–50.0 | 49.2–50.0 | 5 | 6 / 15 |
| Database | ||||
| Database CPU per request | 213.7 µs 95 % CI 202.7–220.5 | 202.7–220.5 | 5 | 12 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 435.5 J 95 % CI 365.4–516.6 | 365.4–516.6 | 5 | — |
| Package energy per request | 5.205 mJ 95 % CI 4.938–5.919 | 4.938–5.919 | 5 | 12 / 15 |
| Network | ||||
| Bytes per response | 4,811 B 95 % CI 4,811–4,811 | 4,811–4,811 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 10.67 runnable tasks 95 % CI 9.71–11.91 | 9.71–11.91 | 5 | 12 / 15 |
| CPU clock | 2,280 MHz 95 % CI 1,757–2,820 | 1,757–2,820 | 5 | — |
| Load generator CPU | 0.10 95 % CI 0.08–0.13 | 0.08–0.13 | 5 | 3 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 15,016 req/s 95 % CI 12,919–15,069 | 12,919–15,069 | 5 | 13 / 15 |
| Latency p99 | 16.80 ms 95 % CI 16.67–20.17 | 16.67–20.17 | 5 | 13 / 15 |
| CPU per request | 105.7 µs 95 % CI 105.6–123.1 | 105.6–123.1 | 5 | 12 / 15 |
| Memory under load (PSS) | 111.3 MiB 95 % CI 111.0–111.5 | 111.0–111.5 | 5 | 8 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 8.08 ms 95 % CI 8.06–9.34 | 8.06–9.34 | 5 | 12 / 15 |
| Latency p90 | 11.36 ms 95 % CI 11.32–13.83 | 11.32–13.83 | 5 | 13 / 15 |
| Latency p99.9 | 22.29 ms 95 % CI 22.18–26.39 | 22.18–26.39 | 5 | 11 / 15 |
| Latency p75 | 9.47 ms 95 % CI 9.39–11.42 | 9.39–11.42 | 5 | 13 / 15 |
| Latency p99.99 | 26.03 ms 95 % CI 25.73–31.72 | 25.73–31.72 | 5 | 11 / 15 |
| Latency mean | 8.53 ms 95 % CI 8.47–9.91 | 8.47–9.91 | 5 | 13 / 15 |
| Latency std. dev. | 2.31 ms 95 % CI 2.29–3.08 | 2.29–3.08 | 5 | 11 / 15 |
| Latency max | 33.83 ms 95 % CI 31.99–35.64 | 31.99–35.64 | 5 | 10 / 15 |
| CPU | ||||
| CPU used | 1.59 cores 95 % CI 1.58–1.59 | 1.58–1.59 | 5 | — |
| User-space CPU share | 0.804 95 % CI 0.801–0.816 | 0.801–0.816 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 50.0 MiB 95 % CI 49.7–50.3 | 49.7–50.3 | 5 | 8 / 15 |
| Database | ||||
| Database CPU per request | 0.1 µs 95 % CI < 0.1–0.1 | < 0.1–0.1 | 5 | 10 / 15 |
| Energy | ||||
| CPU package energy | 662.2 J 95 % CI 659.0–745.7 | 659.0–745.7 | 5 | — |
| Package energy per request | 2.934 mJ 95 % CI 2.912–3.840 | 2.912–3.840 | 5 | 12 / 15 |
| Network | ||||
| Bytes per response | 230 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 8.50 runnable tasks 95 % CI 8.10–9.57 | 8.10–9.57 | 5 | 11 / 15 |
| CPU clock | 3,713 MHz 95 % CI 3,687–3,793 | 3,687–3,793 | 5 | — |
| Load generator CPU | 0.17 95 % CI 0.14–0.17 | 0.14–0.17 | 5 | 3 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 8,722 req/s 95 % CI 8,666–9,333 | 8,666–9,333 | 5 | 14 / 15 |
| Latency p99 | 4.84 ms 95 % CI 4.49–4.89 | 4.49–4.89 | 5 | 14 / 15 |
| CPU per request | 136.5 µs 95 % CI 127.9–137.1 | 127.9–137.1 | 5 | 14 / 15 |
| Memory under load (PSS) | 104.3 MiB 95 % CI 103.8–104.7 | 103.8–104.7 | 5 | 7 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.78 ms 95 % CI 1.67–1.80 | 1.67–1.80 | 5 | 14 / 15 |
| Latency p90 | 2.98 ms 95 % CI 2.75–3.00 | 2.75–3.00 | 5 | 15 / 15 |
| Latency p99.9 | 6.95 ms 95 % CI 6.43–7.15 | 6.43–7.15 | 5 | 14 / 15 |
| Latency p75 | 2.36 ms 95 % CI 2.20–2.38 | 2.20–2.38 | 5 | 15 / 15 |
| Latency p99.99 | 8.93 ms 95 % CI 8.24–9.01 | 8.24–9.01 | 5 | 11 / 15 |
| Latency mean | 1.85 ms 95 % CI 1.74–1.87 | 1.74–1.87 | 5 | 14 / 15 |
| Latency std. dev. | 0.94 ms 95 % CI 0.86–0.94 | 0.86–0.94 | 5 | 14 / 15 |
| Latency max | 11.54 ms 95 % CI 9.87–12.74 | 9.87–12.74 | 5 | 8 / 15 |
| CPU | ||||
| CPU used | 1.19 cores 95 % CI 1.19–1.20 | 1.19–1.20 | 5 | — |
| User-space CPU share | 0.653 95 % CI 0.644–0.658 | 0.644–0.658 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 43.0 MiB 95 % CI 42.9–43.5 | 42.9–43.5 | 5 | 8 / 15 |
| Database | ||||
| Database CPU per request | 86.0 µs 95 % CI 82.0–86.8 | 82.0–86.8 | 5 | 12 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 391.0 J 95 % CI 382.3–453.4 | 382.3–453.4 | 5 | — |
| Package energy per request | 2.959 mJ 95 % CI 2.911–3.273 | 2.911–3.273 | 5 | 13 / 15 |
| Network | ||||
| Bytes per response | 191 B 95 % CI 191–191 | 191–191 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 6.86 runnable tasks 95 % CI 6.23–8.27 | 6.23–8.27 | 5 | 11 / 15 |
| CPU clock | 2,528 MHz 95 % CI 2,357–2,652 | 2,357–2,652 | 5 | — |
| Load generator CPU | 0.10 95 % CI 0.10–0.11 | 0.10–0.11 | 5 | 1 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 8,532 req/s 95 % CI 8,464–9,368 | 8,464–9,368 | 5 | 13 / 15 |
| Latency p99 | 88.38 ms 95 % CI 85.59–90.51 | 85.59–90.51 | 5 | 13 / 15 |
| CPU per request | 141.5 µs 95 % CI 130.1–142.8 | 130.1–142.8 | 5 | 13 / 15 |
| Memory under load (PSS) | 134.8 MiB 95 % CI 133.9–135.5 | 133.9–135.5 | 5 | 6 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 59.32 ms 95 % CI 54.14–60.05 | 54.14–60.05 | 5 | 13 / 15 |
| Latency p90 | 74.52 ms 95 % CI 70.64–75.44 | 70.64–75.44 | 5 | 13 / 15 |
| Latency p99.9 | 101.55 ms 95 % CI 99.07–105.13 | 99.07–105.13 | 5 | 11 / 15 |
| Latency p75 | 67.03 ms 95 % CI 62.87–67.69 | 62.87–67.69 | 5 | 13 / 15 |
| Latency p99.99 | 117.74 ms 95 % CI 110.61–120.62 | 110.61–120.62 | 5 | 10 / 15 |
| Latency mean | 59.68 ms 95 % CI 54.30–60.20 | 54.30–60.20 | 5 | 13 / 15 |
| Latency std. dev. | 11.99 ms 95 % CI 11.57–12.88 | 11.57–12.88 | 5 | 11 / 15 |
| Latency max | 135.50 ms 95 % CI 128.37–147.20 | 128.37–147.20 | 5 | 10 / 15 |
| CPU | ||||
| CPU used | 1.21 cores 95 % CI 1.20–1.22 | 1.20–1.22 | 5 | — |
| User-space CPU share | 0.656 95 % CI 0.648–0.661 | 0.648–0.661 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 73.7 MiB 95 % CI 72.6–74.2 | 72.6–74.2 | 5 | 4 / 15 |
| Database | ||||
| Database CPU per request | 86.6 µs 95 % CI 79.1–87.6 | 79.1–87.6 | 5 | 11 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 397.2 J 95 % CI 384.1–478.7 | 384.1–478.7 | 5 | — |
| Package energy per request | 3.023 mJ 95 % CI 3.017–3.392 | 3.017–3.392 | 5 | 13 / 15 |
| Network | ||||
| Bytes per response | 191 B 95 % CI 191–191 | 191–191 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.56 runnable tasks 95 % CI 5.35–6.97 | 5.35–6.97 | 5 | 5 / 15 |
| CPU clock | 2,595 MHz 95 % CI 2,485–3,133 | 2,485–3,133 | 5 | — |
| Load generator CPU | 0.10 95 % CI 0.10–0.10 | 0.10–0.10 | 5 | 2 / 15 |
Fixed rate
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 4,999 req/s 95 % CI 4,999–4,999 | 4,999–4,999 | 5 | 2 / 15 |
| Latency p99 | 7.78 ms 95 % CI 7.57–8.27 | 7.57–8.27 | 5 | 13 / 15 |
| CPU per request | 241.5 µs 95 % CI 233.6–242.2 | 233.6–242.2 | 5 | 11 / 15 |
| Memory under load (PSS) | 133.2 MiB 95 % CI 132.3–133.8 | 132.3–133.8 | 5 | 8 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.07 ms 95 % CI 0.99–1.08 | 0.99–1.08 | 5 | 13 / 15 |
| Latency p90 | 2.74 ms 95 % CI 2.57–2.82 | 2.57–2.82 | 5 | 13 / 15 |
| Latency p99.9 | 12.03 ms 95 % CI 10.34–13.05 | 10.34–13.05 | 5 | 11 / 15 |
| Latency p75 | 1.51 ms 95 % CI 1.44–1.51 | 1.44–1.51 | 5 | 12 / 15 |
| Latency p99.99 | 15.81 ms 95 % CI 13.60–18.47 | 13.60–18.47 | 5 | 8 / 15 |
| Latency mean | 1.48 ms 95 % CI 1.42–1.52 | 1.42–1.52 | 5 | 13 / 15 |
| Latency max | 17.96 ms 95 % CI 14.98–23.52 | 14.98–23.52 | 5 | 9 / 15 |
| CPU | ||||
| CPU used | 1.20 cores 95 % CI 1.16–1.21 | 1.16–1.21 | 5 | — |
| User-space CPU share | 0.655 95 % CI 0.640–0.671 | 0.640–0.671 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 71.8 MiB 95 % CI 71.0–73.1 | 71.0–73.1 | 5 | 8 / 15 |
| Database | ||||
| Database CPU per request | 112.6 µs 95 % CI 102.9–113.7 | 102.9–113.7 | 5 | 1 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 455.5 J 95 % CI 444.6–560.3 | 444.6–560.3 | 5 | — |
| Package energy per request | 4.555 mJ 95 % CI 4.446–5.603 | 4.446–5.603 | 5 | 12 / 15 |
| Network | ||||
| Bytes per response | 30 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.00 runnable tasks 95 % CI 4.77–6.17 | 4.77–6.17 | 5 | 3 / 15 |
| CPU clock | 1,953 MHz 95 % CI 1,898–2,182 | 1,898–2,182 | 5 | — |
| Load generator CPU | 0.13 95 % CI 0.12–0.13 | 0.12–0.13 | 5 | 3 / 15 |