Overall
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 14.1 | — | — | 15 / 15 |
| CPU efficiency index | 12.5 | — | — | 15 / 15 |
| Peak memory | 141.6 MiB | — | — | 7 / 15 |
FastAPI with Pydantic validation on uvicorn (uvloop, httptools) and asyncpg.
Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.
Derived
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput index | 14.1 | — | — | 15 / 15 |
| CPU efficiency index | 12.5 | — | — | 15 / 15 |
| Peak memory | 141.6 MiB | — | — | 7 / 15 |
Start-up
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Cold start | 1,274 ms 95 % CI 1,260–1,279 | 1,260–1,279 | 5 | 13 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Memory | ||||
| Memory at idle | 126.8 MiB 95 % CI 126.6–129.1 | 126.6–129.1 | 5 | 11 / 15 |
| Anonymous memory at idle | 108.6 MiB 95 % CI 108.5–111.2 | 108.5–111.2 | 5 | 13 / 15 |
| Start-up | ||||
| Cold start (fastest) | 1,250 ms 95 % CI 1,232–1,252 | 1,232–1,252 | 5 | 13 / 15 |
| Cold start (slowest) | 1,299 ms 95 % CI 1,276–1,310 | 1,276–1,310 | 5 | 13 / 15 |
| Footprint | ||||
| Image size | 258 MB | — | 5 | 7 / 15 |
Cold load
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 8,620 req/s 95 % CI 8,103–8,735 | 8,103–8,735 | 5 | 13 / 15 |
| Latency p99 | 30.83 ms 95 % CI 26.12–39.95 | 26.12–39.95 | 5 | 9 / 15 |
| CPU per request | 231.5 µs 95 % CI 228.6–246.1 | 228.6–246.1 | 5 | 13 / 15 |
| Memory under load (PSS) | 129.4 MiB 95 % CI 129.3–131.4 | 129.3–131.4 | 5 | 9 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 15.67 ms 95 % CI 14.30–15.75 | 14.30–15.75 | 5 | 15 / 15 |
| Latency p90 | 17.61 ms 95 % CI 15.56–19.32 | 15.56–19.32 | 5 | 12 / 15 |
| Latency p99.9 | 53.77 ms 95 % CI 47.63–63.43 | 47.63–63.43 | 5 | 7 / 15 |
| Latency p75 | 16.26 ms 95 % CI 14.93–16.44 | 14.93–16.44 | 5 | 12 / 15 |
| Latency p99.99 | 72.84 ms 95 % CI 65.13–81.17 | 65.13–81.17 | 5 | 8 / 15 |
| Latency mean | 14.85 ms 95 % CI 14.64–15.95 | 14.64–15.95 | 5 | 13 / 15 |
| Latency std. dev. | 3.99 ms 95 % CI 3.02–6.46 | 3.02–6.46 | 5 | 7 / 15 |
| Latency max | 87.18 ms 95 % CI 77.51–88.67 | 77.51–88.67 | 5 | 8 / 15 |
| CPU | ||||
| CPU used | 1.99 cores 95 % CI 1.99–1.99 | 1.99–1.99 | 5 | — |
| User-space CPU share | 0.858 95 % CI 0.857–0.859 | 0.857–0.859 | 5 | — |
| CPU throttling | 15.5 ms 95 % CI 6.7–19.4 | 6.7–19.4 | 5 | 14 / 15 |
| Memory | ||||
| Anonymous memory peak | 111.5 MiB 95 % CI 111.5–113.7 | 111.5–113.7 | 5 | 10 / 15 |
| Database | ||||
| Database CPU per request | 186.9 µs 95 % CI 171.2–230.5 | 171.2–230.5 | 5 | 15 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Start-up | ||||
| Cold vs. warm throughput | 1.05 95 % CI 0.98–1.08 | 0.98–1.08 | 5 | 2 / 15 |
| Energy | ||||
| CPU package energy | 495.5 J 95 % CI 474.9–508.8 | 474.9–508.8 | 5 | — |
| Package energy per request | 5.831 mJ 95 % CI 5.699–5.844 | 5.699–5.844 | 5 | 14 / 15 |
| Network | ||||
| Bytes per response | 156 B 95 % CI 156–156 | 156–156 | 5 | — |
| Disk I/O | ||||
| Disk writes | 3,576 KiB 95 % CI 0–3,848 | 0–3,848 | 5 | 15 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 5.08 runnable tasks 95 % CI 2.86–5.49 | 2.86–5.49 | 5 | 13 / 15 |
| CPU clock | 3,540 MHz 95 % CI 3,380–3,540 | 3,380–3,540 | 5 | — |
| Load generator CPU | 0.11 95 % CI 0.11–0.11 | 0.11–0.11 | 5 | 4 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 18,476 req/s 95 % CI 17,944–18,930 | 17,944–18,930 | 5 | 15 / 15 |
| Latency p99 | 13.11 ms 95 % CI 12.43–13.60 | 12.43–13.60 | 5 | 14 / 15 |
| CPU per request | 108.2 µs 95 % CI 105.6–111.4 | 105.6–111.4 | 5 | 15 / 15 |
| Memory under load (PSS) | 132.4 MiB 95 % CI 132.1–133.5 | 132.1–133.5 | 5 | 10 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 6.95 ms 95 % CI 6.56–7.03 | 6.56–7.03 | 5 | 15 / 15 |
| Latency p90 | 7.24 ms 95 % CI 6.87–7.33 | 6.87–7.33 | 5 | 14 / 15 |
| Latency p99.9 | 58.23 ms 95 % CI 50.61–82.64 | 50.61–82.64 | 5 | 15 / 15 |
| Latency p75 | 7.06 ms 95 % CI 6.63–7.14 | 6.63–7.14 | 5 | 15 / 15 |
| Latency p99.99 | 132.36 ms 95 % CI 121.40–153.62 | 121.40–153.62 | 5 | 15 / 15 |
| Latency mean | 7.00 ms 95 % CI 6.89–7.22 | 6.89–7.22 | 5 | 15 / 15 |
| Latency std. dev. | 3.14 ms 95 % CI 2.86–4.13 | 2.86–4.13 | 5 | 15 / 15 |
| Latency max | 161.20 ms 95 % CI 154.35–184.06 | 154.35–184.06 | 5 | 15 / 15 |
| CPU | ||||
| CPU used | 2.00 cores 95 % CI 1.99–2.00 | 1.99–2.00 | 5 | — |
| User-space CPU share | 0.884 95 % CI 0.881–0.888 | 0.881–0.888 | 5 | — |
| CPU throttling | 14.4 ms 95 % CI 7.3–26.6 | 7.3–26.6 | 5 | 11 / 15 |
| Memory | ||||
| Anonymous memory peak | 114.5 MiB 95 % CI 114.2–115.8 | 114.2–115.8 | 5 | 10 / 15 |
| Database | ||||
| Database CPU per request | < 0.1 µs 95 % CI < 0.1–0.1 | < 0.1–0.1 | 5 | 13 / 15 |
| Energy | ||||
| CPU package energy | 717.1 J 95 % CI 703.5–728.5 | 703.5–728.5 | 5 | — |
| Package energy per request | 2.586 mJ 95 % CI 2.561–2.614 | 2.561–2.614 | 5 | 15 / 15 |
| Network | ||||
| Bytes per response | 152 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.65 runnable tasks 95 % CI 3.29–5.20 | 3.29–5.20 | 5 | 1 / 15 |
| CPU clock | 3,667 MHz 95 % CI 3,570–3,727 | 3,570–3,727 | 5 | — |
| Load generator CPU | 0.23 95 % CI 0.22–0.24 | 0.22–0.24 | 5 | 1 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 8,168 req/s 95 % CI 8,027–8,335 | 8,027–8,335 | 5 | 15 / 15 |
| Latency p99 | 40.55 ms 95 % CI 39.96–41.33 | 39.96–41.33 | 5 | 15 / 15 |
| CPU per request | 244.7 µs 95 % CI 239.9–249.0 | 239.9–249.0 | 5 | 15 / 15 |
| Memory under load (PSS) | 132.6 MiB 95 % CI 132.3–133.7 | 132.3–133.7 | 5 | 9 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 15.53 ms 95 % CI 15.29–15.81 | 15.29–15.81 | 5 | 15 / 15 |
| Latency p90 | 26.23 ms 95 % CI 25.35–27.03 | 25.35–27.03 | 5 | 15 / 15 |
| Latency p99.9 | 55.31 ms 95 % CI 53.85–56.35 | 53.85–56.35 | 5 | 14 / 15 |
| Latency p75 | 16.73 ms 95 % CI 16.13–16.95 | 16.13–16.95 | 5 | 14 / 15 |
| Latency p99.99 | 70.26 ms 95 % CI 66.72–76.52 | 66.72–76.52 | 5 | 14 / 15 |
| Latency mean | 15.85 ms 95 % CI 15.52–16.10 | 15.52–16.10 | 5 | 15 / 15 |
| Latency std. dev. | 7.18 ms 95 % CI 6.97–7.39 | 6.97–7.39 | 5 | 14 / 15 |
| Latency max | 95.85 ms 95 % CI 83.41–112.72 | 83.41–112.72 | 5 | 14 / 15 |
| CPU | ||||
| CPU used | 2.00 cores 95 % CI 2.00–2.00 | 2.00–2.00 | 5 | — |
| User-space CPU share | 0.858 95 % CI 0.856–0.862 | 0.856–0.862 | 5 | — |
| CPU throttling | 30.1 ms 95 % CI 9.9–41.3 | 9.9–41.3 | 5 | 15 / 15 |
| Memory | ||||
| Anonymous memory peak | 114.5 MiB 95 % CI 114.2–115.8 | 114.2–115.8 | 5 | 10 / 15 |
| Database | ||||
| Database CPU per request | 250.7 µs 95 % CI 243.1–251.7 | 243.1–251.7 | 5 | 15 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 727.6 J 95 % CI 721.2–736.6 | 721.2–736.6 | 5 | — |
| Package energy per request | 5.905 mJ 95 % CI 5.878–6.007 | 5.878–6.007 | 5 | 15 / 15 |
| Network | ||||
| Bytes per response | 156 B 95 % CI 156–156 | 156–156 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.36 runnable tasks 95 % CI 3.29–4.57 | 3.29–4.57 | 5 | 1 / 15 |
| CPU clock | 3,613 MHz 95 % CI 3,440–3,627 | 3,440–3,627 | 5 | — |
| Load generator CPU | 0.11 95 % CI 0.11–0.11 | 0.11–0.11 | 5 | 2 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 2,158 req/s 95 % CI 2,123–2,208 | 2,123–2,208 | 5 | 15 / 15 |
| Latency p99 | 102.10 ms 95 % CI 101.09–106.45 | 101.09–106.45 | 5 | 13 / 15 |
| CPU per request | 925.7 µs 95 % CI 906.2–941.0 | 906.2–941.0 | 5 | 15 / 15 |
| Memory under load (PSS) | 132.6 MiB 95 % CI 132.3–133.7 | 132.3–133.7 | 5 | 9 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 58.28 ms 95 % CI 57.23–60.38 | 57.23–60.38 | 5 | 15 / 15 |
| Latency p90 | 63.09 ms 95 % CI 60.03–64.17 | 60.03–64.17 | 5 | 14 / 15 |
| Latency p99.9 | 118.17 ms 95 % CI 112.31–125.36 | 112.31–125.36 | 5 | 12 / 15 |
| Latency p75 | 61.24 ms 95 % CI 58.29–61.70 | 58.29–61.70 | 5 | 14 / 15 |
| Latency p99.99 | 156.60 ms 95 % CI 145.78–165.93 | 145.78–165.93 | 5 | 12 / 15 |
| Latency mean | 59.09 ms 95 % CI 57.63–60.07 | 57.63–60.07 | 5 | 15 / 15 |
| Latency std. dev. | 8.67 ms 95 % CI 8.06–9.83 | 8.06–9.83 | 5 | 11 / 15 |
| Latency max | 170.52 ms 95 % CI 157.03–201.49 | 157.03–201.49 | 5 | 12 / 15 |
| CPU | ||||
| CPU used | 2.00 cores 95 % CI 1.99–2.00 | 1.99–2.00 | 5 | — |
| User-space CPU share | 0.792 95 % CI 0.789–0.794 | 0.789–0.794 | 5 | — |
| CPU throttling | 22.5 ms 95 % CI 9.9–32.5 | 9.9–32.5 | 5 | 14 / 15 |
| Memory | ||||
| Anonymous memory peak | 114.5 MiB 95 % CI 114.3–115.8 | 114.3–115.8 | 5 | 10 / 15 |
| Database | ||||
| Database CPU per request | 1,078.0 µs 95 % CI 1,062.8–1,100.4 | 1,062.8–1,100.4 | 5 | 15 / 15 |
| SELECTs per request | 20.08 queries 95 % CI 20.08–20.08 | 20.08–20.08 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 819.1 J 95 % CI 804.7–861.9 | 804.7–861.9 | 5 | — |
| Package energy per request | 25.062 mJ 95 % CI 24.763–26.555 | 24.763–26.555 | 5 | 15 / 15 |
| Network | ||||
| Bytes per response | 763 B 95 % CI 763–763 | 763–763 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.03 runnable tasks 95 % CI 3.37–4.23 | 3.37–4.23 | 5 | 1 / 15 |
| CPU clock | 3,627 MHz 95 % CI 3,480–3,627 | 3,480–3,627 | 5 | — |
| Load generator CPU | 0.03 95 % CI 0.03–0.03 | 0.03–0.03 | 5 | 1 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 3,506 req/s 95 % CI 3,369–3,546 | 3,369–3,546 | 5 | 15 / 15 |
| Latency p99 | 66.27 ms 95 % CI 63.20–67.42 | 63.20–67.42 | 5 | 12 / 15 |
| CPU per request | 570.3 µs 95 % CI 564.1–592.9 | 564.1–592.9 | 5 | 15 / 15 |
| Memory under load (PSS) | 132.6 MiB 95 % CI 132.3–133.7 | 132.3–133.7 | 5 | 9 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 36.30 ms 95 % CI 35.78–37.28 | 35.78–37.28 | 5 | 15 / 15 |
| Latency p90 | 39.07 ms 95 % CI 37.54–40.48 | 37.54–40.48 | 5 | 13 / 15 |
| Latency p99.9 | 72.85 ms 95 % CI 70.30–75.06 | 70.30–75.06 | 5 | 12 / 15 |
| Latency p75 | 37.26 ms 95 % CI 36.44–39.57 | 36.44–39.57 | 5 | 14 / 15 |
| Latency p99.99 | 98.13 ms 95 % CI 96.88–102.46 | 96.88–102.46 | 5 | 12 / 15 |
| Latency mean | 36.42 ms 95 % CI 36.02–37.87 | 36.02–37.87 | 5 | 15 / 15 |
| Latency std. dev. | 5.98 ms 95 % CI 5.75–6.31 | 5.75–6.31 | 5 | 12 / 15 |
| Latency max | 126.54 ms 95 % CI 100.90–135.99 | 100.90–135.99 | 5 | 12 / 15 |
| CPU | ||||
| CPU used | 2.00 cores 95 % CI 1.99–2.00 | 1.99–2.00 | 5 | — |
| User-space CPU share | 0.816 95 % CI 0.815–0.819 | 0.815–0.819 | 5 | — |
| CPU throttling | 19.6 ms 95 % CI 7.2–33.5 | 7.2–33.5 | 5 | 13 / 15 |
| Memory | ||||
| Anonymous memory peak | 114.5 MiB 95 % CI 114.3–115.8 | 114.3–115.8 | 5 | 10 / 15 |
| Database | ||||
| Database CPU per request | 555.4 µs 95 % CI 546.0–561.0 | 546.0–561.0 | 5 | 14 / 15 |
| SELECTs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| UPDATEs per request | 5.01 queries 95 % CI 5.01–5.01 | 5.01–5.01 | 5 | — |
| Energy | ||||
| CPU package energy | 890.0 J 95 % CI 874.1–892.7 | 874.1–892.7 | 5 | — |
| Package energy per request | 16.932 mJ 95 % CI 16.711–17.253 | 16.711–17.253 | 5 | 15 / 15 |
| Network | ||||
| Bytes per response | 286 B 95 % CI 286–286 | 286–286 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.33 runnable tasks 95 % CI 4.06–4.75 | 4.06–4.75 | 5 | 1 / 15 |
| CPU clock | 3,627 MHz 95 % CI 3,507–3,627 | 3,507–3,627 | 5 | — |
| Load generator CPU | 0.05 95 % CI 0.05–0.05 | 0.05–0.05 | 5 | 1 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 2,071 req/s 95 % CI 2,009–2,092 | 2,009–2,092 | 5 | 15 / 15 |
| Latency p99 | 162.69 ms 95 % CI 155.68–177.89 | 155.68–177.89 | 5 | 15 / 15 |
| CPU per request | 965.3 µs 95 % CI 956.5–995.4 | 956.5–995.4 | 5 | 15 / 15 |
| Memory under load (PSS) | 132.6 MiB 95 % CI 132.3–133.7 | 132.3–133.7 | 5 | 9 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 61.71 ms 95 % CI 61.02–62.37 | 61.02–62.37 | 5 | 15 / 15 |
| Latency p90 | 107.88 ms 95 % CI 106.07–108.70 | 106.07–108.70 | 5 | 15 / 15 |
| Latency p99.9 | 245.24 ms 95 % CI 215.55–260.20 | 215.55–260.20 | 5 | 15 / 15 |
| Latency p75 | 65.42 ms 95 % CI 62.99–68.61 | 62.99–68.61 | 5 | 15 / 15 |
| Latency p99.99 | 302.38 ms 95 % CI 259.86–349.60 | 259.86–349.60 | 5 | 15 / 15 |
| Latency mean | 62.39 ms 95 % CI 62.23–64.67 | 62.23–64.67 | 5 | 15 / 15 |
| Latency std. dev. | 31.76 ms 95 % CI 30.13–33.16 | 30.13–33.16 | 5 | 15 / 15 |
| Latency max | 393.00 ms 95 % CI 291.36–402.22 | 291.36–402.22 | 5 | 15 / 15 |
| CPU | ||||
| CPU used | 2.00 cores 95 % CI 2.00–2.00 | 2.00–2.00 | 5 | — |
| User-space CPU share | 0.957 95 % CI 0.957–0.960 | 0.957–0.960 | 5 | — |
| CPU throttling | 20.1 ms 95 % CI 8.1–33.7 | 8.1–33.7 | 5 | 13 / 15 |
| Memory | ||||
| Anonymous memory peak | 114.5 MiB 95 % CI 114.3–115.8 | 114.3–115.8 | 5 | 9 / 15 |
| Database | ||||
| Database CPU per request | 406.1 µs 95 % CI 385.9–408.5 | 385.9–408.5 | 5 | 15 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 743.3 J 95 % CI 729.4–748.7 | 729.4–748.7 | 5 | — |
| Package energy per request | 23.961 mJ 95 % CI 23.670–24.159 | 23.670–24.159 | 5 | 15 / 15 |
| Network | ||||
| Bytes per response | 4,757 B 95 % CI 4,757–4,757 | 4,757–4,757 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.32 runnable tasks 95 % CI 3.80–4.95 | 3.80–4.95 | 5 | 1 / 15 |
| CPU clock | 3,627 MHz 95 % CI 3,520–3,627 | 3,520–3,627 | 5 | — |
| Load generator CPU | 0.03 95 % CI 0.03–0.03 | 0.03–0.03 | 5 | 1 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 7,519 req/s 95 % CI 7,323–7,615 | 7,323–7,615 | 5 | 14 / 15 |
| Latency p99 | 33.22 ms 95 % CI 32.01–33.84 | 32.01–33.84 | 5 | 14 / 15 |
| CPU per request | 266.0 µs 95 % CI 262.8–273.3 | 262.8–273.3 | 5 | 14 / 15 |
| Memory under load (PSS) | 132.6 MiB 95 % CI 132.3–133.7 | 132.3–133.7 | 5 | 10 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 16.82 ms 95 % CI 16.71–16.91 | 16.71–16.91 | 5 | 14 / 15 |
| Latency p90 | 17.56 ms 95 % CI 17.22–19.14 | 17.22–19.14 | 5 | 14 / 15 |
| Latency p99.9 | 319.33 ms 95 % CI 297.91–349.59 | 297.91–349.59 | 5 | 15 / 15 |
| Latency p75 | 17.12 ms 95 % CI 16.87–18.93 | 16.87–18.93 | 5 | 14 / 15 |
| Latency p99.99 | 440.61 ms 95 % CI 417.24–473.55 | 417.24–473.55 | 5 | 15 / 15 |
| Latency mean | 18.17 ms 95 % CI 17.87–18.56 | 17.87–18.56 | 5 | 14 / 15 |
| Latency std. dev. | 17.31 ms 95 % CI 15.60–19.66 | 15.60–19.66 | 5 | 15 / 15 |
| Latency max | 480.68 ms 95 % CI 459.56–519.43 | 459.56–519.43 | 5 | 15 / 15 |
| CPU | ||||
| CPU used | 2.00 cores 95 % CI 1.99–2.00 | 1.99–2.00 | 5 | — |
| User-space CPU share | 0.936 95 % CI 0.935–0.938 | 0.935–0.938 | 5 | — |
| CPU throttling | 16.7 ms 95 % CI 6.7–31.3 | 6.7–31.3 | 5 | 12 / 15 |
| Memory | ||||
| Anonymous memory peak | 114.5 MiB 95 % CI 114.3–115.8 | 114.3–115.8 | 5 | 11 / 15 |
| Database | ||||
| Database CPU per request | 0.1 µs 95 % CI < 0.1–0.2 | < 0.1–0.2 | 5 | 12 / 15 |
| Energy | ||||
| CPU package energy | 713.9 J 95 % CI 700.5–720.3 | 700.5–720.3 | 5 | — |
| Package energy per request | 6.357 mJ 95 % CI 6.268–6.375 | 6.268–6.375 | 5 | 14 / 15 |
| Network | ||||
| Bytes per response | 195 B 95 % CI 195–195 | 195–195 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.07 runnable tasks 95 % CI 3.35–4.13 | 3.35–4.13 | 5 | 1 / 15 |
| CPU clock | 3,687 MHz 95 % CI 3,590–3,707 | 3,590–3,707 | 5 | — |
| Load generator CPU | 0.10 95 % CI 0.09–0.10 | 0.09–0.10 | 5 | 2 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 8,029 req/s 95 % CI 7,634–8,297 | 7,634–8,297 | 5 | 15 / 15 |
| Latency p99 | 3.06 ms 95 % CI 2.82–3.42 | 2.82–3.42 | 5 | 11 / 15 |
| CPU per request | 248.7 µs 95 % CI 241.0–261.6 | 241.0–261.6 | 5 | 15 / 15 |
| Memory under load (PSS) | 132.6 MiB 95 % CI 132.3–133.7 | 132.3–133.7 | 5 | 10 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.94 ms 95 % CI 1.88–1.99 | 1.88–1.99 | 5 | 15 / 15 |
| Latency p90 | 2.27 ms 95 % CI 2.11–2.84 | 2.11–2.84 | 5 | 14 / 15 |
| Latency p99.9 | 3.86 ms 95 % CI 3.61–4.56 | 3.61–4.56 | 5 | 9 / 15 |
| Latency p75 | 2.14 ms 95 % CI 1.99–2.71 | 1.99–2.71 | 5 | 14 / 15 |
| Latency p99.99 | 6.87 ms 95 % CI 4.87–7.45 | 4.87–7.45 | 5 | 7 / 15 |
| Latency mean | 1.98 ms 95 % CI 1.92–2.08 | 1.92–2.08 | 5 | 15 / 15 |
| Latency std. dev. | 0.29 ms 95 % CI 0.23–0.61 | 0.23–0.61 | 5 | 9 / 15 |
| Latency max | 9.53 ms 95 % CI 6.34–12.71 | 6.34–12.71 | 5 | 7 / 15 |
| CPU | ||||
| CPU used | 2.00 cores 95 % CI 1.99–2.00 | 1.99–2.00 | 5 | — |
| User-space CPU share | 0.864 95 % CI 0.862–0.870 | 0.862–0.870 | 5 | — |
| CPU throttling | 17.1 ms 95 % CI 10.9–25.7 | 10.9–25.7 | 5 | 12 / 15 |
| Memory | ||||
| Anonymous memory peak | 114.5 MiB 95 % CI 114.3–115.8 | 114.3–115.8 | 5 | 11 / 15 |
| Database | ||||
| Database CPU per request | 243.6 µs 95 % CI 209.9–250.2 | 209.9–250.2 | 5 | 15 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 732.8 J 95 % CI 716.1–747.7 | 716.1–747.7 | 5 | — |
| Package energy per request | 6.028 mJ 95 % CI 5.968–6.213 | 5.968–6.213 | 5 | 15 / 15 |
| Network | ||||
| Bytes per response | 156 B 95 % CI 156–156 | 156–156 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 3.75 runnable tasks 95 % CI 3.21–3.95 | 3.21–3.95 | 5 | 1 / 15 |
| CPU clock | 3,600 MHz 95 % CI 3,521–3,627 | 3,521–3,627 | 5 | — |
| Load generator CPU | 0.10 95 % CI 0.10–0.11 | 0.10–0.11 | 5 | 2 / 15 |
Closed loop
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 7,657 req/s 95 % CI 7,477–7,724 | 7,477–7,724 | 5 | 14 / 15 |
| Latency p99 | 189.02 ms 95 % CI 183.94–190.60 | 183.94–190.60 | 5 | 14 / 15 |
| CPU per request | 260.9 µs 95 % CI 258.8–267.3 | 258.8–267.3 | 5 | 15 / 15 |
| Memory under load (PSS) | 141.6 MiB 95 % CI 141.5–142.2 | 141.5–142.2 | 5 | 7 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 66.02 ms 95 % CI 65.59–68.08 | 65.59–68.08 | 5 | 14 / 15 |
| Latency p90 | 124.69 ms 95 % CI 122.06–125.61 | 122.06–125.61 | 5 | 14 / 15 |
| Latency p99.9 | 255.27 ms 95 % CI 253.57–256.84 | 253.57–256.84 | 5 | 14 / 15 |
| Latency p75 | 68.75 ms 95 % CI 67.51–73.90 | 67.51–73.90 | 5 | 14 / 15 |
| Latency p99.99 | 321.67 ms 95 % CI 319.70–353.08 | 319.70–353.08 | 5 | 14 / 15 |
| Latency mean | 67.57 ms 95 % CI 67.03–69.40 | 67.03–69.40 | 5 | 14 / 15 |
| Latency std. dev. | 35.07 ms 95 % CI 34.98–35.78 | 34.98–35.78 | 5 | 14 / 15 |
| Latency max | 422.46 ms 95 % CI 378.78–492.16 | 378.78–492.16 | 5 | 14 / 15 |
| CPU | ||||
| CPU used | 1.99 cores 95 % CI 1.99–1.99 | 1.99–1.99 | 5 | — |
| User-space CPU share | 0.853 95 % CI 0.852–0.859 | 0.852–0.859 | 5 | — |
| CPU throttling | 17.2 ms 95 % CI 7.7–27.3 | 7.7–27.3 | 5 | 11 / 15 |
| Memory | ||||
| Anonymous memory peak | 123.6 MiB 95 % CI 123.3–124.1 | 123.3–124.1 | 5 | 10 / 15 |
| Database | ||||
| Database CPU per request | 263.0 µs 95 % CI 261.8–263.1 | 261.8–263.1 | 5 | 15 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 725.0 J 95 % CI 705.3–727.8 | 705.3–727.8 | 5 | — |
| Package energy per request | 6.266 mJ 95 % CI 6.253–6.351 | 6.253–6.351 | 5 | 14 / 15 |
| Network | ||||
| Bytes per response | 156 B 95 % CI 156–156 | 156–156 | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.06 runnable tasks 95 % CI 3.36–4.32 | 3.36–4.32 | 5 | 1 / 15 |
| CPU clock | 3,560 MHz 95 % CI 3,453–3,627 | 3,453–3,627 | 5 | — |
| Load generator CPU | 0.10 95 % CI 0.10–0.11 | 0.10–0.11 | 5 | 3 / 15 |
Fixed rate
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | 5,000 req/s 95 % CI 4,999–5,000 | 4,999–5,000 | 5 | 1 / 15 |
| Latency p99 | 14.19 ms 95 % CI 13.85–21.94 | 13.85–21.94 | 5 | 14 / 15 |
| CPU per request | 294.2 µs 95 % CI 292.9–300.3 | 292.9–300.3 | 5 | 15 / 15 |
| Memory under load (PSS) | 141.6 MiB 95 % CI 141.5–142.2 | 141.5–142.2 | 5 | 9 / 15 |
| Metric | Median | 95 % CI | n | Rank |
|---|---|---|---|---|
| Throughput | ||||
| Errors | 0 requests | — | 5 | 1 / 15 |
| Error rate | 0.0000 | — | 5 | 1 / 15 |
| Latency | ||||
| Latency p50 | 1.33 ms 95 % CI 1.28–1.42 | 1.28–1.42 | 5 | 15 / 15 |
| Latency p90 | 7.07 ms 95 % CI 6.37–7.91 | 6.37–7.91 | 5 | 15 / 15 |
| Latency p99.9 | 20.02 ms 95 % CI 19.39–43.67 | 19.39–43.67 | 5 | 13 / 15 |
| Latency p75 | 2.17 ms 95 % CI 2.09–2.73 | 2.09–2.73 | 5 | 15 / 15 |
| Latency p99.99 | 24.84 ms 95 % CI 24.32–50.79 | 24.32–50.79 | 5 | 12 / 15 |
| Latency mean | 2.62 ms 95 % CI 2.51–2.79 | 2.51–2.79 | 5 | 14 / 15 |
| Latency max | 30.59 ms 95 % CI 29.39–68.47 | 29.39–68.47 | 5 | 12 / 15 |
| CPU | ||||
| CPU used | 1.47 cores 95 % CI 1.46–1.50 | 1.46–1.50 | 5 | — |
| User-space CPU share | 0.865 95 % CI 0.845–0.885 | 0.845–0.885 | 5 | — |
| CPU throttling | 0.0 ms | — | 5 | 1 / 15 |
| Memory | ||||
| Anonymous memory peak | 123.6 MiB 95 % CI 123.3–124.1 | 123.3–124.1 | 5 | 11 / 15 |
| Database | ||||
| Database CPU per request | 243.8 µs 95 % CI 222.3–244.9 | 222.3–244.9 | 5 | 15 / 15 |
| SELECTs per request | 1.00 queries 95 % CI 1.00–1.00 | 1.00–1.00 | 5 | — |
| UPDATEs per request | 0.00 queries | — | 5 | — |
| Energy | ||||
| CPU package energy | 811.7 J 95 % CI 805.1–814.7 | 805.1–814.7 | 5 | — |
| Package energy per request | 8.118 mJ 95 % CI 8.052–8.147 | 8.052–8.147 | 5 | 15 / 15 |
| Network | ||||
| Bytes per response | 30 B | — | 5 | — |
| Disk I/O | ||||
| Disk writes | 0 KiB | — | 5 | 1 / 15 |
| Measurement quality | ||||
| Hypervisor steal | 0.0 % | — | 5 | 1 / 15 |
| Host load | 4.29 runnable tasks 95 % CI 3.34–4.74 | 3.34–4.74 | 5 | 1 / 15 |
| CPU clock | 3,399 MHz 95 % CI 3,334–3,488 | 3,334–3,488 | 5 | — |
| Load generator CPU | 0.14 95 % CI 0.14–0.14 | 0.14–0.14 | 5 | 8 / 15 |