Python · FastAPI

FastAPI with Pydantic validation on uvicorn (uvloop, httptools) and asyncpg.

  • Language Python
  • RuntimeCPython
  • FrameworkFastAPI
  • CategoryFramework

Headline results

All results

Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.

Overall

Derived

Metric Median 95 % CI n Rank
Throughput index 14.1 — — 15 / 15
CPU efficiency index 12.5 — — 15 / 15
Peak memory 141.6 MiB — — 7 / 15

Cold start

Start-up

  • GET /json
Metric Median 95 % CI n Rank
Cold start 1,274 ms 95 % CI 1,260–1,279 1,260–1,279 5 13 / 15
5 more metrics
Metric Median 95 % CI n Rank
Memory
Memory at idle 126.8 MiB 95 % CI 126.6–129.1 126.6–129.1 5 11 / 15
Anonymous memory at idle 108.6 MiB 95 % CI 108.5–111.2 108.5–111.2 5 13 / 15
Start-up
Cold start (fastest) 1,250 ms 95 % CI 1,232–1,252 1,232–1,252 5 13 / 15
Cold start (slowest) 1,299 ms 95 % CI 1,276–1,310 1,276–1,310 5 13 / 15
Footprint
Image size 258 MB — 5 7 / 15

Cold load

Cold load

  • GET /db
  • 128 connections
  • 10s measured
  • 1 SELECT per request
  • compared with Single query
Metric Median 95 % CI n Rank
Throughput 8,620 req/s 95 % CI 8,103–8,735 8,103–8,735 5 13 / 15
Latency p99 30.83 ms 95 % CI 26.12–39.95 26.12–39.95 5 9 / 15
CPU per request 231.5 µs 95 % CI 228.6–246.1 228.6–246.1 5 13 / 15
Memory under load (PSS) 129.4 MiB 95 % CI 129.3–131.4 129.3–131.4 5 9 / 15
26 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 15.67 ms 95 % CI 14.30–15.75 14.30–15.75 5 15 / 15
Latency p90 17.61 ms 95 % CI 15.56–19.32 15.56–19.32 5 12 / 15
Latency p99.9 53.77 ms 95 % CI 47.63–63.43 47.63–63.43 5 7 / 15
Latency p75 16.26 ms 95 % CI 14.93–16.44 14.93–16.44 5 12 / 15
Latency p99.99 72.84 ms 95 % CI 65.13–81.17 65.13–81.17 5 8 / 15
Latency mean 14.85 ms 95 % CI 14.64–15.95 14.64–15.95 5 13 / 15
Latency std. dev. 3.99 ms 95 % CI 3.02–6.46 3.02–6.46 5 7 / 15
Latency max 87.18 ms 95 % CI 77.51–88.67 77.51–88.67 5 8 / 15
CPU
CPU used 1.99 cores 95 % CI 1.99–1.99 1.99–1.99 5 —
User-space CPU share 0.858 95 % CI 0.857–0.859 0.857–0.859 5 —
CPU throttling 15.5 ms 95 % CI 6.7–19.4 6.7–19.4 5 14 / 15
Memory
Anonymous memory peak 111.5 MiB 95 % CI 111.5–113.7 111.5–113.7 5 10 / 15
Database
Database CPU per request 186.9 µs 95 % CI 171.2–230.5 171.2–230.5 5 15 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Start-up
Cold vs. warm throughput 1.05 95 % CI 0.98–1.08 0.98–1.08 5 2 / 15
Energy
CPU package energy 495.5 J 95 % CI 474.9–508.8 474.9–508.8 5 —
Package energy per request 5.831 mJ 95 % CI 5.699–5.844 5.699–5.844 5 14 / 15
Network
Bytes per response 156 B 95 % CI 156–156 156–156 5 —
Disk I/O
Disk writes 3,576 KiB 95 % CI 0–3,848 0–3,848 5 15 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 5.08 runnable tasks 95 % CI 2.86–5.49 2.86–5.49 5 13 / 15
CPU clock 3,540 MHz 95 % CI 3,380–3,540 3,380–3,540 5 —
Load generator CPU 0.11 95 % CI 0.11–0.11 0.11–0.11 5 4 / 15

JSON

Closed loop

  • GET /json
Metric Median 95 % CI n Rank
Throughput 18,476 req/s 95 % CI 17,944–18,930 17,944–18,930 5 15 / 15
Latency p99 13.11 ms 95 % CI 12.43–13.60 12.43–13.60 5 14 / 15
CPU per request 108.2 µs 95 % CI 105.6–111.4 105.6–111.4 5 15 / 15
Memory under load (PSS) 132.4 MiB 95 % CI 132.1–133.5 132.1–133.5 5 10 / 15
23 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 6.95 ms 95 % CI 6.56–7.03 6.56–7.03 5 15 / 15
Latency p90 7.24 ms 95 % CI 6.87–7.33 6.87–7.33 5 14 / 15
Latency p99.9 58.23 ms 95 % CI 50.61–82.64 50.61–82.64 5 15 / 15
Latency p75 7.06 ms 95 % CI 6.63–7.14 6.63–7.14 5 15 / 15
Latency p99.99 132.36 ms 95 % CI 121.40–153.62 121.40–153.62 5 15 / 15
Latency mean 7.00 ms 95 % CI 6.89–7.22 6.89–7.22 5 15 / 15
Latency std. dev. 3.14 ms 95 % CI 2.86–4.13 2.86–4.13 5 15 / 15
Latency max 161.20 ms 95 % CI 154.35–184.06 154.35–184.06 5 15 / 15
CPU
CPU used 2.00 cores 95 % CI 1.99–2.00 1.99–2.00 5 —
User-space CPU share 0.884 95 % CI 0.881–0.888 0.881–0.888 5 —
CPU throttling 14.4 ms 95 % CI 7.3–26.6 7.3–26.6 5 11 / 15
Memory
Anonymous memory peak 114.5 MiB 95 % CI 114.2–115.8 114.2–115.8 5 10 / 15
Database
Database CPU per request < 0.1 µs 95 % CI < 0.1–0.1 < 0.1–0.1 5 13 / 15
Energy
CPU package energy 717.1 J 95 % CI 703.5–728.5 703.5–728.5 5 —
Package energy per request 2.586 mJ 95 % CI 2.561–2.614 2.561–2.614 5 15 / 15
Network
Bytes per response 152 B — 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.65 runnable tasks 95 % CI 3.29–5.20 3.29–5.20 5 1 / 15
CPU clock 3,667 MHz 95 % CI 3,570–3,727 3,570–3,727 5 —
Load generator CPU 0.23 95 % CI 0.22–0.24 0.22–0.24 5 1 / 15

Single query

Closed loop

  • GET /db
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 8,168 req/s 95 % CI 8,027–8,335 8,027–8,335 5 15 / 15
Latency p99 40.55 ms 95 % CI 39.96–41.33 39.96–41.33 5 15 / 15
CPU per request 244.7 µs 95 % CI 239.9–249.0 239.9–249.0 5 15 / 15
Memory under load (PSS) 132.6 MiB 95 % CI 132.3–133.7 132.3–133.7 5 9 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 15.53 ms 95 % CI 15.29–15.81 15.29–15.81 5 15 / 15
Latency p90 26.23 ms 95 % CI 25.35–27.03 25.35–27.03 5 15 / 15
Latency p99.9 55.31 ms 95 % CI 53.85–56.35 53.85–56.35 5 14 / 15
Latency p75 16.73 ms 95 % CI 16.13–16.95 16.13–16.95 5 14 / 15
Latency p99.99 70.26 ms 95 % CI 66.72–76.52 66.72–76.52 5 14 / 15
Latency mean 15.85 ms 95 % CI 15.52–16.10 15.52–16.10 5 15 / 15
Latency std. dev. 7.18 ms 95 % CI 6.97–7.39 6.97–7.39 5 14 / 15
Latency max 95.85 ms 95 % CI 83.41–112.72 83.41–112.72 5 14 / 15
CPU
CPU used 2.00 cores 95 % CI 2.00–2.00 2.00–2.00 5 —
User-space CPU share 0.858 95 % CI 0.856–0.862 0.856–0.862 5 —
CPU throttling 30.1 ms 95 % CI 9.9–41.3 9.9–41.3 5 15 / 15
Memory
Anonymous memory peak 114.5 MiB 95 % CI 114.2–115.8 114.2–115.8 5 10 / 15
Database
Database CPU per request 250.7 µs 95 % CI 243.1–251.7 243.1–251.7 5 15 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 727.6 J 95 % CI 721.2–736.6 721.2–736.6 5 —
Package energy per request 5.905 mJ 95 % CI 5.878–6.007 5.878–6.007 5 15 / 15
Network
Bytes per response 156 B 95 % CI 156–156 156–156 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.36 runnable tasks 95 % CI 3.29–4.57 3.29–4.57 5 1 / 15
CPU clock 3,613 MHz 95 % CI 3,440–3,627 3,440–3,627 5 —
Load generator CPU 0.11 95 % CI 0.11–0.11 0.11–0.11 5 2 / 15

20 queries

Closed loop

  • GET /queries
  • 20 SELECT per request
Metric Median 95 % CI n Rank
Throughput 2,158 req/s 95 % CI 2,123–2,208 2,123–2,208 5 15 / 15
Latency p99 102.10 ms 95 % CI 101.09–106.45 101.09–106.45 5 13 / 15
CPU per request 925.7 µs 95 % CI 906.2–941.0 906.2–941.0 5 15 / 15
Memory under load (PSS) 132.6 MiB 95 % CI 132.3–133.7 132.3–133.7 5 9 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 58.28 ms 95 % CI 57.23–60.38 57.23–60.38 5 15 / 15
Latency p90 63.09 ms 95 % CI 60.03–64.17 60.03–64.17 5 14 / 15
Latency p99.9 118.17 ms 95 % CI 112.31–125.36 112.31–125.36 5 12 / 15
Latency p75 61.24 ms 95 % CI 58.29–61.70 58.29–61.70 5 14 / 15
Latency p99.99 156.60 ms 95 % CI 145.78–165.93 145.78–165.93 5 12 / 15
Latency mean 59.09 ms 95 % CI 57.63–60.07 57.63–60.07 5 15 / 15
Latency std. dev. 8.67 ms 95 % CI 8.06–9.83 8.06–9.83 5 11 / 15
Latency max 170.52 ms 95 % CI 157.03–201.49 157.03–201.49 5 12 / 15
CPU
CPU used 2.00 cores 95 % CI 1.99–2.00 1.99–2.00 5 —
User-space CPU share 0.792 95 % CI 0.789–0.794 0.789–0.794 5 —
CPU throttling 22.5 ms 95 % CI 9.9–32.5 9.9–32.5 5 14 / 15
Memory
Anonymous memory peak 114.5 MiB 95 % CI 114.3–115.8 114.3–115.8 5 10 / 15
Database
Database CPU per request 1,078.0 µs 95 % CI 1,062.8–1,100.4 1,062.8–1,100.4 5 15 / 15
SELECTs per request 20.08 queries 95 % CI 20.08–20.08 20.08–20.08 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 819.1 J 95 % CI 804.7–861.9 804.7–861.9 5 —
Package energy per request 25.062 mJ 95 % CI 24.763–26.555 24.763–26.555 5 15 / 15
Network
Bytes per response 763 B 95 % CI 763–763 763–763 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.03 runnable tasks 95 % CI 3.37–4.23 3.37–4.23 5 1 / 15
CPU clock 3,627 MHz 95 % CI 3,480–3,627 3,480–3,627 5 —
Load generator CPU 0.03 95 % CI 0.03–0.03 0.03–0.03 5 1 / 15

Updates

Closed loop

  • GET /updates
  • 5 SELECT + 5 UPDATE per request
Metric Median 95 % CI n Rank
Throughput 3,506 req/s 95 % CI 3,369–3,546 3,369–3,546 5 15 / 15
Latency p99 66.27 ms 95 % CI 63.20–67.42 63.20–67.42 5 12 / 15
CPU per request 570.3 µs 95 % CI 564.1–592.9 564.1–592.9 5 15 / 15
Memory under load (PSS) 132.6 MiB 95 % CI 132.3–133.7 132.3–133.7 5 9 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 36.30 ms 95 % CI 35.78–37.28 35.78–37.28 5 15 / 15
Latency p90 39.07 ms 95 % CI 37.54–40.48 37.54–40.48 5 13 / 15
Latency p99.9 72.85 ms 95 % CI 70.30–75.06 70.30–75.06 5 12 / 15
Latency p75 37.26 ms 95 % CI 36.44–39.57 36.44–39.57 5 14 / 15
Latency p99.99 98.13 ms 95 % CI 96.88–102.46 96.88–102.46 5 12 / 15
Latency mean 36.42 ms 95 % CI 36.02–37.87 36.02–37.87 5 15 / 15
Latency std. dev. 5.98 ms 95 % CI 5.75–6.31 5.75–6.31 5 12 / 15
Latency max 126.54 ms 95 % CI 100.90–135.99 100.90–135.99 5 12 / 15
CPU
CPU used 2.00 cores 95 % CI 1.99–2.00 1.99–2.00 5 —
User-space CPU share 0.816 95 % CI 0.815–0.819 0.815–0.819 5 —
CPU throttling 19.6 ms 95 % CI 7.2–33.5 7.2–33.5 5 13 / 15
Memory
Anonymous memory peak 114.5 MiB 95 % CI 114.3–115.8 114.3–115.8 5 10 / 15
Database
Database CPU per request 555.4 µs 95 % CI 546.0–561.0 546.0–561.0 5 14 / 15
SELECTs per request 5.01 queries 95 % CI 5.01–5.01 5.01–5.01 5 —
UPDATEs per request 5.01 queries 95 % CI 5.01–5.01 5.01–5.01 5 —
Energy
CPU package energy 890.0 J 95 % CI 874.1–892.7 874.1–892.7 5 —
Package energy per request 16.932 mJ 95 % CI 16.711–17.253 16.711–17.253 5 15 / 15
Network
Bytes per response 286 B 95 % CI 286–286 286–286 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.33 runnable tasks 95 % CI 4.06–4.75 4.06–4.75 5 1 / 15
CPU clock 3,627 MHz 95 % CI 3,507–3,627 3,507–3,627 5 —
Load generator CPU 0.05 95 % CI 0.05–0.05 0.05–0.05 5 1 / 15

List

Closed loop

  • GET /list
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 2,071 req/s 95 % CI 2,009–2,092 2,009–2,092 5 15 / 15
Latency p99 162.69 ms 95 % CI 155.68–177.89 155.68–177.89 5 15 / 15
CPU per request 965.3 µs 95 % CI 956.5–995.4 956.5–995.4 5 15 / 15
Memory under load (PSS) 132.6 MiB 95 % CI 132.3–133.7 132.3–133.7 5 9 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 61.71 ms 95 % CI 61.02–62.37 61.02–62.37 5 15 / 15
Latency p90 107.88 ms 95 % CI 106.07–108.70 106.07–108.70 5 15 / 15
Latency p99.9 245.24 ms 95 % CI 215.55–260.20 215.55–260.20 5 15 / 15
Latency p75 65.42 ms 95 % CI 62.99–68.61 62.99–68.61 5 15 / 15
Latency p99.99 302.38 ms 95 % CI 259.86–349.60 259.86–349.60 5 15 / 15
Latency mean 62.39 ms 95 % CI 62.23–64.67 62.23–64.67 5 15 / 15
Latency std. dev. 31.76 ms 95 % CI 30.13–33.16 30.13–33.16 5 15 / 15
Latency max 393.00 ms 95 % CI 291.36–402.22 291.36–402.22 5 15 / 15
CPU
CPU used 2.00 cores 95 % CI 2.00–2.00 2.00–2.00 5 —
User-space CPU share 0.957 95 % CI 0.957–0.960 0.957–0.960 5 —
CPU throttling 20.1 ms 95 % CI 8.1–33.7 8.1–33.7 5 13 / 15
Memory
Anonymous memory peak 114.5 MiB 95 % CI 114.3–115.8 114.3–115.8 5 9 / 15
Database
Database CPU per request 406.1 µs 95 % CI 385.9–408.5 385.9–408.5 5 15 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 743.3 J 95 % CI 729.4–748.7 729.4–748.7 5 —
Package energy per request 23.961 mJ 95 % CI 23.670–24.159 23.670–24.159 5 15 / 15
Network
Bytes per response 4,757 B 95 % CI 4,757–4,757 4,757–4,757 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.32 runnable tasks 95 % CI 3.80–4.95 3.80–4.95 5 1 / 15
CPU clock 3,627 MHz 95 % CI 3,520–3,627 3,520–3,627 5 —
Load generator CPU 0.03 95 % CI 0.03–0.03 0.03–0.03 5 1 / 15

JSON POST

Closed loop

  • POST /orders
  • body orders.json
Metric Median 95 % CI n Rank
Throughput 7,519 req/s 95 % CI 7,323–7,615 7,323–7,615 5 14 / 15
Latency p99 33.22 ms 95 % CI 32.01–33.84 32.01–33.84 5 14 / 15
CPU per request 266.0 µs 95 % CI 262.8–273.3 262.8–273.3 5 14 / 15
Memory under load (PSS) 132.6 MiB 95 % CI 132.3–133.7 132.3–133.7 5 10 / 15
23 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 16.82 ms 95 % CI 16.71–16.91 16.71–16.91 5 14 / 15
Latency p90 17.56 ms 95 % CI 17.22–19.14 17.22–19.14 5 14 / 15
Latency p99.9 319.33 ms 95 % CI 297.91–349.59 297.91–349.59 5 15 / 15
Latency p75 17.12 ms 95 % CI 16.87–18.93 16.87–18.93 5 14 / 15
Latency p99.99 440.61 ms 95 % CI 417.24–473.55 417.24–473.55 5 15 / 15
Latency mean 18.17 ms 95 % CI 17.87–18.56 17.87–18.56 5 14 / 15
Latency std. dev. 17.31 ms 95 % CI 15.60–19.66 15.60–19.66 5 15 / 15
Latency max 480.68 ms 95 % CI 459.56–519.43 459.56–519.43 5 15 / 15
CPU
CPU used 2.00 cores 95 % CI 1.99–2.00 1.99–2.00 5 —
User-space CPU share 0.936 95 % CI 0.935–0.938 0.935–0.938 5 —
CPU throttling 16.7 ms 95 % CI 6.7–31.3 6.7–31.3 5 12 / 15
Memory
Anonymous memory peak 114.5 MiB 95 % CI 114.3–115.8 114.3–115.8 5 11 / 15
Database
Database CPU per request 0.1 µs 95 % CI < 0.1–0.2 < 0.1–0.2 5 12 / 15
Energy
CPU package energy 713.9 J 95 % CI 700.5–720.3 700.5–720.3 5 —
Package energy per request 6.357 mJ 95 % CI 6.268–6.375 6.268–6.375 5 14 / 15
Network
Bytes per response 195 B 95 % CI 195–195 195–195 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.07 runnable tasks 95 % CI 3.35–4.13 3.35–4.13 5 1 / 15
CPU clock 3,687 MHz 95 % CI 3,590–3,707 3,590–3,707 5 —
Load generator CPU 0.10 95 % CI 0.09–0.10 0.09–0.10 5 2 / 15

Single query, 16 connections

Closed loop

  • GET /db
  • 16 connections
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 8,029 req/s 95 % CI 7,634–8,297 7,634–8,297 5 15 / 15
Latency p99 3.06 ms 95 % CI 2.82–3.42 2.82–3.42 5 11 / 15
CPU per request 248.7 µs 95 % CI 241.0–261.6 241.0–261.6 5 15 / 15
Memory under load (PSS) 132.6 MiB 95 % CI 132.3–133.7 132.3–133.7 5 10 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 1.94 ms 95 % CI 1.88–1.99 1.88–1.99 5 15 / 15
Latency p90 2.27 ms 95 % CI 2.11–2.84 2.11–2.84 5 14 / 15
Latency p99.9 3.86 ms 95 % CI 3.61–4.56 3.61–4.56 5 9 / 15
Latency p75 2.14 ms 95 % CI 1.99–2.71 1.99–2.71 5 14 / 15
Latency p99.99 6.87 ms 95 % CI 4.87–7.45 4.87–7.45 5 7 / 15
Latency mean 1.98 ms 95 % CI 1.92–2.08 1.92–2.08 5 15 / 15
Latency std. dev. 0.29 ms 95 % CI 0.23–0.61 0.23–0.61 5 9 / 15
Latency max 9.53 ms 95 % CI 6.34–12.71 6.34–12.71 5 7 / 15
CPU
CPU used 2.00 cores 95 % CI 1.99–2.00 1.99–2.00 5 —
User-space CPU share 0.864 95 % CI 0.862–0.870 0.862–0.870 5 —
CPU throttling 17.1 ms 95 % CI 10.9–25.7 10.9–25.7 5 12 / 15
Memory
Anonymous memory peak 114.5 MiB 95 % CI 114.3–115.8 114.3–115.8 5 11 / 15
Database
Database CPU per request 243.6 µs 95 % CI 209.9–250.2 209.9–250.2 5 15 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 732.8 J 95 % CI 716.1–747.7 716.1–747.7 5 —
Package energy per request 6.028 mJ 95 % CI 5.968–6.213 5.968–6.213 5 15 / 15
Network
Bytes per response 156 B 95 % CI 156–156 156–156 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 3.75 runnable tasks 95 % CI 3.21–3.95 3.21–3.95 5 1 / 15
CPU clock 3,600 MHz 95 % CI 3,521–3,627 3,521–3,627 5 —
Load generator CPU 0.10 95 % CI 0.10–0.11 0.10–0.11 5 2 / 15

Single query, 512 connections

Closed loop

  • GET /db
  • 512 connections
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 7,657 req/s 95 % CI 7,477–7,724 7,477–7,724 5 14 / 15
Latency p99 189.02 ms 95 % CI 183.94–190.60 183.94–190.60 5 14 / 15
CPU per request 260.9 µs 95 % CI 258.8–267.3 258.8–267.3 5 15 / 15
Memory under load (PSS) 141.6 MiB 95 % CI 141.5–142.2 141.5–142.2 5 7 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 66.02 ms 95 % CI 65.59–68.08 65.59–68.08 5 14 / 15
Latency p90 124.69 ms 95 % CI 122.06–125.61 122.06–125.61 5 14 / 15
Latency p99.9 255.27 ms 95 % CI 253.57–256.84 253.57–256.84 5 14 / 15
Latency p75 68.75 ms 95 % CI 67.51–73.90 67.51–73.90 5 14 / 15
Latency p99.99 321.67 ms 95 % CI 319.70–353.08 319.70–353.08 5 14 / 15
Latency mean 67.57 ms 95 % CI 67.03–69.40 67.03–69.40 5 14 / 15
Latency std. dev. 35.07 ms 95 % CI 34.98–35.78 34.98–35.78 5 14 / 15
Latency max 422.46 ms 95 % CI 378.78–492.16 378.78–492.16 5 14 / 15
CPU
CPU used 1.99 cores 95 % CI 1.99–1.99 1.99–1.99 5 —
User-space CPU share 0.853 95 % CI 0.852–0.859 0.852–0.859 5 —
CPU throttling 17.2 ms 95 % CI 7.7–27.3 7.7–27.3 5 11 / 15
Memory
Anonymous memory peak 123.6 MiB 95 % CI 123.3–124.1 123.3–124.1 5 10 / 15
Database
Database CPU per request 263.0 µs 95 % CI 261.8–263.1 261.8–263.1 5 15 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 725.0 J 95 % CI 705.3–727.8 705.3–727.8 5 —
Package energy per request 6.266 mJ 95 % CI 6.253–6.351 6.253–6.351 5 14 / 15
Network
Bytes per response 156 B 95 % CI 156–156 156–156 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.06 runnable tasks 95 % CI 3.36–4.32 3.36–4.32 5 1 / 15
CPU clock 3,560 MHz 95 % CI 3,453–3,627 3,453–3,627 5 —
Load generator CPU 0.10 95 % CI 0.10–0.11 0.10–0.11 5 3 / 15

Fixed load (5,000 req/s)

Fixed rate

  • GET /db
  • 5,000 req/s fixed
  • 64 connections
  • 20s measured
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 5,000 req/s 95 % CI 4,999–5,000 4,999–5,000 5 1 / 15
Latency p99 14.19 ms 95 % CI 13.85–21.94 13.85–21.94 5 14 / 15
CPU per request 294.2 µs 95 % CI 292.9–300.3 292.9–300.3 5 15 / 15
Memory under load (PSS) 141.6 MiB 95 % CI 141.5–142.2 141.5–142.2 5 9 / 15
24 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 1.33 ms 95 % CI 1.28–1.42 1.28–1.42 5 15 / 15
Latency p90 7.07 ms 95 % CI 6.37–7.91 6.37–7.91 5 15 / 15
Latency p99.9 20.02 ms 95 % CI 19.39–43.67 19.39–43.67 5 13 / 15
Latency p75 2.17 ms 95 % CI 2.09–2.73 2.09–2.73 5 15 / 15
Latency p99.99 24.84 ms 95 % CI 24.32–50.79 24.32–50.79 5 12 / 15
Latency mean 2.62 ms 95 % CI 2.51–2.79 2.51–2.79 5 14 / 15
Latency max 30.59 ms 95 % CI 29.39–68.47 29.39–68.47 5 12 / 15
CPU
CPU used 1.47 cores 95 % CI 1.46–1.50 1.46–1.50 5 —
User-space CPU share 0.865 95 % CI 0.845–0.885 0.845–0.885 5 —
CPU throttling 0.0 ms — 5 1 / 15
Memory
Anonymous memory peak 123.6 MiB 95 % CI 123.3–124.1 123.3–124.1 5 11 / 15
Database
Database CPU per request 243.8 µs 95 % CI 222.3–244.9 222.3–244.9 5 15 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 811.7 J 95 % CI 805.1–814.7 805.1–814.7 5 —
Package energy per request 8.118 mJ 95 % CI 8.052–8.147 8.052–8.147 5 15 / 15
Network
Bytes per response 30 B — 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.29 runnable tasks 95 % CI 3.34–4.74 3.34–4.74 5 1 / 15
CPU clock 3,399 MHz 95 % CI 3,334–3,488 3,334–3,488 5 —
Load generator CPU 0.14 95 % CI 0.14–0.14 0.14–0.14 5 8 / 15