Java · Spring Boot

Native image

The same Spring Boot service compiled to a native executable with GraalVM Community Edition.

  • Language Java
  • RuntimeGraalVM Native Image
  • FrameworkSpring Boot (Spring MVC)
  • CategoryFull-stack

Headline results

All results

Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.

Overall

Derived

Metric Median 95 % CI n Rank
Throughput index 17.0 — — 14 / 15
CPU efficiency index 15.5 — — 14 / 15
Peak memory 244.3 MiB — — 13 / 15

Cold start

Start-up

  • GET /json
Metric Median 95 % CI n Rank
Cold start 274 ms 95 % CI 262–348 262–348 5 5 / 15
5 more metrics
Metric Median 95 % CI n Rank
Memory
Memory at idle 98.2 MiB 95 % CI 98.2–98.2 98.2–98.2 5 9 / 15
Anonymous memory at idle 39.5 MiB 95 % CI 39.5–39.5 39.5–39.5 5 9 / 15
Start-up
Cold start (fastest) 259 ms 95 % CI 239–265 239–265 5 5 / 15
Cold start (slowest) 285 ms 95 % CI 278–357 278–357 5 5 / 15
Footprint
Image size 248 MB — 5 5 / 15

Cold load

Cold load

  • GET /db
  • 128 connections
  • 10s measured
  • 1 SELECT per request
  • compared with Single query
Metric Median 95 % CI n Rank
Throughput 14,545 req/s 95 % CI 14,027–14,711 14,027–14,711 5 11 / 15
Latency p99 36.57 ms 95 % CI 33.92–38.77 33.92–38.77 5 11 / 15
CPU per request 133.4 µs 95 % CI 131.7–138.0 131.7–138.0 5 12 / 15
Memory under load (PSS) 195.6 MiB 95 % CI 190.8–212.5 190.8–212.5 5 12 / 15
26 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 8.14 ms 95 % CI 8.08–8.34 8.08–8.34 5 11 / 15
Latency p90 15.92 ms 95 % CI 15.60–16.98 15.60–16.98 5 11 / 15
Latency p99.9 86.37 ms 95 % CI 71.31–87.79 71.31–87.79 5 9 / 15
Latency p75 10.60 ms 95 % CI 10.48–11.53 10.48–11.53 5 11 / 15
Latency p99.99 106.18 ms 95 % CI 92.92–116.29 92.92–116.29 5 9 / 15
Latency mean 9.53 ms 95 % CI 9.32–9.85 9.32–9.85 5 11 / 15
Latency std. dev. 7.29 ms 95 % CI 6.67–7.67 6.67–7.67 5 9 / 15
Latency max 120.83 ms 95 % CI 113.47–171.57 113.47–171.57 5 9 / 15
CPU
CPU used 1.93 cores 95 % CI 1.93–1.94 1.93–1.94 5 —
User-space CPU share 0.692 95 % CI 0.690–0.703 0.690–0.703 5 —
CPU throttling 2.2 ms 95 % CI 1.0–6.0 1.0–6.0 5 7 / 15
Memory
Anonymous memory peak 134.4 MiB 95 % CI 129.4–151.4 129.4–151.4 5 11 / 15
Database
Database CPU per request 114.7 µs 95 % CI 109.4–115.2 109.4–115.2 5 12 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Start-up
Cold vs. warm throughput 1.01 95 % CI 1.00–1.03 1.00–1.03 5 5 / 15
Energy
CPU package energy 471.3 J 95 % CI 461.0–481.5 461.0–481.5 5 —
Package energy per request 3.198 mJ 95 % CI 3.162–3.399 3.162–3.399 5 12 / 15
Network
Bytes per response 137 B 95 % CI 137–137 137–137 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 5.27 runnable tasks 95 % CI 3.10–6.10 3.10–6.10 5 15 / 15
CPU clock 3,536 MHz 95 % CI 3,391–3,541 3,391–3,541 5 —
Load generator CPU 0.17 95 % CI 0.15–0.18 0.15–0.18 5 5 / 15

JSON

Closed loop

  • GET /json
Metric Median 95 % CI n Rank
Throughput 23,641 req/s 95 % CI 21,877–23,689 21,877–23,689 5 14 / 15
Latency p99 15.13 ms 95 % CI 14.32–17.49 14.32–17.49 5 15 / 15
CPU per request 82.3 µs 95 % CI 82.1–88.9 82.1–88.9 5 14 / 15
Memory under load (PSS) 124.5 MiB 95 % CI 116.8–125.4 116.8–125.4 5 9 / 15
23 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 5.21 ms 95 % CI 5.19–5.55 5.19–5.55 5 13 / 15
Latency p90 6.73 ms 95 % CI 6.65–7.58 6.65–7.58 5 13 / 15
Latency p99.9 24.80 ms 95 % CI 24.31–32.79 24.31–32.79 5 14 / 15
Latency p75 5.73 ms 95 % CI 5.70–6.53 5.70–6.53 5 13 / 15
Latency p99.99 29.08 ms 95 % CI 26.55–36.91 26.55–36.91 5 12 / 15
Latency mean 5.51 ms 95 % CI 5.48–5.96 5.48–5.96 5 14 / 15
Latency std. dev. 2.00 ms 95 % CI 1.93–2.50 1.93–2.50 5 13 / 15
Latency max 30.36 ms 95 % CI 28.22–37.16 28.22–37.16 5 11 / 15
CPU
CPU used 1.94 cores 95 % CI 1.94–1.94 1.94–1.94 5 —
User-space CPU share 0.763 95 % CI 0.762–0.766 0.762–0.766 5 —
CPU throttling 0.4 ms 95 % CI 0.0–0.8 0.0–0.8 5 7 / 15
Memory
Anonymous memory peak 61.9 MiB 95 % CI 53.8–62.9 53.8–62.9 5 9 / 15
Database
Database CPU per request < 0.1 µs 95 % CI < 0.1–< 0.1 < 0.1–< 0.1 5 12 / 15
Energy
CPU package energy 677.4 J 95 % CI 674.0–745.7 674.0–745.7 5 —
Package energy per request 1.906 mJ 95 % CI 1.899–2.257 1.899–2.257 5 14 / 15
Network
Bytes per response 133 B 95 % CI 133–133 133–133 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 5.02 runnable tasks 95 % CI 3.53–5.89 3.53–5.89 5 3 / 15
CPU clock 3,763 MHz 95 % CI 3,733–3,800 3,733–3,800 5 —
Load generator CPU 0.28 95 % CI 0.24–0.28 0.24–0.28 5 3 / 15

Single query

Closed loop

  • GET /db
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 14,559 req/s 95 % CI 13,654–14,594 13,654–14,594 5 13 / 15
Latency p99 33.62 ms 95 % CI 27.43–39.79 27.43–39.79 5 14 / 15
CPU per request 134.1 µs 95 % CI 133.5–142.9 133.5–142.9 5 13 / 15
Memory under load (PSS) 179.0 MiB 95 % CI 172.3–181.1 172.3–181.1 5 11 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 8.17 ms 95 % CI 8.15–8.57 8.15–8.57 5 13 / 15
Latency p90 15.96 ms 95 % CI 15.17–17.21 15.17–17.21 5 13 / 15
Latency p99.9 138.60 ms 95 % CI 42.74–209.97 42.74–209.97 5 15 / 15
Latency p75 10.84 ms 95 % CI 10.34–12.03 10.34–12.03 5 13 / 15
Latency p99.99 269.98 ms 95 % CI 51.48–453.69 51.48–453.69 5 15 / 15
Latency mean 9.71 ms 95 % CI 9.09–10.64 9.09–10.64 5 13 / 15
Latency std. dev. 9.81 ms 95 % CI 5.15–14.20 5.15–14.20 5 15 / 15
Latency max 340.21 ms 95 % CI 56.13–519.47 56.13–519.47 5 15 / 15
CPU
CPU used 1.95 cores 95 % CI 1.95–1.95 1.95–1.95 5 —
User-space CPU share 0.695 95 % CI 0.691–0.698 0.691–0.698 5 —
CPU throttling 3.0 ms 95 % CI 1.1–4.3 1.1–4.3 5 9 / 15
Memory
Anonymous memory peak 116.6 MiB 95 % CI 109.7–118.5 109.7–118.5 5 11 / 15
Database
Database CPU per request 114.2 µs 95 % CI 106.3–114.6 106.3–114.6 5 14 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 702.2 J 95 % CI 698.4–751.7 698.4–751.7 5 —
Package energy per request 3.219 mJ 95 % CI 3.187–3.664 3.187–3.664 5 14 / 15
Network
Bytes per response 137 B 95 % CI 137–137 137–137 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.72 runnable tasks 95 % CI 4.36–6.00 4.36–6.00 5 2 / 15
CPU clock 3,607 MHz 95 % CI 3,540–3,627 3,540–3,627 5 —
Load generator CPU 0.17 95 % CI 0.14–0.17 0.14–0.17 5 3 / 15

20 queries

Closed loop

  • GET /queries
  • 20 SELECT per request
Metric Median 95 % CI n Rank
Throughput 2,234 req/s 95 % CI 2,070–2,244 2,070–2,244 5 14 / 15
Latency p99 146.33 ms 95 % CI 138.70–161.36 138.70–161.36 5 15 / 15
CPU per request 873.2 µs 95 % CI 869.2–942.1 869.2–942.1 5 14 / 15
Memory under load (PSS) 226.6 MiB 95 % CI 216.2–229.9 216.2–229.9 5 13 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 54.98 ms 95 % CI 54.74–59.27 54.74–59.27 5 14 / 15
Latency p90 91.94 ms 95 % CI 89.95–102.54 89.95–102.54 5 15 / 15
Latency p99.9 203.68 ms 95 % CI 183.71–224.36 183.71–224.36 5 15 / 15
Latency p75 72.57 ms 95 % CI 71.72–79.73 71.72–79.73 5 15 / 15
Latency p99.99 236.67 ms 95 % CI 219.45–290.61 219.45–290.61 5 15 / 15
Latency mean 58.05 ms 95 % CI 57.49–62.69 57.49–62.69 5 14 / 15
Latency std. dev. 27.73 ms 95 % CI 26.55–31.94 26.55–31.94 5 15 / 15
Latency max 284.18 ms 95 % CI 252.48–346.72 252.48–346.72 5 15 / 15
CPU
CPU used 1.95 cores 95 % CI 1.94–1.95 1.94–1.95 5 —
User-space CPU share 0.592 95 % CI 0.587–0.594 0.587–0.594 5 —
CPU throttling 2.8 ms 95 % CI 0.0–5.6 0.0–5.6 5 9 / 15
Memory
Anonymous memory peak 164.0 MiB 95 % CI 153.6–168.0 153.6–168.0 5 11 / 15
Database
Database CPU per request 1,035.3 µs 95 % CI 1,028.3–1,082.3 1,028.3–1,082.3 5 14 / 15
SELECTs per request 20.08 queries 95 % CI 20.07–20.08 20.07–20.08 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 798.5 J 95 % CI 796.9–842.4 796.9–842.4 5 —
Package energy per request 23.803 mJ 95 % CI 23.653–27.062 23.653–27.062 5 14 / 15
Network
Bytes per response 744 B 95 % CI 744–744 744–744 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.97 runnable tasks 95 % CI 4.64–6.57 4.64–6.57 5 4 / 15
CPU clock 3,627 MHz 95 % CI 3,560–3,717 3,560–3,717 5 —
Load generator CPU 0.03 95 % CI 0.03–0.03 0.03–0.03 5 2 / 15

Updates

Closed loop

  • GET /updates
  • 5 SELECT + 5 UPDATE per request
Metric Median 95 % CI n Rank
Throughput 3,932 req/s 95 % CI 3,796–3,940 3,796–3,940 5 14 / 15
Latency p99 84.42 ms 95 % CI 83.35–103.35 83.35–103.35 5 15 / 15
CPU per request 496.3 µs 95 % CI 495.4–507.5 495.4–507.5 5 14 / 15
Memory under load (PSS) 203.2 MiB 95 % CI 194.1–205.7 194.1–205.7 5 11 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 31.38 ms 95 % CI 31.12–32.13 31.12–32.13 5 14 / 15
Latency p90 52.22 ms 95 % CI 52.13–57.41 52.13–57.41 5 15 / 15
Latency p99.9 126.47 ms 95 % CI 118.64–155.14 118.64–155.14 5 15 / 15
Latency p75 41.34 ms 95 % CI 41.03–43.52 41.03–43.52 5 15 / 15
Latency p99.99 166.13 ms 95 % CI 146.78–188.39 146.78–188.39 5 15 / 15
Latency mean 33.08 ms 95 % CI 32.92–34.79 32.92–34.79 5 14 / 15
Latency std. dev. 16.11 ms 95 % CI 15.88–19.63 15.88–19.63 5 15 / 15
Latency max 202.48 ms 95 % CI 187.00–241.58 187.00–241.58 5 15 / 15
CPU
CPU used 1.95 cores 95 % CI 1.92–1.95 1.92–1.95 5 —
User-space CPU share 0.612 95 % CI 0.609–0.613 0.609–0.613 5 —
CPU throttling 4.5 ms 95 % CI 1.7–4.7 1.7–4.7 5 9 / 15
Memory
Anonymous memory peak 140.6 MiB 95 % CI 131.5–143.2 131.5–143.2 5 11 / 15
Database
Database CPU per request 585.4 µs 95 % CI 583.0–597.7 583.0–597.7 5 15 / 15
SELECTs per request 5.01 queries 95 % CI 5.01–5.01 5.01–5.01 5 —
UPDATEs per request 5.01 queries 95 % CI 5.01–5.01 5.01–5.01 5 —
Energy
CPU package energy 828.6 J 95 % CI 822.8–836.6 822.8–836.6 5 —
Package energy per request 13.991 mJ 95 % CI 13.920–14.660 13.920–14.660 5 14 / 15
Network
Bytes per response 267 B 95 % CI 267–267 267–267 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 5.39 runnable tasks 95 % CI 5.16–7.48 5.16–7.48 5 3 / 15
CPU clock 3,607 MHz 95 % CI 3,553–3,633 3,553–3,633 5 —
Load generator CPU 0.05 95 % CI 0.05–0.05 0.05–0.05 5 2 / 15

List

Closed loop

  • GET /list
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 4,162 req/s 95 % CI 4,066–4,200 4,066–4,200 5 14 / 15
Latency p99 63.08 ms 95 % CI 60.61–68.15 60.61–68.15 5 14 / 15
CPU per request 468.7 µs 95 % CI 464.4–479.9 464.4–479.9 5 14 / 15
Memory under load (PSS) 244.3 MiB 95 % CI 239.7–260.9 239.7–260.9 5 13 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 28.54 ms 95 % CI 28.21–29.07 28.21–29.07 5 14 / 15
Latency p90 46.24 ms 95 % CI 45.78–48.48 45.78–48.48 5 14 / 15
Latency p99.9 78.55 ms 95 % CI 75.50–87.95 75.50–87.95 5 14 / 15
Latency p75 32.57 ms 95 % CI 31.89–34.22 31.89–34.22 5 13 / 15
Latency p99.99 99.34 ms 95 % CI 89.00–105.32 89.00–105.32 5 14 / 15
Latency mean 30.76 ms 95 % CI 30.43–31.50 30.43–31.50 5 14 / 15
Latency std. dev. 10.15 ms 95 % CI 9.76–11.30 9.76–11.30 5 13 / 15
Latency max 120.00 ms 95 % CI 106.80–130.43 106.80–130.43 5 14 / 15
CPU
CPU used 1.95 cores 95 % CI 1.95–1.95 1.95–1.95 5 —
User-space CPU share 0.876 95 % CI 0.874–0.878 0.874–0.878 5 —
CPU throttling 1.9 ms 95 % CI 1.2–3.1 1.2–3.1 5 6 / 15
Memory
Anonymous memory peak 181.6 MiB 95 % CI 177.1–198.3 177.1–198.3 5 13 / 15
Database
Database CPU per request 237.1 µs 95 % CI 235.0–237.2 235.0–237.2 5 13 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 731.1 J 95 % CI 727.2–751.0 727.2–751.0 5 —
Package energy per request 11.652 mJ 95 % CI 11.577–12.270 11.577–12.270 5 14 / 15
Network
Bytes per response 4,738 B 95 % CI 4,738–4,738 4,738–4,738 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 5.60 runnable tasks 95 % CI 4.63–8.13 4.63–8.13 5 3 / 15
CPU clock 3,610 MHz 95 % CI 3,541–3,627 3,541–3,627 5 —
Load generator CPU 0.06 95 % CI 0.05–0.06 0.05–0.06 5 2 / 15

JSON POST

Closed loop

  • POST /orders
  • body orders.json
Metric Median 95 % CI n Rank
Throughput 4,297 req/s 95 % CI 4,239–4,345 4,239–4,345 5 15 / 15
Latency p99 41.74 ms 95 % CI 41.20–43.11 41.20–43.11 5 15 / 15
CPU per request 453.0 µs 95 % CI 448.2–458.7 448.2–458.7 5 15 / 15
Memory under load (PSS) 127.2 MiB 95 % CI 125.7–129.4 125.7–129.4 5 9 / 15
23 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 29.13 ms 95 % CI 28.83–29.23 28.83–29.23 5 15 / 15
Latency p90 31.06 ms 95 % CI 30.64–33.01 30.64–33.01 5 15 / 15
Latency p99.9 44.28 ms 95 % CI 42.78–53.27 42.78–53.27 5 13 / 15
Latency p75 29.91 ms 95 % CI 29.51–30.04 29.51–30.04 5 15 / 15
Latency p99.99 46.22 ms 95 % CI 44.09–58.79 44.09–58.79 5 12 / 15
Latency mean 29.71 ms 95 % CI 29.38–30.09 29.38–30.09 5 15 / 15
Latency std. dev. 3.09 ms 95 % CI 3.08–3.78 3.08–3.78 5 12 / 15
Latency max 46.54 ms 95 % CI 45.02–60.07 45.02–60.07 5 11 / 15
CPU
CPU used 1.94 cores 95 % CI 1.94–1.95 1.94–1.95 5 —
User-space CPU share 0.910 95 % CI 0.907–0.911 0.907–0.911 5 —
CPU throttling 0.0 ms 95 % CI 0.0–0.8 0.0–0.8 5 1 / 15
Memory
Anonymous memory peak 64.6 MiB 95 % CI 63.1–66.8 63.1–66.8 5 9 / 15
Database
Database CPU per request 0.2 µs 95 % CI < 0.1–0.4 < 0.1–0.4 5 14 / 15
Energy
CPU package energy 702.9 J 95 % CI 700.0–710.9 700.0–710.9 5 —
Package energy per request 10.869 mJ 95 % CI 10.796–11.149 10.796–11.149 5 15 / 15
Network
Bytes per response 195 B 95 % CI 195–195 195–195 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.69 runnable tasks 95 % CI 4.40–6.81 4.40–6.81 5 2 / 15
CPU clock 3,767 MHz 95 % CI 3,726–3,777 3,726–3,777 5 —
Load generator CPU 0.07 95 % CI 0.07–0.07 0.07–0.07 5 1 / 15

Single query, 16 connections

Closed loop

  • GET /db
  • 16 connections
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 14,336 req/s 95 % CI 14,076–14,522 14,076–14,522 5 13 / 15
Latency p99 6.90 ms 95 % CI 6.78–7.94 6.78–7.94 5 15 / 15
CPU per request 117.9 µs 95 % CI 117.5–120.0 117.5–120.0 5 13 / 15
Memory under load (PSS) 107.2 MiB 95 % CI 106.4–109.3 106.4–109.3 5 9 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 1.04 ms 95 % CI 1.02–1.05 1.02–1.05 5 13 / 15
Latency p90 1.55 ms 95 % CI 1.54–1.62 1.54–1.62 5 13 / 15
Latency p99.9 14.00 ms 95 % CI 13.17–17.21 13.17–17.21 5 15 / 15
Latency p75 1.26 ms 95 % CI 1.25–1.29 1.25–1.29 5 13 / 15
Latency p99.99 16.84 ms 95 % CI 14.83–25.01 14.83–25.01 5 15 / 15
Latency mean 1.22 ms 95 % CI 1.21–1.27 1.21–1.27 5 13 / 15
Latency std. dev. 1.11 ms 95 % CI 1.07–1.33 1.07–1.33 5 15 / 15
Latency max 20.92 ms 95 % CI 17.38–27.85 17.38–27.85 5 15 / 15
CPU
CPU used 1.69 cores 95 % CI 1.69–1.71 1.69–1.71 5 —
User-space CPU share 0.725 95 % CI 0.717–0.728 0.717–0.728 5 —
CPU throttling 0.0 ms — 5 1 / 15
Memory
Anonymous memory peak 44.6 MiB 95 % CI 43.8–46.7 43.8–46.7 5 9 / 15
Database
Database CPU per request 118.2 µs 95 % CI 112.8–118.9 112.8–118.9 5 14 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 665.8 J 95 % CI 661.1–684.8 661.1–684.8 5 —
Package energy per request 3.075 mJ 95 % CI 3.042–3.222 3.042–3.222 5 14 / 15
Network
Bytes per response 137 B 95 % CI 137–137 137–137 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.24 runnable tasks 95 % CI 4.14–5.77 4.14–5.77 5 2 / 15
CPU clock 3,476 MHz 95 % CI 3,366–3,513 3,366–3,513 5 —
Load generator CPU 0.17 95 % CI 0.16–0.17 0.16–0.17 5 3 / 15

Single query, 512 connections

Closed loop

  • GET /db
  • 512 connections
  • 1 SELECT per request
  • throughput varies 15 % between passes
Metric Median 95 % CI n Rank
Throughput 6,207 req/s 95 % CI 5,354–7,927 5,354–7,927 5 15 / 15
Latency p99 269.66 ms 95 % CI 220.74–298.46 220.74–298.46 5 15 / 15
CPU per request 239.3 µs 95 % CI 202.3–266.9 202.3–266.9 5 14 / 15
Memory under load (PSS) 239.8 MiB 95 % CI 216.7–276.2 216.7–276.2 5 13 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 81.53 ms 95 % CI 67.08–101.07 67.08–101.07 5 15 / 15
Latency p90 176.66 ms 95 % CI 135.65–196.63 135.65–196.63 5 15 / 15
Latency p99.9 388.66 ms 95 % CI 349.83–457.31 349.83–457.31 5 15 / 15
Latency p75 135.05 ms 95 % CI 99.50–146.77 99.50–146.77 5 15 / 15
Latency p99.99 561.97 ms 95 % CI 412.92–655.95 412.92–655.95 5 15 / 15
Latency mean 87.38 ms 95 % CI 68.56–100.63 68.56–100.63 5 15 / 15
Latency std. dev. 67.73 ms 95 % CI 51.28–74.09 51.28–74.09 5 15 / 15
Latency max 589.65 ms 95 % CI 474.50–753.47 474.50–753.47 5 15 / 15
CPU
CPU used 1.48 cores 95 % CI 1.43–1.60 1.43–1.60 5 —
User-space CPU share 0.690 95 % CI 0.688–0.696 0.688–0.696 5 —
CPU throttling 0.0 ms 95 % CI 0.0–0.4 0.0–0.4 5 1 / 15
Memory
Anonymous memory peak 177.3 MiB 95 % CI 154.6–213.5 154.6–213.5 5 13 / 15
Database
Database CPU per request 109.9 µs 95 % CI 109.1–110.9 109.1–110.9 5 14 / 15
SELECTs per request 1.01 queries 95 % CI 1.00–1.01 1.00–1.01 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 617.0 J 95 % CI 599.2–632.4 599.2–632.4 5 —
Package energy per request 6.468 mJ 95 % CI 5.297–7.425 5.297–7.425 5 15 / 15
Network
Bytes per response 137 B 95 % CI 137–137 137–137 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.70 runnable tasks 95 % CI 4.08–5.49 4.08–5.49 5 2 / 15
CPU clock 3,024 MHz 95 % CI 2,772–3,278 2,772–3,278 5 —
Load generator CPU 0.08 95 % CI 0.07–0.10 0.07–0.10 5 1 / 15

Fixed load (5,000 req/s)

Fixed rate

  • GET /db
  • 5,000 req/s fixed
  • 64 connections
  • 20s measured
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 4,999 req/s 95 % CI 4,998–4,999 4,998–4,999 5 7 / 15
Latency p99 38.56 ms 95 % CI 5.12–41.99 5.12–41.99 5 15 / 15
CPU per request 267.6 µs 95 % CI 250.2–271.0 250.2–271.0 5 14 / 15
Memory under load (PSS) 174.9 MiB 95 % CI 146.4–284.5 146.4–284.5 5 11 / 15
24 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 1.07 ms 95 % CI 1.05–1.14 1.05–1.14 5 12 / 15
Latency p90 3.76 ms 95 % CI 1.78–5.23 1.78–5.23 5 14 / 15
Latency p99.9 48.38 ms 95 % CI 21.58–53.38 21.58–53.38 5 15 / 15
Latency p75 1.71 ms 95 % CI 1.33–2.13 1.33–2.13 5 14 / 15
Latency p99.99 52.31 ms 95 % CI 31.61–78.38 31.61–78.38 5 15 / 15
Latency mean 2.72 ms 95 % CI 1.27–3.55 1.27–3.55 5 15 / 15
Latency max 60.04 ms 95 % CI 33.32–85.94 33.32–85.94 5 14 / 15
CPU
CPU used 1.33 cores 95 % CI 1.25–1.35 1.25–1.35 5 —
User-space CPU share 0.747 95 % CI 0.744–0.755 0.744–0.755 5 —
CPU throttling 0.0 ms — 5 1 / 15
Memory
Anonymous memory peak 112.2 MiB 95 % CI 83.8–221.9 83.8–221.9 5 9 / 15
Database
Database CPU per request 127.1 µs 95 % CI 110.5–130.7 110.5–130.7 5 2 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 487.7 J 95 % CI 474.5–634.6 474.5–634.6 5 —
Package energy per request 4.878 mJ 95 % CI 4.745–6.347 4.745–6.347 5 13 / 15
Network
Bytes per response 30 B — 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.39 runnable tasks 95 % CI 3.87–5.32 3.87–5.32 5 2 / 15
CPU clock 2,239 MHz 95 % CI 2,072–2,525 2,072–2,525 5 —
Load generator CPU 0.13 95 % CI 0.11–0.13 0.11–0.13 5 4 / 15