Java · Spring Boot

JVM + AOT cache

The same Spring Boot service with a Project Leyden AOT cache created by a training run at build time (JEP 514/515).

  • Language Java
  • RuntimeJVM (HotSpot)
  • FrameworkSpring Boot (Spring MVC)
  • CategoryFull-stack

Headline results

All results

Every scenario and metric measured for this implementation. Primary metrics first; the rest are one click away. Ranks count all 15 implementations of the run.

Overall

Derived

Metric Median 95 % CI n Rank
Throughput index 45.4 — — 10 / 15
CPU efficiency index 42.0 — — 9 / 15
Peak memory 671.4 MiB — — 14 / 15

Cold start

Start-up

  • GET /json
Metric Median 95 % CI n Rank
Cold start 1,486 ms 95 % CI 1,457–1,560 1,457–1,560 5 14 / 15
5 more metrics
Metric Median 95 % CI n Rank
Memory
Memory at idle 142.7 MiB 95 % CI 142.2–153.6 142.2–153.6 5 12 / 15
Anonymous memory at idle 109.4 MiB 95 % CI 109.0–120.1 109.0–120.1 5 14 / 15
Start-up
Cold start (fastest) 1,414 ms 95 % CI 1,367–1,539 1,367–1,539 5 14 / 15
Cold start (slowest) 1,531 ms 95 % CI 1,524–1,641 1,524–1,641 5 14 / 15
Footprint
Image size 632 MB — 5 14 / 15

Cold load

Cold load

  • GET /db
  • 128 connections
  • 10s measured
  • 1 SELECT per request
  • compared with Single query
  • throughput varies 14 % between passes
Metric Median 95 % CI n Rank
Throughput 8,124 req/s 95 % CI 5,804–9,049 5,804–9,049 5 14 / 15
Latency p99 194.05 ms 95 % CI 187.76–779.08 187.76–779.08 5 14 / 15
CPU per request 245.3 µs 95 % CI 220.5–343.5 220.5–343.5 5 14 / 15
Memory under load (PSS) 262.3 MiB 95 % CI 260.9–265.7 260.9–265.7 5 15 / 15
26 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 13.03 ms 95 % CI 11.66–18.75 11.66–18.75 5 12 / 15
Latency p90 41.38 ms 95 % CI 38.67–81.49 38.67–81.49 5 14 / 15
Latency p99.9 357.87 ms 95 % CI 339.57–1,125.32 339.57–1,125.32 5 14 / 15
Latency p75 21.71 ms 95 % CI 20.99–30.86 20.99–30.86 5 14 / 15
Latency p99.99 459.55 ms 95 % CI 405.06–1,323.74 405.06–1,323.74 5 14 / 15
Latency mean 22.28 ms 95 % CI 21.77–56.27 21.77–56.27 5 14 / 15
Latency std. dev. 35.01 ms 95 % CI 33.93–137.63 33.93–137.63 5 14 / 15
Latency max 515.44 ms 95 % CI 439.38–1,345.81 439.38–1,345.81 5 14 / 15
CPU
CPU used 1.99 cores 95 % CI 1.98–1.99 1.98–1.99 5 —
User-space CPU share 0.810 95 % CI 0.802–0.835 0.802–0.835 5 —
CPU throttling 11.1 ms 95 % CI 7.7–14.8 7.7–14.8 5 10 / 15
Memory
Anonymous memory peak 229.0 MiB 95 % CI 227.3–232.2 227.3–232.2 5 15 / 15
Database
Database CPU per request 119.0 µs 95 % CI 102.7–121.1 102.7–121.1 5 13 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Start-up
Cold vs. warm throughput 0.28 95 % CI 0.19–0.31 0.19–0.31 5 14 / 15
Energy
CPU package energy 477.5 J 95 % CI 469.3–599.1 469.3–599.1 5 —
Package energy per request 5.767 mJ 95 % CI 5.260–10.281 5.260–10.281 5 13 / 15
Network
Bytes per response 137 B 95 % CI 137–137 137–137 5 —
Disk I/O
Disk writes 28 KiB — 5 13 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 4.44 runnable tasks 95 % CI 3.43–5.46 3.43–5.46 5 9 / 15
CPU clock 3,520 MHz 95 % CI 3,500–3,632 3,500–3,632 5 —
Load generator CPU 0.10 95 % CI 0.05–0.11 0.05–0.11 5 2 / 15

JSON

Closed loop

  • GET /json
Metric Median 95 % CI n Rank
Throughput 56,027 req/s 95 % CI 54,160–57,922 54,160–57,922 5 10 / 15
Latency p99 4.33 ms 95 % CI 4.09–4.81 4.09–4.81 5 9 / 15
CPU per request 29.8 µs 95 % CI 29.7–31.5 29.7–31.5 5 9 / 15
Memory under load (PSS) 276.8 MiB 95 % CI 272.8–282.9 272.8–282.9 5 14 / 15
23 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 2.29 ms 95 % CI 2.11–2.40 2.11–2.40 5 11 / 15
Latency p90 2.92 ms 95 % CI 2.82–3.02 2.82–3.02 5 11 / 15
Latency p99.9 23.18 ms 95 % CI 6.38–26.74 6.38–26.74 5 13 / 15
Latency p75 2.71 ms 95 % CI 2.67–2.87 2.67–2.87 5 10 / 15
Latency p99.99 32.77 ms 95 % CI 8.80–56.30 8.80–56.30 5 13 / 15
Latency mean 2.27 ms 95 % CI 2.26–2.40 2.26–2.40 5 10 / 15
Latency std. dev. 1.33 ms 95 % CI 0.70–1.63 0.70–1.63 5 11 / 15
Latency max 35.91 ms 95 % CI 23.23–71.28 23.23–71.28 5 13 / 15
CPU
CPU used 1.70 cores 95 % CI 1.67–1.72 1.67–1.72 5 —
User-space CPU share 0.583 95 % CI 0.570–0.595 0.570–0.595 5 —
CPU throttling 0.0 ms — 5 1 / 15
Memory
Anonymous memory peak 243.2 MiB 95 % CI 239.0–249.5 239.0–249.5 5 14 / 15
Database
Database CPU per request < 0.1 µs 95 % CI < 0.1–< 0.1 < 0.1–< 0.1 5 9 / 15
Energy
CPU package energy 689.8 J 95 % CI 686.6–704.4 686.6–704.4 5 —
Package energy per request 0.812 mJ 95 % CI 0.799–0.844 0.799–0.844 5 10 / 15
Network
Bytes per response 133 B 95 % CI 133–133 133–133 5 —
Disk I/O
Disk writes 36 KiB — 5 14 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 5.21 runnable tasks 95 % CI 4.76–6.25 4.76–6.25 5 5 / 15
CPU clock 3,670 MHz 95 % CI 3,587–3,723 3,587–3,723 5 —
Load generator CPU 0.56 95 % CI 0.55–0.56 0.55–0.56 5 8 / 15

Single query

Closed loop

  • GET /db
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 29,702 req/s 95 % CI 29,233–30,341 29,233–30,341 5 9 / 15
Latency p99 12.04 ms 95 % CI 11.81–12.57 11.81–12.57 5 11 / 15
CPU per request 65.6 µs 95 % CI 64.2–67.0 64.2–67.0 5 9 / 15
Memory under load (PSS) 277.2 MiB 95 % CI 273.0–283.2 273.0–283.2 5 14 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 3.78 ms 95 % CI 3.72–3.88 3.72–3.88 5 9 / 15
Latency p90 7.64 ms 95 % CI 7.48–7.81 7.48–7.81 5 11 / 15
Latency p99.9 16.90 ms 95 % CI 16.77–18.50 16.77–18.50 5 11 / 15
Latency p75 5.60 ms 95 % CI 5.49–5.71 5.49–5.71 5 10 / 15
Latency p99.99 23.23 ms 95 % CI 21.80–26.29 21.80–26.29 5 9 / 15
Latency mean 4.39 ms 95 % CI 4.31–4.49 4.31–4.49 5 9 / 15
Latency std. dev. 2.41 ms 95 % CI 2.36–2.53 2.36–2.53 5 11 / 15
Latency max 32.95 ms 95 % CI 29.55–60.00 29.55–60.00 5 9 / 15
CPU
CPU used 1.95 cores 95 % CI 1.94–1.96 1.94–1.96 5 —
User-space CPU share 0.530 95 % CI 0.525–0.530 0.525–0.530 5 —
CPU throttling 1.3 ms 95 % CI 0.1–3.8 0.1–3.8 5 7 / 15
Memory
Anonymous memory peak 243.5 MiB 95 % CI 239.2–249.8 239.2–249.8 5 14 / 15
Database
Database CPU per request 77.5 µs 95 % CI 76.2–78.4 76.2–78.4 5 10 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 756.4 J 95 % CI 746.2–762.6 746.2–762.6 5 —
Package energy per request 1.687 mJ 95 % CI 1.654–1.699 1.654–1.699 5 9 / 15
Network
Bytes per response 137 B 95 % CI 137–137 137–137 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 5.70 runnable tasks 95 % CI 4.99–6.35 4.99–6.35 5 10 / 15
CPU clock 3,613 MHz 95 % CI 3,573–3,627 3,573–3,627 5 —
Load generator CPU 0.35 95 % CI 0.34–0.36 0.34–0.36 5 7 / 15

20 queries

Closed loop

  • GET /queries
  • 20 SELECT per request
Metric Median 95 % CI n Rank
Throughput 3,781 req/s 95 % CI 3,751–3,850 3,751–3,850 5 8 / 15
Latency p99 100.10 ms 95 % CI 98.06–104.10 98.06–104.10 5 12 / 15
CPU per request 525.0 µs 95 % CI 516.6–531.6 516.6–531.6 5 10 / 15
Memory under load (PSS) 277.4 MiB 95 % CI 273.1–283.4 273.1–283.4 5 14 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 31.30 ms 95 % CI 30.85–31.92 30.85–31.92 5 6 / 15
Latency p90 60.33 ms 95 % CI 59.55–61.33 59.55–61.33 5 12 / 15
Latency p99.9 138.26 ms 95 % CI 134.97–146.92 134.97–146.92 5 13 / 15
Latency p75 44.53 ms 95 % CI 43.55–44.76 43.55–44.76 5 11 / 15
Latency p99.99 178.46 ms 95 % CI 166.31–199.96 166.31–199.96 5 13 / 15
Latency mean 34.92 ms 95 % CI 34.28–35.05 34.28–35.05 5 8 / 15
Latency std. dev. 19.70 ms 95 % CI 19.39–20.56 19.39–20.56 5 13 / 15
Latency max 217.92 ms 95 % CI 196.96–241.70 196.96–241.70 5 13 / 15
CPU
CPU used 1.99 cores 95 % CI 1.98–1.99 1.98–1.99 5 —
User-space CPU share 0.423 95 % CI 0.420–0.439 0.420–0.439 5 —
CPU throttling 15.6 ms 95 % CI 8.0–25.5 8.0–25.5 5 12 / 15
Memory
Anonymous memory peak 243.6 MiB 95 % CI 239.3–249.9 239.3–249.9 5 14 / 15
Database
Database CPU per request 802.8 µs 95 % CI 801.6–806.8 801.6–806.8 5 4 / 15
SELECTs per request 20.04 queries 95 % CI 20.04–20.05 20.04–20.05 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 929.6 J 95 % CI 922.5–940.5 922.5–940.5 5 —
Package energy per request 16.286 mJ 95 % CI 16.063–16.592 16.063–16.592 5 8 / 15
Network
Bytes per response 744 B 95 % CI 744–744 744–744 5 —
Disk I/O
Disk writes 12 KiB — 5 14 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 6.26 runnable tasks 95 % CI 5.96–7.32 5.96–7.32 5 10 / 15
CPU clock 3,507 MHz 95 % CI 3,427–3,627 3,427–3,627 5 —
Load generator CPU 0.05 95 % CI 0.05–0.05 0.05–0.05 5 9 / 15

Updates

Closed loop

  • GET /updates
  • 5 SELECT + 5 UPDATE per request
Metric Median 95 % CI n Rank
Throughput 6,667 req/s 95 % CI 6,532–6,785 6,532–6,785 5 8 / 15
Latency p99 70.57 ms 95 % CI 66.14–71.12 66.14–71.12 5 14 / 15
CPU per request 295.8 µs 95 % CI 293.6–304.9 293.6–304.9 5 10 / 15
Memory under load (PSS) 277.5 MiB 95 % CI 273.2–283.5 273.2–283.5 5 14 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 17.30 ms 95 % CI 17.09–17.73 17.09–17.73 5 6 / 15
Latency p90 39.35 ms 95 % CI 37.33–39.92 37.33–39.92 5 14 / 15
Latency p99.9 100.00 ms 95 % CI 96.63–103.19 96.63–103.19 5 14 / 15
Latency p75 27.23 ms 95 % CI 26.07–27.35 26.07–27.35 5 13 / 15
Latency p99.99 135.22 ms 95 % CI 122.37–136.56 122.37–136.56 5 14 / 15
Latency mean 20.64 ms 95 % CI 20.02–20.86 20.02–20.86 5 10 / 15
Latency std. dev. 14.48 ms 95 % CI 13.49–14.84 13.49–14.84 5 14 / 15
Latency max 161.07 ms 95 % CI 156.26–192.92 156.26–192.92 5 14 / 15
CPU
CPU used 1.98 cores 95 % CI 1.95–1.99 1.95–1.99 5 —
User-space CPU share 0.449 95 % CI 0.443–0.461 0.443–0.461 5 —
CPU throttling 9.7 ms 95 % CI 5.8–12.7 5.8–12.7 5 12 / 15
Memory
Anonymous memory peak 243.7 MiB 95 % CI 239.4–250.0 239.4–250.0 5 14 / 15
Database
Database CPU per request 489.8 µs 95 % CI 475.6–491.7 475.6–491.7 5 8 / 15
SELECTs per request 5.01 queries 95 % CI 5.01–5.01 5.01–5.01 5 —
UPDATEs per request 5.01 queries 95 % CI 5.01–5.01 5.01–5.01 5 —
Energy
CPU package energy 947.3 J 95 % CI 940.4–957.9 940.4–957.9 5 —
Package energy per request 9.492 mJ 95 % CI 9.266–9.650 9.266–9.650 5 11 / 15
Network
Bytes per response 267 B 95 % CI 267–267 267–267 5 —
Disk I/O
Disk writes 12 KiB 95 % CI 0–12 0–12 5 14 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 7.12 runnable tasks 95 % CI 6.23–8.56 6.23–8.56 5 8 / 15
CPU clock 3,613 MHz 95 % CI 3,583–3,627 3,583–3,627 5 —
Load generator CPU 0.08 95 % CI 0.08–0.09 0.08–0.09 5 8 / 15

List

Closed loop

  • GET /list
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 19,898 req/s 95 % CI 19,593–20,141 19,593–20,141 5 9 / 15
Latency p99 15.83 ms 95 % CI 15.39–16.05 15.39–16.05 5 11 / 15
CPU per request 99.5 µs 95 % CI 98.6–100.5 98.6–100.5 5 8 / 15
Memory under load (PSS) 294.6 MiB 95 % CI 283.8–296.1 283.8–296.1 5 14 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 6.10 ms 95 % CI 6.02–6.18 6.02–6.18 5 9 / 15
Latency p90 10.66 ms 95 % CI 10.57–10.75 10.57–10.75 5 10 / 15
Latency p99.9 22.39 ms 95 % CI 21.08–22.93 21.08–22.93 5 10 / 15
Latency p75 8.07 ms 95 % CI 7.98–8.40 7.98–8.40 5 9 / 15
Latency p99.99 31.51 ms 95 % CI 28.02–50.31 28.02–50.31 5 10 / 15
Latency mean 6.48 ms 95 % CI 6.43–6.60 6.43–6.60 5 9 / 15
Latency std. dev. 3.19 ms 95 % CI 3.09–3.25 3.09–3.25 5 12 / 15
Latency max 41.99 ms 95 % CI 39.45–90.42 39.45–90.42 5 10 / 15
CPU
CPU used 1.98 cores 95 % CI 1.95–1.98 1.95–1.98 5 —
User-space CPU share 0.619 95 % CI 0.615–0.627 0.615–0.627 5 —
CPU throttling 9.1 ms 95 % CI 3.9–10.5 3.9–10.5 5 10 / 15
Memory
Anonymous memory peak 261.1 MiB 95 % CI 250.4–262.6 250.4–262.6 5 14 / 15
Database
Database CPU per request 122.6 µs 95 % CI 120.2–124.3 120.2–124.3 5 9 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 823.7 J 95 % CI 815.5–831.2 815.5–831.2 5 —
Package energy per request 2.756 mJ 95 % CI 2.729–2.770 2.729–2.770 5 9 / 15
Network
Bytes per response 4,738 B 95 % CI 4,738–4,738 4,738–4,738 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 7.41 runnable tasks 95 % CI 6.34–9.11 6.34–9.11 5 10 / 15
CPU clock 3,600 MHz 95 % CI 3,553–3,613 3,553–3,613 5 —
Load generator CPU 0.25 95 % CI 0.24–0.25 0.24–0.25 5 8 / 15

JSON POST

Closed loop

  • POST /orders
  • body orders.json
Metric Median 95 % CI n Rank
Throughput 23,460 req/s 95 % CI 23,203–24,061 23,203–24,061 5 11 / 15
Latency p99 8.07 ms 95 % CI 7.95–8.10 7.95–8.10 5 8 / 15
CPU per request 84.6 µs 95 % CI 82.4–85.5 82.4–85.5 5 11 / 15
Memory under load (PSS) 295.0 MiB 95 % CI 284.3–301.9 284.3–301.9 5 14 / 15
23 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 5.35 ms 95 % CI 5.22–5.42 5.22–5.42 5 11 / 15
Latency p90 6.44 ms 95 % CI 6.30–6.50 6.30–6.50 5 10 / 15
Latency p99.9 10.07 ms 95 % CI 9.83–10.59 9.83–10.59 5 5 / 15
Latency p75 5.69 ms 95 % CI 5.57–5.76 5.57–5.76 5 10 / 15
Latency p99.99 14.34 ms 95 % CI 13.36–45.82 13.36–45.82 5 7 / 15
Latency mean 5.42 ms 95 % CI 5.30–5.50 5.30–5.50 5 11 / 15
Latency std. dev. 0.95 ms 95 % CI 0.90–1.13 0.90–1.13 5 5 / 15
Latency max 52.41 ms 95 % CI 14.93–80.36 14.93–80.36 5 12 / 15
CPU
CPU used 1.98 cores 95 % CI 1.98–1.98 1.98–1.98 5 —
User-space CPU share 0.736 95 % CI 0.734–0.746 0.734–0.746 5 —
CPU throttling 5.0 ms 95 % CI 2.9–6.8 2.9–6.8 5 6 / 15
Memory
Anonymous memory peak 261.7 MiB 95 % CI 250.9–268.1 250.9–268.1 5 14 / 15
Database
Database CPU per request < 0.1 µs 95 % CI < 0.1–0.1 < 0.1–0.1 5 7 / 15
Energy
CPU package energy 722.9 J 95 % CI 706.6–731.2 706.6–731.2 5 —
Package energy per request 2.024 mJ 95 % CI 2.003–2.052 2.003–2.052 5 11 / 15
Network
Bytes per response 195 B 95 % CI 195–195 195–195 5 —
Disk I/O
Disk writes 12 KiB — 5 14 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 6.91 runnable tasks 95 % CI 6.40–8.68 6.40–8.68 5 7 / 15
CPU clock 3,733 MHz 95 % CI 3,613–3,788 3,613–3,788 5 —
Load generator CPU 0.35 95 % CI 0.34–0.35 0.34–0.35 5 7 / 15

Single query, 16 connections

Closed loop

  • GET /db
  • 16 connections
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 29,548 req/s 95 % CI 28,693–29,988 28,693–29,988 5 10 / 15
Latency p99 1.10 ms 95 % CI 1.08–1.42 1.08–1.42 5 6 / 15
CPU per request 55.0 µs 95 % CI 54.2–56.9 54.2–56.9 5 9 / 15
Memory under load (PSS) 293.1 MiB 95 % CI 284.5–300.1 284.5–300.1 5 14 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 0.52 ms 95 % CI 0.51–0.53 0.51–0.53 5 10 / 15
Latency p90 0.71 ms 95 % CI 0.70–0.73 0.70–0.73 5 8 / 15
Latency p99.9 2.53 ms 95 % CI 2.48–3.56 2.48–3.56 5 7 / 15
Latency p75 0.62 ms 95 % CI 0.61–0.64 0.61–0.64 5 9 / 15
Latency p99.99 4.37 ms 95 % CI 3.87–6.08 3.87–6.08 5 5 / 15
Latency mean 0.54 ms 95 % CI 0.53–0.56 0.53–0.56 5 8 / 15
Latency std. dev. 0.20 ms 95 % CI 0.19–0.25 0.19–0.25 5 5 / 15
Latency max 6.73 ms 95 % CI 6.59–8.87 6.59–8.87 5 5 / 15
CPU
CPU used 1.63 cores 95 % CI 1.60–1.65 1.60–1.65 5 —
User-space CPU share 0.531 95 % CI 0.529–0.542 0.529–0.542 5 —
CPU throttling 0.0 ms — 5 1 / 15
Memory
Anonymous memory peak 259.8 MiB 95 % CI 251.0–266.3 251.0–266.3 5 14 / 15
Database
Database CPU per request 78.2 µs 95 % CI 77.0–80.2 77.0–80.2 5 10 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 703.6 J 95 % CI 701.7–712.2 701.7–712.2 5 —
Package energy per request 1.573 mJ 95 % CI 1.568–1.624 1.568–1.624 5 9 / 15
Network
Bytes per response 137 B 95 % CI 137–137 137–137 5 —
Disk I/O
Disk writes 12 KiB — 5 14 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 6.40 runnable tasks 95 % CI 5.87–7.59 5.87–7.59 5 10 / 15
CPU clock 3,318 MHz 95 % CI 3,241–3,440 3,241–3,440 5 —
Load generator CPU 0.35 95 % CI 0.34–0.36 0.34–0.36 5 7 / 15

Single query, 512 connections

Closed loop

  • GET /db
  • 512 connections
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 26,108 req/s 95 % CI 25,474–26,479 25,474–26,479 5 9 / 15
Latency p99 84.31 ms 95 % CI 81.05–90.46 81.05–90.46 5 11 / 15
CPU per request 75.4 µs 95 % CI 74.5–77.5 74.5–77.5 5 9 / 15
Memory under load (PSS) 667.2 MiB 95 % CI 662.8–685.5 662.8–685.5 5 14 / 15
25 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 15.94 ms 95 % CI 15.71–16.68 15.71–16.68 5 9 / 15
Latency p90 49.48 ms 95 % CI 48.68–50.43 48.68–50.43 5 12 / 15
Latency p99.9 120.34 ms 95 % CI 112.06–141.49 112.06–141.49 5 12 / 15
Latency p75 32.30 ms 95 % CI 31.71–32.72 31.71–32.72 5 11 / 15
Latency p99.99 178.84 ms 95 % CI 149.30–218.21 149.30–218.21 5 13 / 15
Latency mean 22.61 ms 95 % CI 22.20–22.68 22.20–22.68 5 11 / 15
Latency std. dev. 19.14 ms 95 % CI 18.66–20.40 18.66–20.40 5 12 / 15
Latency max 209.69 ms 95 % CI 194.38–247.56 194.38–247.56 5 12 / 15
CPU
CPU used 1.97 cores 95 % CI 1.97–1.97 1.97–1.97 5 —
User-space CPU share 0.555 95 % CI 0.551–0.557 0.551–0.557 5 —
CPU throttling 7.1 ms 95 % CI 6.4–9.1 6.4–9.1 5 7 / 15
Memory
Anonymous memory peak 633.5 MiB 95 % CI 629.3–652.0 629.3–652.0 5 14 / 15
Database
Database CPU per request 84.4 µs 95 % CI 83.9–87.1 83.9–87.1 5 9 / 15
SELECTs per request 1.00 queries 95 % CI 1.00–1.00 1.00–1.00 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 742.2 J 95 % CI 734.3–747.5 734.3–747.5 5 —
Package energy per request 1.893 mJ 95 % CI 1.868–1.916 1.868–1.916 5 9 / 15
Network
Bytes per response 137 B 95 % CI 137–137 137–137 5 —
Disk I/O
Disk writes 0 KiB — 5 1 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 6.31 runnable tasks 95 % CI 5.85–7.56 5.85–7.56 5 9 / 15
CPU clock 3,533 MHz 95 % CI 3,427–3,547 3,427–3,547 5 —
Load generator CPU 0.32 95 % CI 0.32–0.33 0.32–0.33 5 7 / 15

Fixed load (5,000 req/s)

Fixed rate

  • GET /db
  • 5,000 req/s fixed
  • 64 connections
  • 20s measured
  • 1 SELECT per request
Metric Median 95 % CI n Rank
Throughput 4,999 req/s 95 % CI 4,999–4,999 4,999–4,999 5 11 / 15
Latency p99 2.83 ms 95 % CI 2.64–5.39 2.64–5.39 5 10 / 15
CPU per request 209.7 µs 95 % CI 207.0–210.8 207.0–210.8 5 4 / 15
Memory under load (PSS) 671.4 MiB 95 % CI 664.9–686.9 664.9–686.9 5 14 / 15
24 more metrics
Metric Median 95 % CI n Rank
Throughput
Errors 0 requests — 5 1 / 15
Error rate 0.0000 — 5 1 / 15
Latency
Latency p50 0.76 ms 95 % CI 0.76–0.77 0.76–0.77 5 6 / 15
Latency p90 1.15 ms 95 % CI 1.14–1.17 1.14–1.17 5 6 / 15
Latency p99.9 14.85 ms 95 % CI 11.47–18.48 11.47–18.48 5 12 / 15
Latency p75 0.91 ms 95 % CI 0.91–0.94 0.91–0.94 5 5 / 15
Latency p99.99 25.43 ms 95 % CI 17.52–55.48 17.52–55.48 5 13 / 15
Latency mean 0.87 ms 95 % CI 0.86–0.94 0.86–0.94 5 7 / 15
Latency max 31.77 ms 95 % CI 21.70–61.79 21.70–61.79 5 13 / 15
CPU
CPU used 1.05 cores 95 % CI 1.03–1.05 1.03–1.05 5 —
User-space CPU share 0.600 95 % CI 0.594–0.608 0.594–0.608 5 —
CPU throttling 0.0 ms — 5 1 / 15
Memory
Anonymous memory peak 637.9 MiB 95 % CI 631.6–653.4 631.6–653.4 5 14 / 15
Database
Database CPU per request 146.8 µs 95 % CI 145.6–148.6 145.6–148.6 5 6 / 15
SELECTs per request 1.00 queries — 5 —
UPDATEs per request 0.00 queries — 5 —
Energy
CPU package energy 414.6 J 95 % CI 404.2–423.1 404.2–423.1 5 —
Package energy per request 4.146 mJ 95 % CI 4.042–4.231 4.042–4.231 5 10 / 15
Network
Bytes per response 30 B — 5 —
Disk I/O
Disk writes 12 KiB — 5 14 / 15
Measurement quality
Hypervisor steal 0.0 % — 5 1 / 15
Host load 6.86 runnable tasks 95 % CI 5.42–7.81 5.42–7.81 5 9 / 15
CPU clock 1,230 MHz 95 % CI 1,213–1,264 1,213–1,264 5 —
Load generator CPU 0.14 95 % CI 0.14–0.14 0.14–0.14 5 12 / 15