> 512 shards, each with one Postgres primary each on an r8g.16xlarge
> 480 Neki routers, each on its own 8xlarge instance
> We sustained 118,538,803 QPS for 16 minutes across 512 shards and 1.22 PiB of data. Our largest recording was 118,747,267.
Component Detail Monthly Hourly 16-min burst
---------------------------------------------------------------------------------------------
Shard compute 512x r8g.16xlarge $1.41M $1,930 $515
Router compute 480x r8g.8xlarge* $661K $905 $241
Storage (gp3 floor) 1.22 PiB @ $0.08/GB-mo $102K $140 $37
Storage (io2 floor) 1.22 PiB @ $0.125/GB-mo $160K $219 $58
IOPS (io2, light) 5K IOPS/shard, tiered rate $166K $228 $61
IOPS (io2, medium) 20K IOPS/shard, tiered rate $666K $912 $243
IOPS (io2, worst-case) 231,517 IOPS/shard (0% cache) $4.56M $6,251 $1,667
---------------------------------------------------------------------------------------------
Total (gp3 floor) $2.17M $2,975 $793
Total (io2 floor) $2.23M $3,054 $814
Total (io2 + light IOPS) $2.40M $3,282 $875
Total (io2 + medium IOPS) $2.90M $3,966 $1,058
Total (io2 + worst-case IOPS) $6.79M $9,305 $2,481I see the machine sizes some people are allowed to use and I cry. Here I am being asked to downsize our VMs to only use 32 GB RAM.
your calculation does not account for the load generation and cross-az network cost