this will change as inference demand increases (which is happening right now faster than many people expected)