> you just prompt engineer a bit and it often magically works

yea, i agree, thats the biggest selling point right now

i just get the feeling reproducibility, performance and cost will start to become more and more important as time goes on... jmo tho