> But I'm also interested is retraining needed? how relevant will a model be in N years if it's just "static", and if you do need to retrain and fine-tune over time, is it still profitable? how often is that needed?

Just wait until what Ilya Sutskever has for Safe Super Intelligence (SSI) to self update the weights without retraining them to bring training costs down close to $0.