This idea of what constitutes a “black box” and at what level of abstraction is very interesting. Take open weights for example - the weights being open affects where you can run inference (you can self-host) and allows you to modify the parameters via fine-tuning, BUT it doesn’t necessarily affect your ability to understand what a model is doing and why. Even when we’re deploying open models on our own infra, our understanding and control over model behavior is still pretty rudimentary.