> Instruct models are already so tuned that they could not be tuned

Some models have the base model available, that is before instruction tuning. For example llama 3 comes in "pre-trained and instruction tuned variants" [1]. I'm guessing you already know that though.

[1] https://huggingface.co/meta-llama/Meta-Llama-3-8B