Yeah referencing is the way to go, as even finetuning probably captures style more than concrete facts. I know with large context windows we don't really RAG anymore, but for owner's manual lookup with a smaller model it seems ideal.

Something every LLM user ends up learning is that they're far better used as search and summarization tools than as knowledge databases in themselves.