RGMII isn't really designed to go board-to-board, fairly high data rates, and ideally all of the signals should be delay matched. That gets a bit trickier when there are two boards involved. Also I would expect EMI/EMC issues.

I know people do that sort of thing for evaluation kits, but it doesn't seem like a good idea for production.