I also ended up doing this. With HDMI-CEC powering up the TV and the receiver automatically, then switching to the correct input on any AppleTV remote button press, this is actually a really friction free option if you can stomach buying two devices for the same purpose. I put the remotes in different colored rubber cases (red and blue) to make clear which device is being operated.

At one stage I even had a third AppleTV, that was hooked permanently to a VPN exiting in a foreign country, so I could get TV content and applications restricted to another region I watch a lot of content in. It was so nice to just pick up a remote and instantly have the foreign appleTV experience, rather than juggle VPN apps and foreign Apple Store accounts on the same device.