why were you using 2 remotes? did you have other systems attached to the television, such as a game console, or cable?
the Apple TV provides hdmi cec, which should control your television through the hdmi cable.