Any Airpods connect directly to the AppleTV. You don't need the remote, phone or an app at all.
If you're using wired headphones then a $20 Bluetooth dongle will do the same.
Pretty much any bluetooth headphones work connected directly to the AppleTV, not just Airpods
Pretty much any bluetooth headphones work connected directly to the AppleTV, not just Airpods