Check out Buzzkill, its a great app for managing notification rules. You can set it to hide and batch up notifications during your off hours and show them later.