Congresscritters like personal power. Trump has neutered even his own party's legislators and they do not like it, even if they fall in line out of fear. Keep in mind even when Trump is in power, his own party goes through processes like "pro forma" sessions which prevent him from making recess appointments.