This one has always confused me as well. Tapping the screen, as the other commenter suggested, dismisses the whole thing too, so I have to fish for the stop button in the notifications every time.
Maybe there’s “the Apple way” that we’ve yet to discover.
The Apple way is to have an Apple watch and deal with the alarm there