Isn't "not being upsidedown" just one of the default properties of a button in whatever GUI toolkit you are using? I'd be worried if an LLM _did_ start setting all the possible button properties.
If you ask for increase and decrease buttons they will put the right icons on it (not words) and lay them out right.
Putting LLMs on a pedestal is very much in vogue these days.