If you stay late it looks like a) you're struggling, b) you're a try-hard, c) you don't have a life after work.
One of the most actionable low-hanging career advices I could give is be among the first ones to pack up and leave for the day. You can always continue working at home if you're not done.
When I worked for a crypto startup early in my career, we were once chastised because no one was in the office at 6:30pm. Some engineers (including me) did mostly work from home but most people, engineers and non engineers alike, mostly worked from the office.
And a couple years ago I did a short consulting stint for an AI startup (I know how to pick the bubbles huh?) where I shipped something at around 6pm my time, got a call at 9pm their time to talk about it, and then he asked me "what are you working on tonight?" I quit the next day.
Anyway, this advice confuses me because many companies see staying late as a badge of commitment. Maybe it doesn't apply to startups.