>Meanwhile, alkaline batteries can go to hell. You might as well plan on one leaking in the battery compartment.
On the other hand, alkaline batteries never burn your house down.
I also feel like they serve different purposes. Needed for long-term storage and only used in an emergency? (eg, a flashlight for power outages) You're probably better off going with old-fashioned alkaline batteries. Duracell claims they're good for 10 years. Needed for day-to-day usage? Lithium might be better: you can monitor for swelling, the battery recharge-ability is probably more important than any of the downsides that come with lithium ion batteries.
Alkaline has a tendency to leak electrolyte when stored in devices long-term, especially if used intermittently, even more so if the loads are at the upper end of what alkaline can handle as they are in many modern flashlights. The electrolyte is corrosive and often results in a broken device, which is exactly what you don't want in an emergency.
Li-ion's self-discharge is pretty low for a bare unprotected cell, and a flashlight with a mechanical switch consumes no power when off. One must take care to avoid short circuits when handling such a cell, but modern Li-ion flashlights have over-discharge protection, so that's the main safety concern with a single-cell design.
> You're probably better off going with old-fashioned alkaline batteries.
Never. They will leak and die. Alkaline cells always end up leaking and dying in my experience, given enough time.
In fact, I do the reverse: If it's something I think will sit for a long time, I make sure to put a rechargeable battery in it. That way, worst case, it's dead—but it won't be destroyed by a leak.
No, there's basically no reason you'd ever want an alkaline battery except cost. For your use case of long-term storage or a rarely used flashlight (e.g. in a car emergency kit), you'd want a Li/FeS2 as the parent poster recommended, also called just a "Lithium" primary (i.e. non-rechargable) cell. They have a longer shelf life, don't leak, hold more energy, can provide a higher discharge current, work over a wider temperature range, and have safety characteristics very similar to alkaline.