Ironically, training wheels are actually a bad way to teach a kid how to ride a bike. They teach kids bad habits (like turning the handlebars to steer rather than leaning).

Balance bikes are a better first step and are actually really fun compared to training wheels.