Have you tried [0]? It can source values from CSV file and after configuring a label and sheet template you should be able to use it to print filled labels.

Can be used it with a thermal label printer and with generic label sheets if you are willing to hand tweak templates.

[0] https://glabels.org/