I did this for my child with an ESP32, RFID cards off ebay, and MP3s on a SD card. A fun project.
Tip: it's much quicker to read the serial number of the RFID card and rename the MP3 than it is to program the MP3 name to the card!
> rename the MP3
Depending on the SD card formatting, perhaps a nice big folder of symlinks.
For people looking at OSS, Phoniebox seems to be the popular/mature project: https://phoniebox.de/index-en.html
(My partner and I are building one for our daughter)