alt Hacker NewsThere’s many nation states working on this, have you looked into availability of those data sets?
What languages are you prioritizing?
There’s many nation states working on this, have you looked into availability of those data sets?
What languages are you prioritizing?
Yes, there are government datasets, languge "acadamies" (or "regulators") - organizations focused on preserving / teaching the language, and often smaller, local publishers that publish material in their local language.
I'm living in Guatemala, so have been focusing on the Mayan languages here (22 languages, millions of speakers).