logoalt Hacker News

knaughttoday at 3:45 PM0 repliesview on HN

The code behind this is a whole AWS stack built as part of our larger infrastructure. It's not just a simple script, it's a full data pipeline. The MLC data is ~400GB of raw TSV data dropped on an FTP server every week, which we then process, index, make available internally for our tools. The Blackbox site is a frontend that leverages this infrastructure.

That being said, everything we use here, the MLC Bulk Data feed and the Spotify API are publicly available.

https://www.themlc.com/bulk-database-feed ($100 sign up fee and $25/mo)