That slot is called USB-C. I can fully imagine inference ASICs coming in powerbank form factor that you'd just plug and play.
This would be a hell of a hot power bank. It uses about as much power as my oven. So probably more like inside a huge cooling device outside the house. Or integrated into the heating system of the house.
(Still compelling!)
Pretty sure it'd just be a thumbdrive. Are the Taalas chips particularly large in surface area?
> USB-C
With these speeds you can run it over USB2, though maybe power is limiting.