The D3D -> VK layer actually seems to speed things up, so maybe we'll just end up back where we started :)