No, but did any of the other big companies? Google literally found the transformer architecture but had no idea what to do with it.