The amount of livestock that we actually would need in that case is probably around 5% of what we actually have (in the US). So it’s still valid if half of all people became vegetarian, and the remaining amount cut their meat consumption to “special occasions only”.

Keep in mind that a lot of our current agriculture is growing feed for livestock as well, so we could cut back on plant farming by a huge amount as well, if we greatly reduced livestock.