Well a big reason for speed limits in cities is safety, that doesn't change with EVs. Another thing you mention is collectivism but cars are a very inefficient private use of public space, both roads and parking, so when such space is scarce it makes sense to restrict them.