You forgot to mention that those people weren't considered "white" at the time.