There's no way that it hasn't existed for infinity, for the value where universe = literally everything. It can't come from nothing, so it has always existed. I am obviously not aware of the formal definition of universe, considering there are theories of our universe being one of many bubbling in the cosmic foam.
Whereas I really like the idea that infinities cannot exist, so for any definition of the universe, it must have had a start somewhere/when.