There are several stand-out episodes in season 1 and 2, as well as several stand-out scenes; plus the second half of season 2 is not mediocre. You also miss out on character and world-building that happens in those episodes that help contextualize a lot of the later seasons.

Plus, many reactors now have liked season 1 a lot better than when it initially aired.