I think you're taking that far more seriously than it merits. I'd just read it as "we had fun times too"