I've been a lifetime swimmer, so I can relate. There's a reason a lot of swimmers and waterpolo players gain tons of weight as soon as they stop training.

Usually if you can fight through the "hunger" it'll calm down in its own after about an hour or so in my experience.