I agree. In my expereince swimming is not good for feeling fresh and up. For me it's a bother for the cardiovascular system (as is even more to have a sauna- I hate it). It's nice to relax in the water after a work day but it makes me tired (even a shower does that to me). Short regeular exercises are the best thing to stay fit I think, like doing many ways walking or by bike.
Leaving the city (where I had to walk much more) and now living in the country side and just getting in and out of a car did bad things to the extend of fitniss I had (I'm not saying that it was *that* much, but still).