People tend to be happier the earlier they retire but often this is dampened by the fact that their finances have taken a hit, research has found.