About a quarter of people feel they are not responsible for their retirement and would be inclined to blame others should anything go wrong.