Some 3.6 million people aged 65-plus in the UK have retired earlier than they expected due to circumstances out of their control, research revealed.