The impact of inflation and clients running out of money sooner than expected are the biggest harms to consumers in retirement, IFAs have said.