The Financial Conduct Authority's pension transfer findings may have been skewed by a few bad eggs, it has been suggested.