Too many advisers are doing what is convenient for them rather than the client, according to a new report.