Shareholders are increasingly raising concerns about director accountability, according to analysis by the Investment Association.