Shareholders in the £1bn Temple Bar investment trust have rejected a proposal from its board to have an increased focus on ethical investments.