Any increase in the amount of tax buy-to-let landlords are having to pay could have a devastating impact on the market, an expert has warned, after the Labour party said it was looking at raising taxes on unearned income.