The Bank of England’s decision to withdraw its affordability test recommendation following an industry-wide consultation has been labelled irresponsible by brokers.