Spiralling living costs are putting off prospective homebuyers and denting confidence in the housing market, according to the Building Societies Association (BSA).