Total broker numbers at the Mortgage Advice Bureau have fallen by 4 per cent to reach 2,158 at the end of 2023.