A number of brokers want Help to Buy (HTB) schemes to be restricted to first time buyers (FTBs) should the scheme be extended, while others are calling for further restrictions on loan size.