Victims of investment fraud have lost at least £657m in the past year, as scammers preyed on financial vulnerability caused by the coronavirus pandemic.