Investors have withdrawn a total of £1.3bn from the Baillie Gifford Japan fund over the past three years to the end of October, equivalent to over £400mn per year.