UK bakery business Finsbury Food Group confirmed it will close its loss-making Grain D'Or factory with an expected completion date of 2 December.