Baked goods manufacturer Finsbury Food Group posted a 76% rise in annual operating profit despite a challenging environment.