UK cake maker Finsbury Food Group has said the past six months have been extremely challenging for the company.