An increase in costs has weighed on annual profits at UK private-label supplier and Ginsters owner Samworth Brothers.