The rising cost of raw sugar ate into the bottom line at US sugar refiner Imperial Sugar during its fourth quarter, the company has reported.