US baker Flowers Foods has bought back a bakery building in Georgia from The Schwan Food Co.