Business confidence in the UK food industry is on the wane, with the country's trade body citing Brexit as a factor in the growing anxiety among parts of its membership.