A Scottish government minister has heard concerns about post-Brexit labour availability during a visit to a meat processing plant.