There have been plenty of occasions since the early hours of 24 June 2016 when those in the UK who voted for the country to stay in the EU would have held their heads in the hands.