"Single market (but food treated specially)" wouldn't be unprecedented; Switzerland was basically like this for a long time.

Working Time Directive may be more of a sticking point, though Canada doesn't seem _that_ far away from aligned with it anyway (big difference would be on paid time off, where Canada's way under the minimum).