It normally takes 4 - 5hrs to get to Montreal...it took us 8hrs...in the rain. Did I mention it rained all the way? Why go? I'd rather spend 8hrs in the rain on my bike, than 8hrs at work.
Trust me it's worth it once you get up to Mont-Tremblant. A little rain, but nothing serious.