Like yourself I hankered after crossing the channel to france. I did it a few years ago now and to be honest, it was boring. I don't like the french/france, but I suspect the feeling is mutual.
Your far better off coast hoping. More to see, stop off's etc. Plodding acroos the channel for a couple of hours is not much fun for thoise that have noting to do apart from keeping a lookout for othe boats/ferries/ships.
It is possible to do it in your boat with plenty of prep and watching for the weather. Sods law dictates that the crossing over will be fine and then coming back will be a bit lumpy. We went across with 60 odd miles of near flat water. Half way back the wind picked up, which wasn't forecast, and things got interesting.