MWF > everything else
I was suggesting using it as a preshave. The olive oil acts as a barrier, protecting the moisture below from the lather on top. I used it during the winter, and it definitely helped keep my face from drying out.Or another option I heard discussed is using some sort of oil, such as olive oil as a shaving medium. It was used by the roman's centuries ago.
I don't know whether or not that would appeal but it would keep your face very moisturised, although it is a very different experience (having experimented with it myself).
In any case hope You find a Solution
Regards