Interesting question. I routinely add clay to my shaving routine. Followers of The Method also use clay. In my experience, blades last the same. My shaves are smoother with clay.
I wouldn't expect a clay particle to cause any issues with a blade. Clays are supposed to be smooth and slippery. Now if you were shaving with sand, I could see problems arising.