Depends. I might make a new base. I might enlarge the cut out. I might not care. It might not be an issue and not warrant fussing over. If the stone requires too much pressure to fit into the wood, I'd either not use the wood or fix it so the stone fits.
I would opt to make a call on inspection, not speculation.
I would opt to make a call on inspection, not speculation.