Your first sentence applies to both coffee and tea. It's really a subjective matter. Either can get expensive. Coffee probably has the higher upper range of pricing but you don't have to get expensive with either option. A hand mill and a pourover are certainly viable options for coffee.The tea itself can be pricey, some of the Chinese teas cost hundreds of $$ per kilo, but the equipment to make it well does not have to be.
Good coffee gear costs a mint.
I'd say go for whatever you enjoy more if you have to pick.