Aluminum naturally develops a thin oxide layer that protects it from corrosion. The anodizing process basically creates a much thicker layer of oxide on the metal surface. The oxide layer is very durable, the thicker the layer, the more durable it is. The color comes from dyeing the oxide surface after it is formed.
I'd suggest avoiding anything that would be very abrasive, or scraping with a hardened steel tool.