If the container is really messy, I rinse. If not, I just put the lid on, if it has one, and put it in the shave drawer.
+1 If the outside / threads gets messy I will rinse, but normally let what little lather remains on the puck there to dry.
If you don't particularly like a soap, load extra heavy and rinse puck well each time.