There are two kind of hot spa in Japan; Sento and Onsen. Sento are public baths that can be found in many neighborhoods, and Onsen are naturally occuring hot springs with geothermaically heated water full of minerals. And they are more than just bathing.
This is another video of how to enter Japanese Sento.