"any reason for concern, regarding bacteria in the pools vs. an infant's less-than-full-power immune system" -
How about you consider other people who came to enjoy the springs? Are your kids potty trained already? Is there a possibility for an accident? Are they going to be freaked out by nudity? Are their noise gonna disturb piece and tranquility people seek?