Matrix,
If you are looking for just a few folks you need to visit during the week and you will find a few mellow folks. On weekends you will always find more people.
However, one of the things I like about this "oasis" is that it is nice year round. Spring, Summer, Autum and Winter all offer different attractions and continous changes of scenery. The neat mix of hot and water make skinny-dipping year round a possible, and hiking is always great too. You should try visiting after October as well, just remember to dress in layers and bring some warm clothes.