I forgot to mention how scenic the areas were ... it was a very pretty drive and a great location to soak and take in the beauty. We seemed to be the only non-locals ... everybody we spoke to was from Santa Barbara. They were amazed that we had traveled so far to visit the hot springs. We did find one couple that my husband had met once before at Remington Hot Spring. They were camped in the other site next to ours.
And one other thing about the map that Rick posted from the Forest Service ... it's a little inaccuarate. The "picnic site" is labled as Lower Caliente but it is actually a campground (in that spot). The day use symbol (picnic table symbol) should be at Big Caliente Hot Spring. And the other symbol further up above Big Caliente on the map labled as Upper Caliente campground doesn't really exist.
I would really recommend visiting when it's not summer/hunting season (less flies and lower temperatures).