I have camped there about a dozen times and the only problem I had was when a snake got into my tent and did not leave for @ 30 minutes. The forest adventure pass is not required either. Another time I saw some deer there, they did not scare me though. Best time is during a full moon. I usually park behind the guard rail next to the bridge. Uphill and to the south of there is some good flat spots to camp with large trees near by. The last time I camped there I parked in front of the police camera near the gate at the end of the road. I felt really safe there.
Good luck and stay safe !