Paul,
That's like saying we should outlaw the use of automobiles because some of the "user group" rob banks, run red lights, smuggle drugs, kidnap children, speed on our highways, drive drunk, commit road rage, and drive without a seatbelt.
Your assertion is not logical.
What you are asserting is the mantra of ecochondriacs and the laundry list of complaints they have compiled about what those horrible people on OHV's do when left to their own devices. Non-compliance is rarely a reason for banning an activity, unless the activity itself is illegal. Last I checked, OHV use is a legal, legitimate, and wholesomely family-oriented activity that just happens to piss some people off, even when done in areas they never gave a rip about before.
Hypersensitivity about the environmental wisdom of someone else's legal activity is not grounds for elimination. Never has been, although ecochondriacs have gotten away with sticking their noses into other peoples' business for decades. Look for that to gradually end.
PS: last I checked, there were no speed limits on OHV trails, and BLM or USFS or the Sheriff do not perform brake checks. I don't know where you got these things, unless you were merely searching for more unfounded complaints.