Let's just cut to the chase.
You think you should be able to do anything you want any time you want if you're not breaking any laws.
I actually agree.
But then I realize that I live in the real world where cops shoot people, people shoot cops, people rob people, people rape people, etc, etc and I think "Maybe there are some perfectly legal things I just shouldn't do in order to decrease my risk."