I have done it actually a couple times by clicking in the priority button then accidently changing it to "remove" by using my wheel on my mouse. I use it to scroll to the bottom of the screen to save and not realizing the wheel scrolled it to remove.
And no worries about the thread that's one of the reasons for a forum.