That's a good point. Truth is, I'm actively working 4-5 hours a day. That means, for 7-8 hours per day, I'm simply monitoring emails/phone calls/overseeing day to day ops. Lot of time to fill.
But, if I've said something you don't like, it's convenient to say "You must not have a life." Which is fine. Maybe I don't. But YOU don't KNOW that. You're just trying to be a passive-aggressive jerk.