I'd rather be listening

Like the bumper sticker, I'd rather be golfing, or whatever you would claim as the better activity, try claiming listening as the better activity. When you are tense, rushed, irritated, or angry, and your tongue is ready to announce, just tell yourself, "I'd rather be listening." Bonus, you can listen while you're golfing or whatever.