He was a mediocre (though certainly good for a catcher) hitter in the majors and featured that in his self-deprecating humor. He once told this story on himself: He knew that it was time to retire, when he was catching and his ex-teammate Stan Musial stepped into the batter's box, turned to Joe, and said, "When are you gonna quit?"
Looking back at his career in 1970, Garagiola observed, "It's not a record, but being traded four times when there are only eight teams in the league tells you something. I thought I was modeling uniforms for the National League.