Here's the problem I see with that:
Let's say a HOFer played most of his career with Cincinnati (for example). The Cincinnati franchise moves to Buffalo, and a different team moves to Cincinnati.
In that case, do you really want the player to weat a Cincinnati hat? Because it would be a bit miselading, because it would look like he played for the current Cincy franchise, which he may have never played for.