That depends on what defense you play. If you play zone, don't worry about it. If you play man, you might consider switching if the opposition has a particularly high distro PF, but I would be careful about that if the other PF was fast. If you are playing press, maybe someone who is more of a press guru should weigh in, but I would stick with the speed at PF in the press.