The differences aren’t so great that they can’t be ignored, and I would say most ignore them. We don’t all agree exactly where the differences are, either. IMO, where there are differences, it’s usually just a matter of degrees. Ballhandling matters in all sets. It’s slightly more important in FB and motion. Passing matters in all sets. It’s slightly more important in triangle and flex.
Personally, I think the physical attributes are where the biggest differences are; absolutely vital for FB at the top end, a bit less so for triangle at the bottom, but it’s relatively important for all (moreso on the defensive side, though, IMO).