To some degree it's fluke. No your defense isn't that bad. And you know that because your defense on average gives up less than 50% shooting per game. But average means it doesn't have to always be around the exact number.
2 things that could have contributed though. 1. He took a lot of free throws. So it could just be that many of his misses you fouled, which doesn't count as a missed shot. and 2. Because your team was in foul trouble some of your players, especially your big men, were very tired during the game, and he took advantage of that. Thar going along with him having better team stamina and one extra eligible player, and your stamina being a little misleading since your walk-on has good stamina.