He walked away after he was considering you, or he signed with a different team?
In all my years of playing this game, if a player is considering you and you have offered him a scholarship, he always signs eventually, unless another school signs him first.
The visits are just used to get the player to consider you, or to battle another coach recruiting the same player. Once the player is considering you, it doesn't matter whether you have visited him or not. I sign players all the time without ever using a home or campus visit.