Posted by dahsdebater on 2/24/2012 2:14:00 PM (view original):
Must not be that sick... How can you get the up-to-date input data if you're only active in 1 world now?
i wrote that dynasty ranking program like a year and a half ago, it goes out and grabs the HTML for each team in HD. you don't need to logged in to see a particular team, just need their team ID. i did have coaches, up front, sent me the team IDs for every world. so now to grab all that data, all i do is delete the old data, hit a button, and it goes out and reads, parses, and saves the team history for every team in every world (thats like 10 thousand teams maybe). it takes good couple hours to run though, i don't want to flood WIS servers, so i only read 1 team at a time. i used to leave a delay in there too, and start 3 of them, reading from the 3 urls (whatifsports, wisjournal, whatif.cincinnati which no longer exists). but i dont really see the value in that so its just doing 1 by 1 with no delay now.
i would post the dynasty rankings more often except once i get the data, i set the program mode to like one of 7 different things it can do, like calculate all time best team dynasties, which will do juts that for 5, 10, 20 year time periods, and spit the data out in a format so i can simply copy paste to the forums. but there are so many copy pastes because there is so much data, i spit out the rankings for all of HD and for every world, so im sitting there copy pasting for like a half hour. it used to take a few hours, but i enhanced the program to spit it out in the easiest format to minimize the manual labor. really, i bet there is a coach out there who would think, a half hour of work to post dynasty rankings of every team, conferences, and other miscellaneous data by world and all of HD (like world pop data and longest streaks, like most consecutive NT appearances, etc) - well a half hour for that, they would think that was a great investment of a half hor. i am just burnt out on the game (well much less so right now) and lazy. its like, i did all the work to write this, and so i don't want to do any more work on it. i just want it to post itself. i WOULD have programmed it to post itself if i saw i way to programatically post to the HD forums... but anyway, maybe i could have another coach take up the charge of keeping this stuff up to date?
lets see, its been running like 10-15 minutes, and it has scraped almost half of d1. so another 1.5 hours maybe? when its done, ill post teh basic conf dynasty info - best current and all time 1, 5, 10, 20 year runs, and the population data (which happens to be turned on to print, and i dont remember how to turn it off, so i figure ill just grab it - a coach is maintaining a population thread right now which is cool but i dont think he has all the worlds, so i wanted to give this data to him, but was lazy - well, no excuse now, it will automatically print itself when the 1.5 hours of data mining is done).