everybody,
i need some help gathering some data. i am working on a project to come up with some all time lists. so when you make 20 straight NTs and you wonder if that put you in the top 25 or top 100 or something in terms of longest NT appearance streak, you can find the answer! similarly with streaks of 2nd rounds, s16s, and so on. i also would like to put out some other lists for fun, like the 50 greatest 10 year dynasties in any world (by division), even though it is impossible to get it 100% right because of the strength of worlds (although i will factor that in to some degree).

anyway, i already have completed the program to automatically import, save, and rank every team in a division. all i need is the team id, school name, and conference for every school in every division in every world (i could really get by on team ids but for laziness id rather have it all). so, i am looking for people to do 1 of 2 things, for the worlds i don't have access to. i have access to tark and rupp, and wooden and iba (thanks brianp for those last 2). the first option is, a bunch of coaches have site mailed me for help and given me their passwords to look at their teams, if any of those coaches read this, if you wouldn't mind changing your password once more for a day and letting me in to mine the data, that would be great.

the second option requires you to do a little manual work, it takes about 10 minutes for a world, if not less, to send me all the data i need. i would need you to go to the rpi by conference page in each division of a world, and start from the 1. before the first team, and copy all the way down to the end of the last team in the list, and sitemail it to me in a sitemail by itself (or paste into a spread sheet and email it). i also need the team ids for every school. i wrote a little program to parse these out from the HTML of the page. so, on that same page (rpi by conference), i need you to view page source - right click on the page, and in firefox, select view page source, in internet explorer, select view source. then, hit control A to select all, control C to copy, and then control V to paste it into a sitemail to me. if you need my email address to send me a spread sheet, just sitemail me.

finally, if anybody is giving me access to a world, or sending me the data for a world, can you please put a 1 liner post in this thread before hand so others don't waste their time duplicating the effort?

thanks in advance to those who help me get this data put together!

I'll help. Send me a sitemail on what you need. I'll do the second option. I don't care.

Quote: Originally posted by westcoast22 on 2/03/2010I'll help.  Send me a sitemail on what you need.  I'll do the second option.  I don't care.

well, i need the data for any of the 6 worlds i don't have access to that you can provide:
1) naismith
4) smith
6) allen
7) crum
9) knight
10) phelan

for each world, i need the data for all 3 divisions. i need 2 pieces of data for each world/division, as described above. ill try to make it a little simpler and clearer this time. both pieces of data can be found on the same page. go to Rankings -> RPI by School (Rankings is one of the button like items at the top, when you are into an actual team. from the its office, recruiting, schedule, standings, stats, rankings). I need:
1) All of the teams in the division. You can just Control+A to select all, Control+C to copy, then open a sitemail to me, and Control+V to paste it all. This will include a bunch of extra crap but I can deal with that myself :)

2) I need the actual page source of the page. Right click on some white space of the page, and select "View Page Source" or "View Source". Then, you can Control+A to select all, Control+C to copy, and open a sitemail to me, and Control+V to paste it all.

If you send me those 2 pieces of information, I will have everything I need for that division. Thanks!

Happy to help once Allen has RPI's up. Since we're recruiting now, it will probably be a couple weeks.

I can get Naismith for you.

Sent Crum data - if you need anything else let me know. I can also send Smith/Allen when available.

Sent all Naismith. Let me know if I did it wrong.

I'll get you Phelan and Knight by the end of the night.

For some reason it's not letting me send this. Everytime I hit send it takes me to the compose screen and then I checked my sent folder and nothing is there.

westcoast - that was great, thanks!
acn - thanks so much for taking the time to send me everything so cleanly =) if you could, smith/allen would be awesome.
kmason - phelan/knight would be much appreciated. thanks!
redbaron - acn sent me everything perfectly, so getting allen from him just seems the easiest way to go. but thanks, i appreciate it :)


I will start importing all these new worlds tonight. I guess there is nothing to do but wait for smith/allen to start the season, but in the mean time, I will start posting the different ways I was thinking of doing rankings, and if anybody has any ideas for improvements, I would love to hear them! I can code them all up with a partial set of data, so by the time smith/allen are ready, I hope to be finished with everything else.


p.s. all of the worlds are now accounted for except for naismith.

Quote: Originally posted by kmasonbx on 2/03/2010For some reason it's not letting me send this. Everytime I hit send it takes me to the compose screen and then I checked my sent folder and nothing is there.

hmm, are you trying to send all of the data for all divisions in 1 sitemail, or 1 item at a time? if you are sending multiple items at once, maybe it is too long? one sitemail per item per division worked for others (6 total per world).

Gotcha, was trying to send 2 items per sitemail.

All sent.

whoops. i don't know what i was talking about, when i said everything was accounted for but naismith. westcoast covered that one :) so that is everything except smith/allen which are in recruiting and are unavailable... so, that is all the data i was looking for. thanks again to those who sent me stuff!

Glad it came through OK. I will send Smith/Allen when Smith is available (1 day behind Allen), should be ready after President's day.