How does beta testing work? Topic

I'm new enough to HD that I haven't been around when beta testing was done before. (It has been done, right???)

It seems like it is going to be done with a clone of the Knight world. If so, I'm curious as to how that works. Do the seniors all graduate and you test with a new batch of recruits and play for a single season? Do you continue on for four seasons? Something else along the way?

I primarily ask because there are some strategies that I think might be interesting to test but will be difficult to implement if all the rosters are already mostly filled up.
11/10/2009 6:35 PM
What are they Beta Testing this time KU?
11/10/2009 7:07 PM
KU i think it has been done before. And that is just from searching around the forums on the test site. From my past beta experience with WIS (CRD and FC) they run another world, independent (but apparently cloned from an existing one). From there the season runs as it normally would, although at times they may speed it up / slow it down to test certain aspects of it. IE they might generate the recruits 3 or 4 times before recruiting starts just to see if the generation is working properly and ask the testers to see what they think. Same thing goes for games, I assume they will want us to try out everything under the sun -5 ut +5 sd, the whole works to see what might not be working quite as intended. From there they will take the info that is gathered and move forward with the release. As for testing 'strategies', beta testing is for finding the bugs in the system and making everything work as intended, not for trying to win a title or test out things you are curious about for your 'real' hd team.
11/10/2009 8:08 PM
We're on the same page, zhawks. (I think.) And for what it is worth I was involved in testing for simleague baseball twice and all we did was run a single season. The sample size wasn't terrific.

But by strategies I pretty much meant identifying bugs. For example:

  • Big men with good perimeter ratings. Some do exist now but I think we're going to want a decent sample size if possible for testing. And if the freshmen come to campus with 50 ratings and high potential it is going to be tough to gage if that is working well or not unless we see the results after they develop both in skill and IQ.
  • Good rebounding guards. Right now very few teams have those in D3 and it's possible that a team that can rebound at all five positions could be a glitch -- in both directions. Going to be really tough to test.
  • Combo defenses. Some Knight teams are currently set up to run combo but given how empty D2 and D3 are there might not be a whole lot there. And if a team that is cloned with IQ's for combo goes into Sim AI hands will they run the combo or the default set for the school?
  • What happens if you have 12 players with amazing speed but no athleticism? Or vice versa?
  • How does a team filled with single rated defensive players work? Does it matter what defense is being run? I think many would consider this to be a D3 exploit right now and it would be nice to confirm it is fixed. There also might be some D3 teams available to test something like this so unlike the other bullets we might be able to get some decent results.
  • And even something zany like a team having big men with awesome ball handling. Conventional wisdom is that this would have a small impact on things but if there isn't a roster designed to test it, we won't know.
  • Not to mention that if we don't have four seasons (five if you want to measure redshirting) we'll have trouble assessing if the IQ development is working well along with figuring out if we end up putting 40 minutes into study hall for our juniors and seniors because they are maxed out.


Obviously for all of these strategies there would be some curiosity involved. But the main point would be to make sure everything works as intended. I'd be shocked to discover that the key to success is having a bunch of guards with zero speed but tons of athleticism and rebounding abilities along with a front court of speed demons that can do tricks with the rock but lack any athleticism whatsoever. But unless we test that, we won't know for sure. And if we're bringing over 75% of our players from the current Knight world, it will be difficult to find out if those oddball strategies produce normal results or if they work way too well (or not nearly well enough).

And what scares me about new releases is that it typically is something oddball that ends up being the glitch because nobody thought to test it. And then it gets exploited. And then "fixed" with an over-correction which just leads to more problems.
11/10/2009 9:20 PM
Quote: Originally Posted By dmiles1200 on 11/10/2009What are they Beta Testing this time KU
http://whatifsports.com/forums/threads.asp?ForumID=30&TopicID=400090&PagePosition=1
11/10/2009 10:25 PM
So you guys get to beta test?
11/10/2009 11:10 PM
Thank you mniven for answer my question and not ignoring it.

Appreciate it bud
11/11/2009 4:33 AM
Sorry dmiles1200. I figured you knew about the other forum thread so I wasn't sure what exactly you were asking.

(I don't think) beta testers have not yet been selected, cornfused. But since the consensus is that they were asking about Knight status since that will be the test world. And if that's the case I think it is going to be difficult to test certain team strategies because in most cases you are going to inherit 75% of a roster that might not be suited for the strategy at all. Just a concern I have, nothing more nothing less.
11/11/2009 10:24 AM
ku check out rails post in the other thread.

With a major part of this update being recruit generation I hope that more then 1-2 seaons are simmed even if a few are simmed just for generating recruits.
11/11/2009 1:18 PM
How does beta testing work? Topic

Search Criteria

Terms of Use Customer Support Privacy Statement

© 1999-2025 WhatIfSports.com, Inc. All rights reserved. WhatIfSports is a trademark of WhatIfSports.com, Inc. SimLeague, SimMatchup and iSimNow are trademarks or registered trademarks of Electronic Arts, Inc. Used under license. The names of actual companies and products mentioned herein may be the trademarks of their respective owners.