My own personal rule of thumb for moving up is that the new school needs to be at least two-thirds of a letter grade higher baseline prestige than my current school, and ideally the new school should have a baseline prestige in the top half of their league. Yes, you'll be starting over, but In the long run, baseline prestige makes a big difference. So if I were in your shoes at Rutgers, I would move up as long as the new school had a baseline prestige of at least a B+, excluding Virginia in the ACC.