If you are paying them over $55k, cut them before you are on the hook next season. Everyone needs crap players in their minors to fill it out, so don't cut too much. You will also get some retirements. I usually have between 10-15.
I keep about 30 per level. 14 batters, 16 pitchers (5 of them are inactive and rotate in during the season).