Yes! Although not in Division III or II. But, once you get up to Division I-A and I-AA, the administration and alumni of some schools demand success. If you're in trouble, the administration will certainly let you know. In addition, you'll see your job status change in your office.
The different levels of job security are as follows: