I hear you. Having a prestigious program is certainly a huge benefit and draw to recruits.
But look at Clemson. Their history is certainly better than ours, but they are MUCH closer to USC than they are to LSU, Alabama, etc. And they're bringing in top 10 recruiting classes year in and out...