All - I really appreciate all the feedback. I just don't want to waste soil and have perlite littered all over my yard.
I think the happy medium rotating soil annually and adding fertilizer might be the way to go. So any given season there will be a bag of soil in the yard for a few months