Just in the FWIW category, if you were building a home outside of the city limits in Texas, until last year, the only permit required was for the septic system. Conversely, there's one small community around here that is such a PITA for permits that the permit officer is always red-tagging for additional problems so that he's never in the office to verify permits.
So, just because you can call up your local permit office and verify a permit in your area does not mean that everyone can. As Tim said, "normal course of business" for your area. And just because it's not permitted does not mean that it has no value or should be removed. Again, it all depends on how the particular jurisdiction reacts to such non-permitted additions. And now that I've opened that can of worms again, y'all have a great day.