No. the appraiser should not have added money to make up for the cost difference between brick and vinyl. In the sales comparison method the appraisers job is to adjust for difference that the marketplace pays for differences between brick and vinyl.
Think of it like this. If you had your house painted using that iridescent glittery automotive paint that the kids with too much money and too little class put on their cars, it would "cost" a fortune, but you'd be very unlikely to find a buyer that was willing to pay that much extra for the house because of how it was painted.
It may be that in your market the typical buyer is willing to pay a little bit extra for a brick front, but that all brick is more than the typical buyer can pay or is willing to pay. It might also be that all brick is superior and that buyers in the market do value it and are willing to pay more for it. But you dont know that till you analyze the differences in prices paid for all brick vs half brick. The fact that all brick costs more is irrelevent.
A good appraiser will analyze the market and figure out what value difference, if any, exists there. Its a fair question to ask, but don't be surprised if the answer is "zero".
You might also look at the "Condition" line of the appraisal. Many times things like you're talking about will be bundled there into an overall adjustment. For instance.....Lets say, you're all brick, and this comp is brick and vinyl, but maybe this comp has a recently remodeled kitchen with granite, stainless, etc vs your older kitchen, or it has full wood and slate floors vs your carpet, laminate, and linoleum. In a case like that the comps inferior exterior treatment might be canceled out by some superior quality treatment somewhere else, which would make for "no adjustment" in the comparables grid.