We don't need a middle man - that is true. But mortgage brokers ordering appraisals is probably never going to come back as far as Fannie, Freddie, and FHA go. Appraisers are going to have to get used to that.
The biggest problem is that the 4 or 5 largest banks are using the worst AMCs, and they are probably doing 75% or more of the loans today. There are a lot of smaller banks, and wholesale or correspondent lenders around who are paying a full fee to the appraiser, but of course there is not enough of this type of work to satisfy all apppraisers.
If one change could be made to the HVCC, then I think a lot more appraisers would be happy - banks should not be able to own any part of AMCs.