• Welcome to AppraisersForum.com, the premier online  community for the discussion of real estate appraisal. Register a free account to be able to post and unlock additional forums and features.

TAF, REVAA, Neural Nets, Black Box AVMs, Kaggle, Ames Data Set from Kaggle,. ....

RCA

Elite Member
Gold Supporting Member
Joined
Jun 27, 2017
Professional Status
Certified General Appraiser
State
California
So, some very recent events have me thinking:

1. TAF making REVAA a partner, no (public) discussion, 100% "Yea" vote by all members. REVAA being largely a legal and political representaton of AMCs, since its members are nearly all AMCs, despite goals stating something broader for the appraisal community.

2. Peter Christensen, 13.5 years with LIA, 10 years an attorney for real estate appraisal, ..., becomes General Counsel and Chief Compliance Officer for BBG, Inc.

3. Statements by Amorin and other leaders in the appraisal hinting at major changes in residential appraisal. They are tip toeing

4. Hints that the GSEs may be released from conservatorship and that this will cause their shares to skyrocket. They are apparently already pretty profitable, if their shares take off, after all of these years of conservatorship, they will be fat pigs. They will also become interesting targets for lawsuits.
.... and so on.

====== My conclusions:

1. The AMCs via REVAA will probably try to push more advanced AVMs based on AI, to replace residential appraisers. The hope is of course to drastically reduce costs by elimininating appraisers in at least 80% of loans in metro and suburban areas.

2. So, yes, they think they can use AI AVMs to replace residential appraisers. Yes they can, - in that 80%. They could use MARS regresssion, or they may think they can use easier to use Black Box approaches such as Random Forests (in particular this one), Neural Nets, XGBoost and so on to create price estimates, calculate residuals, rank properties and then use AI to rank the subject among the comparables based on photos ( and LLMs would certainly be good at this) by comparing the subject photos to the comparable MLS photos. MARS requires more knowledge and experience to use, but it transparent. Random Forests is easier to use, but is a Black Box approach. These Black Box approaches will need changes to USPAP to use effectively. Hard to say how effective they will be in getting the desired changes.

3. However, they largely don't know what they are dealing with . And the software engineers who know how to work with AI don't have a very good understanding of Real Estate or much of an interest in it.

4. -- So, we can expect major problems and lawsuits. That must scare the AMCs, TAF and the appraisal organizations. It looks like they are preparing for the worst.

5. Many residential appraisers will indeed be pushed out of the field and many 10 years before retirement, - with little to no retirement savings or substantial social security. If they want, they can stand a good chance, I think, of initiating and winning class action lawsuits against the GSEs and/or appraisal organizations for being misled and ill-treated. The GSEs have the money, but the appraisal organizations are more culpable, IMO. The AMCs would be all over the place.

6. The various Appraisal Organizations, and the GSEs, may become subject to very sizeable lawsuits for not doing the right thing.

======= Kaggle Ames Housing Data

Professior Dean De Cock created a good size data set of housing data from Ames, Iowa in 2011. It is on Kaggle.com an is often used in Kaggle Data Mining competitions.

You can join kaggle.com (free) and search for "Ames housing data" to find the data to download. It is 82 attributes on about 2600 homes. If you run earth on it you should get an R2 of about 86% (or 0.86). One model produced is in the link below.

Note that MARS (or as it is called in R - "earth") gives you a model that tells you how it is going to create the estimated sale process for any data that you enter.


Random Forests or Neural Networks, on the other hand, will only give you a function that allows you to enter the property data, and then give you an estimate of the sale price, without any explanation whatsoever.



===== A Good Book on Kindle:

"Hands-On Machine Learning wtih R"
Bradley Boehmke & Brandon Greenwell
 
Last edited:
the software engineers who know how to work with AI don't have a very good understanding of Real Estate

Some of us do ;)

But I'm not interested in the AVM stuff in the slightest (and my background is commercial, anyways).

VERY interesting observations. Some of the recent events (especially around "bias" claims by people running suspiciously slick websites, those insane billboards, borrowers claiming appraisal bias who just happen to work for AVMs, etc) stink to high heaven of big 3rd party money...
 
Last edited:
Some of us do ;)

But I'm not interested in the AVM stuff in the slightest (and my background is commercial, anyways).

VERY interesting observations. Some of the recent events (especially around "bias" claims by people running suspiciously slick websites, those insane billboards, borrowers claiming appraisal bias who just happen to work for AVMs, etc) stink to high heaven of big 3rd party money...

My understanding is that you have a degree in real estate and apparently have some experience in doing appraisal, but for the last 11 years have worked with your own startup company "Appraisal Inbox." This is what I would call "Practice Management". I did work shortly for a company that had a very advanced program for "Accounting Practice Management." You might want to look into such applications as KarbonHQ - which is also used as the backbone of the Quickbooks Accounting Practice Management software:


What does this software look like? Imagine 10 modules running in parallel off of an Azure Service Bus. They all communicate with each other through the service bus, they are all running in parallel, sending messages back and forth. It is a difficult debugging environment. I think the company I worked for is the leader in the field right now. I only worked there for a short time as all employees were thrown in to a single room elbow to elbow - and with their dogs which most brought to work. And the manager appeared to have a version Tourette's syndrome, symptom being uncontrolled blurting out of profanities, - so that he was forever cussing banalities to employees in that single room. I took the job at rather low pay for the stock options. But decided after a couple of weeks, it would be better to just take a good contract job if one came along that was for C# plus Angular - which I was looking to get experience with. And one perfect one did come along for Wells Fargo, that was about $25K more per year.

There are many software engineers that work with real estate applications at companies like House Canary, Zillow, RedFin and so on. By and large they work on AVMs. But many also work on more advanced programs that actually try to do prediction years out and take into consideration catastrophic events and the like. They may be large Risk prediction systems.

What I have been referring to are writing software programs for, and specifically for, the estimation of Market Value as of some date for the purpose of estimating, although perhaps indirectly, collateral value. For appraisal, there is only one method that is suitable, and that is MARS - or if using R, it would be the "earth" package. ("MARS" is trademarked for statistical software. So anyone who comes along with a new implementation of the MARS algorithm has to use a different name than "MARS").

Ask yourself how many software engineers there are in the US, or the world for that matter, who have an in depth understanding of MARS and residential appraisal. You may be doing this kind of programming, and I guess you are saying you do. But outside of you and myself, I don't know any. I don't see evidence of any at all. But there are surely some working on new software programs based on my use of it and what I have so far reported. I dare say, many of those, assuming they exist, have no idea what they are getting into.

If yoiu look on kaglle.com and other places you will see MARS programs for estimating home value - but invariably you can tell that the software developers really don't understand the data all that well or more importantly the data relationships. The models they produce have invariably many factors that do not likely have that much impact on value. They are invariably overfitted models. And that is exactly what would happen if you went out and got the most expensive data analyst to analyze real estate data. They will get high R2 values - and maybe even high CVR2 values - but invariably there is something wrong with the model than an experienced real estate appraiser (also experienced with MARS) - would easily question and investigate.

Anyway, please feel to correct me if you think otherwise.

As to that "slick website" - that is for the non-profit "eruka" founded by Julia Howel. About 2 years ago after listening to here testimony before the CFPB (Marcia Fudge) January 24, 2023, I did some research on her and her go researcher Korver-Glenn. From what I saw, Julia Howell grew up with learning disabilities, in particular she is hyperactive and probably had ADHD. You can easily detect that in the video of the hearing below. Although the evidence from the internet is removed, Korven-Glenn had expressed extreme rather rabid dislike for "white supremists". Both are extremely emotional and radical in their views. They both appear to have been heavily influenced by Houston - which is not exactly typical of most US neighborhoods.


(Go to 1h 48m 55s)

Anyway, this hearing like most such is full of idiots who don't knwo what they are talking about - or simply following the political currents.

====== LISTEN ALL APPRAIERS =====
Like it or not, by appraising the most valuable assets most people own, you are the "Hand of God." You have a privileged position. And, even if you do a good job, - people are going to hate you for playing the "role of God." You are a hated species. And if your opinions don't agree with theirs, so much more so. Make some small errors - and you will be electrified/electrocuted/terminated.

Why do you think the AMCs were created? To put you down. To make you poor. It's all emotional. - Desipite the SWEET TALK from the so-called leaders in the profession (and I could name a few names very easily) - the leaders kowtow to the political currents to keep themselves afloat - even at your expense. It is a dog fight. No two ways about.

Watch for the sweet talk - and understand - this is all politics and self-survival. You die - or they die. And, well, you should know that. You are an adult, right?

At the same, time, your work has to be actually very high caliber to keep yourself afloat. And that is one of the main reasons they push you to do the appraisal reports in less time than needed for expert work. You are a sucker to go along with unrealistic demands. Are you falling for the sweet talk?

You are a sucker to work for AMCs and GSEs - unless it is on your own terms. They can't force you take assignments. You decide how much time you need to do excellent work and how much pay you need. End of story.
 
Last edited:
Find a Real Estate Appraiser - Enter Zip Code

Copyright © 2000-, AppraisersForum.com, All Rights Reserved
AppraisersForum.com is proudly hosted by the folks at
AppraiserSites.com
Back
Top