Scaled Scoring on the new exam?

[Red Flint]

There are 165 questions, 15 do not count. Unfortunately, you don't know which ones do not count during the test.

Scaling the test allows for multiple versions and random generation of questions. This way, if another test taker is working beside you, they may not only have a different question order, their test may include questions not included on yours. Questions are not equal in complexity, therefore, results are likely weighted depending on the particular composition for your test.

Traditionally, 70% passing rate (i.e. 105 questions correct out of 150) has been a reliable benchmark for licensing tests. Apparently, in an effort to toughen standards, this has been raised to around 75% (112.5 correct out of 150). Scaling accomodates the probability of taking a test with a slightly higher question complexity compared to your neighbor, increasing the likelihood that you would not need to get quite as many questions correct, as long as you answered the harder questions satisfactorily. This is why a total number count of questions correct may vary depending on your luck at the 'random' test question set.

 

[nex2beach]

Appraisal Test Scoring

The AG exam is something else. I've taken it 3 times... 1st time missed by 4 questions, 2nd time missed by 14 and 3rd time missed by 23. As I have been told, the tests have been based upon the Appraisal Institue educational programs (their answers to their courses). My complaint is that the test questions and answers don't relate very well. In order to pass, it looks like one would have to take all of the Appraisal Institutes courses beforehand.

Also, there are 15 test questions that are on the exam to check for effectiveness of the exam. Although these questions don't count in your score, you have to deal with them anyway. If they had cosunted and I had gotten enough of them right, I probably would have passed the 1st time around.

The AG test is not straight forward and certainly not a barometer of your knowledge as an appraiser. Good luck!

 

[Metamorphic]

My understanding is that the 15 questions are demo questions...questions they're test driving to see if they're fair, and to see how hard they are. After they get a track record with them, they may enter the data base of real questions given for score or they may get tossed.

Each test is supposedly created from a random selection of questions in the database. Since some questions are harder than others (based on the test drive described above) some tests will be harder than others due to random variation. The scaling occurs when then look at how hard your specific test was based on the actual questions you drew, and then decide how many questions you should have to get right to pass it.

 

[nex2beach]

Just to let you know more about the "new" Certified General Appraiser Exam now given here in California... the present pass rate is at 18% where 18 people out of 100 pass this exam (also includes 2nd & 3rd time test takers). Compare this to the current pass rate of 35% to 40% for the California State Bar Exam for prospective attorneys!

What's wrong with this picture

 

[greens601]

I agree that there are some problems with the test, but unfortunately there is nothing we can do about it!!! Study, study and study and hope I pass it the second time around.

 

[Terrel L. Shields]

Examinations change over time. Each examination may vary in difficulty with one examination easier or more difficult than other examinations. However, when converting raw scores to scaled scores, it should not make a difference whether candidates take an easier or more difficult examination. With the mathematical adjustment, the scaled score accounts for differences by adjusting the scores up or down depending on the difficulty of examinations. When these adjustments are made, the effect is to produce an unbiased and constant passing standard that does not change from one examination to another. A scaled score is not a percentage score, but simply a transformation of a raw score to report comparable results when examinations vary in difficulty."

It is also an intellectual fraud and a statistical hoax...nevermind.

 

[farmguy]

nex2beach,

It may mean folks sitting for the bar are better prepared than folks taking the appraisal test.

The questions are not based on "institute" questions. Naturally appraisal test questions may look like questions a reputable appraisal education provider may ask on their exams.

I wonder what the pass rate is for applicants with a recent college degree with emphasis on real estate and/or appraisal along with recent attendance at MAI, ASA, ASFMRA (read reputable) training? My guess is that it is much higher.

As long as the main complaint, as I often read here, is I can't find any online courses that I can do in the evenings, or I can't find an educational offering within 30 minutes of my house and/or "Jim Bob's real estate appraisal school" , study online to pass exam, etc. is considered education. I would hope and imagine the pass rate will remain low.

 

[farmguy]

Next thread I read, "Anybody ever hear of Masters Appraisal School", I signed up but I don't know who or what they are.

Geez, and we wonder why the pass rate is low.

 

[Ken B]

I suspect part of the "problem" with the pass rate of the new exam is that it tests at a knowledge level which is higher than previous year knowledge level requirements. Many States adopted a segmented approach to satisfying the 2008 appraiser requirements which allows many appraisers who satisfied the lower education requirements prior to the end of 2007 to apply for the exam if they satisfy the other requirements prior to 2009.

I also personally know that during the first half of this year, exam "study" programs provided exam reviews which were inadequate for the 2008 exam. I upgraded from the CR to the CG recently and had purchased a study program for basic review material. It was quite easy. A week before I took the CG exam, the company provided an updated exam review program. It was significantly more difficult.

I, personally, am glad they increased the difficulty of the exam. And yes, I passed on the first attempt. But I admit I was unsure of the results until I received my report. It is a tough one. Again, I think it should be so difficult.

I just had a great idea. Wouldn't it be something if State Boards could require that those guilty of infractions take and pass the new exam? It would be so much more effective at weeding out the incompetent than merely imposing a requirement to take some CE course and pay a fine. A competent appraiser should jump at the chance to merely retake and pass the exam. Less time consuming and less costly.

 

[PropertyEconomics]

I suspect part of the "problem" with the pass rate of the new exam is that it tests at a knowledge level which is higher than previous year knowledge level requirements. Many States adopted a segmented approach to satisfying the 2008 appraiser requirements which allows many appraisers who satisfied the lower education requirements prior to the end of 2007 to apply for the exam if they satisfy the other requirements prior to 2009.

I also personally know that during the first half of this year, exam "study" programs provided exam reviews which were inadequate for the 2008 exam. I upgraded from the CR to the CG recently and had purchased a study program for basic review material. It was quite easy. A week before I took the CG exam, the company provided an updated exam review program. It was significantly more difficult.

I, personally, am glad they increased the difficulty of the exam. And yes, I passed on the first attempt. But I admit I was unsure of the results until I received my report. It is a tough one. Again, I think it should be so difficult.

I just had a great idea. Wouldn't it be something if State Boards could require that those guilty of infractions take and pass the new exam? It would be so much more effective at weeding out the incompetent than merely imposing a requirement to take some CE course and pay a fine. A competent appraiser should jump at the chance to merely retake and pass the exam. Less time consuming and less costly.

Great idea .. wont happen but a great idea.