First, the hay must have been dry before construction. Wet hay, big problems. Second, the exterior must be sealed stucco. Cracks can let in water. Exposed hay can let in water and insects. Again, insects, damp hay....mold, infestations, etc. Thirdly, wiring has to be conduit in the exterior walls (moisture, possible insect damage to wiring, etc). Does the ground shift? Is there a potential for exterior cracking of the stucco? Again, bad things. Think EFIS issues.
Now, lets look at market resistance. How many are there in your market? Is there market acceptance?
Have you discussed with the client that this is a hay bale structure? Before proceeding further, STOP! This home is not acceptable for secondary market delivery. PERIOD. The client needs to be aware of all the factors involved (type of home, available comparable sales, etc) before you proceed beyond the inspection. The client may not want you to go any further and you certainly don't want to waste time and have it cancelled when you are 80% done and the client wants to pay a trip charge.
JMO having done one of these. Nothing good comes out of these for an appraiser.