When Does Surface Appearance Become Scale-Variant?