"but also provided psychological protection by shading the face from close scrutiny. "
To me it feels like this was made up by some spoiled twat, who couldn't stand that people that they thought were socially inferior, wouldn't show the expected obeisance by removing their hat in front of their "betters".