No, I'm criticising the fact that the term devalues both the labour put in by people, as well as devaluing the people themselves. You can't deny that we as a society look down at certain jobs, both in terms of the jobs being unsavoury (handling refuse, cleaning, etc.).
I'm a software developer, my roomie is a truck driver. We don't get the same reactions when we introduce ourselves and talk about our jobs. We don't have the same wages or working conditions either. I have a fixed, yet relaxed schedule, and I can plonk around with my job more or less any time I feel like it. My roomie went to bed at eight today because he has to get up at three, by the time I get up he'll have worked for four hours. He most likely won't be home until five, about the time I close my laptop and start cooking, provided I haven't already started that. Somehow I'm paid more. I'm perceived as more intelligent, and my work is held in higher regard, despite the fact that business grind to a halt and people go without food if my roomie doesn't do his job. He doesn't "just" drive from point A to point B, just like I don't "just" stare at a monitor all day.