"...I introduce the concept of a moral crumple zone to describe how responsibility for an action may be misattributed to a human actor who had limited control over the behavior of an automated or autonomous system. Just as the crumple zone in a car is designed to absorb the force of impact in a crash, the human in a highly complex and automated system may ... [bear] the brunt of the moral and legal responsibilities when the overall system malfunctions." ---Madeleine Clare Elish
@christo@pluralistic@grimalkina I view some amount of the technical and organization coaching work I do to be in spirit of empowering engineers to voice their concerns about being in the crumple zone. I'm there mentoring them how to hold their leaders more in that accountability and responsibility arena (longer? 😂). The best way I've found to protect oneself is by holding the managers and leaders accountable too. Pick the appropriate corporate "one team one dream" motto and apply liberally.
@gregdosh@christo@pluralistic thanks 🙂💕 also moral injury is an extremely important concept in clinical psychology (didn't dive into that so much in this review but very much appreciate the connection).