No one can tell you here beyond "DRM bad". Which it is, and I hate it, but you're exactly right. All it would do if Firefox refused to implement would drive most users to chrome because there DRM works.
We are not the majority. The majority (and by that I mean roughly 96% of users) want their browser just to work. Taking a moral stand doesn't resonate with them, they just see a broken browser and move on.