Honestly, there's a lot of writing about this sentiment already which explains it in great depth. To understand it, that would be a good place to start.
But, yes, I absolutely believe it's true in many cases. For example, the criminal justice system, from police brutality to prisons. There are many proven alternative methods to rehabilitate, reduce crime, and make society safer, and a certain political persuasion utterly refuses to consider any of it. Digging into their arguments, the only internally consistent explanation is that they want people to punish. It doesn't matter if crime could be prevented and everybody made better off. In short, the cruelty of the punishment is the point, even if it means that we have more crime victims as a result.