Absolutely correct. It would be the people who are in power now, building gangs and robbing the weak.
Anarchism is a schoolyard without teachers. Most kids are ok and will treat each other with respect.
But if you ever were molested in a dark corner of said schoolyard you know how important oversight is.
In an Anarchist world, it would be traumatized/autistic people like me running around with guns and shooting everyone who so much as touches another person on sight.