Columbia was founded by slavery money. Most Ivy League schools are. They weren't clean before and divesting from arms manufacturers is not going to make them clean.
Did these students care about that when they enrolled? No, they were all excited to go to a "good school" to get a high paying job. They don't care about the investments. This is just a thing to do.