Short answer is genocide of native people combined with racism against Black people.
Mixed-race marriage, neighborhoods and schools were illegal in the US, in some way or another, for over 300 years. The US Supreme Court did not rule it unconstitutional until 1967.
The US state of Alabama did not officially remove their laws against mixed-race marriage until year 2000.