They actually haven't had much time to pass by. Earths only been around for 4.6 billion years, a couple hundred million of that was spent being a cooling ball of magma. Space is fucking huge and the universe is still very young. It's very likely we are on the early end of the development of life in the universe. A lot of things had to happen before our complex life could evolve.