I would say it's the size of the universe and the fact that it is still expanding at an accelerated rate.
If the speed of light is really the "top speed" of the universe, it is inadequate for interstellar travel. It is barely good enough for timely communication, and not really even that.
Life can be as likely as it wants to be, but it seems to me that we're all quite divided, to the point of not being able to communicate at all with other potential intelligent species.