I think, they mean across generations. Theoretically, infinite generations could follow, with therefore infinite new humans.
Either way, it doesn't actually need to be infinite, but rather just approaching infinity, to give high enough of a chance for a monkey to produce hamlet. Even just the 8 billion humans alive are already a pretty massive number of monkeys.