I believe there was someone on Shark Tank trying to get funding for an app to let people do that. If I remember correctly he did not get funded.
I would also assume there are some legal obligations with that. Like having to have lifeguards or other safety measures a public pool is required, that a house would not have.
Plus people are gross. I'm sure this would only increase the amount of cleaning I would need to do.