This is why in the Netherlands cities shut off the gas valves by neighbourhood: to avoid keeping it flowing for one or two customers.
There are subsidies to convert. I'm not sure they're enough for the not-so-wealthy households. But hey, the country already spends 2 billion euros a year on keeping the sea out: that would escalate quickly under sea level rise.