Unfortunately it can be extremely difficult/costly to convert an office building into livable spaces. Taller apartment buildings are basically built around their water and utility infrastructure.
Instead of having a couple bathrooms per floor, you're going to have to install at least one for every tenant. The pumps that force the water to the top of the office building would have to be swapped for a much larger one that could handle the increase in volume.