The way to drastically reduce medical expenses and thus debt is deregulating health.
From what I remember, you need to have quite a lot of things to become a doctor in the USA, even more to run a related business, and most of those are not about education. So the "supply" here is relatively low.
Also to make education (including medical education, which means - supply again) more affordable the government should just stop subsidizing student loans.
It may have some fixed sum per student allocated, which may be paid for a place, which can be awarded to students from poorer families or something. The "fixed" and "paid for a whole place" parts are important, otherwise this will work just like subsidizing loans - by inflating prices further.