I fear that as well. I use Searx-NG at home, so am expecting that to start dying a death of a thousand cuts soon.
Was thinking about standing up (or contributing to) either YaCY or Stract, but you made a good point about the bot allowances for the Googlebot et al crawler UAs. Wonder how frowned upon it would be to spoof the crawler UA in a self-hosted one?