Ah ha makes sense now! The "Replying to comments" section of that article explains exactly what's happening. If I understand correctly the community itself (!privacy in my above example) is not notified of my reply from Mastodon. If the community did know, then it would broadcast a notification of the activity to whoever else is subscribed to !privacy.