@noybeu Well, of course. This is pertinent to machine learning based models - nothing to do with OpenAI or ChatGPT in particular. All LLM-based chatbots have this problem.
Once you train a ML model and it starts generating output, you generally cannot (a) tell why it has generated this particular output, (b) which particular part of the training data resulted in this output, and (c) change substantially its behavior without full examination of the training data and re-training of the model.