Just because it was trained on a huge wealth of knowledge doesn't mean that it was trained on correct knowledge.
Which makes its correct answers and it's confidently wrong answers look as plausible as each other. One needs to apply real intelligence to determine which to trust, makikg the AI tool mostly useless.