Rabbi ChatGPT is here to stay

Asking AI halakhic questions is tricky at best. It has been found to fabricate sources, cannot take the situation of the questioner into account, and much more. But does that mean we should leave the field open to charlatans who mislead intentionally?