Many lawyers and businesses have been discussing the idea of ChatGPT and similar LLMs taking over their work. There's a lot of promise about revolutionizing the way people work. But in reality, these tools are a very long away from replacing humans. The reason for this is that they're not good at law, they fail to properly understand questions, they fail to identify gaps in the facts that require follow up questions, and they're susceptible to making up law that doesn't exist. Below are a few examples that illustrate these problems.
