A Lawyer Misused AI: Why We Need To Be Careful

You've probably heard about AI tools like ChatGPT that can write text for you. Many of us are exploring how they can help in our daily lives or businesses. But a recent case in Canada shows us why we need to be really careful and double-check anything these tools produce.

A New Brunswick lawyer, Denis Sawyer, was fined $10,000 for using an AI tool to help write a court document. The problem was, the AI made up legal cases and references that didn't actually exist. The lawyer then submitted this document to the court without properly verifying the information. This isn't the first time an AI has 'hallucinated' — which is what we call it when an AI makes up facts or information that sounds convincing but isn't true.

This incident is a timely reminder for anyone thinking of using AI in professional settings, especially where accuracy is critical. Whether you're writing a business proposal, a school assignment, or any document that relies on factual information, the ultimate responsibility for what you submit still lies with you. AI can be a fantastic assistant, but it's not a replacement for human checking and critical thinking.

The lesson here is clear: treat AI as a very smart, but sometimes mistaken, helper. Always verify any facts, figures, or references it provides, just as you would with any junior assistant. This approach will help you harness the power of AI safely and effectively, without falling into common traps that could lead to serious consequences, as Mr. Sawyer discovered.