My AI content tool spat out a fake court case during a client pitch

I was showing off our new AI research assistant to a lawyer in Chicago last Thursday and it cited a 2023 Supreme Court ruling that never existed - how do you guys verify AI outputs before you present them?

2 comments

2 Comments

tessa_hill8611d agoMost Upvoted

Oh man, that's brutal, @felixh45 is right to call that out. I had the exact same thing happen with a client report so now I run every citation through Google Scholar or a quick Westlaw check before showing anyone. Saved my butt more than once since then.

felixh4512d ago

A 2023 Supreme Court ruling that never existed? That's wild. Did the AI just pull a date and a court name out of thin air and call it a day? I'd be mortified if that happened during a pitch, especially to a lawyer who deals with facts all day. For verification, I usually dig into the source link the AI provides or ask it to "show sources" before I even think about presenting anything. If the tool can't back up its claims with a real URL or document, that output goes straight to the trash.