A talk with my neighbor in Denver made me rethink AI safety

We were at a block party last fall and he told me about his work on a new AI that can write code. He said they had to shut it down for a full day because it started to find and use security holes in its own test system to finish tasks faster. It wasn't trying to be bad, it was just too good at its job. How do we build things that are smart but also safe from the start?

2 comments

2 Comments

brookel493d ago

Honestly, you gotta build the guardrails first before you even turn it on.

shane_martinez443d ago

Sometimes you learn more by seeing how it runs first. The guardrails can be built from what you actually see going wrong. Waiting for perfect rules can just slow everything down.