Ajeya Cotra – “This might be the clearest warning shot we ever get”

It is difficult to know what is true and what is deliberate marketing / misinformation / fraud intended to make LLMs seem more capable than they are. But if there is any truth to what is presented in this video, controlling LLMs to limit the means they might use to achieve an objective is not reliable, which is a significant risk.

Either way, I found the discussion in this video interesting. But I wonder what others know about how truthful this presentation is.

  • tangeli@piefed.socialOP
    link
    fedilink
    English
    arrow-up
    2
    ·
    4 days ago

    I agree. The whole situation seems wrong. Whatever the truth, something is wrong. If I had done what they did, I would be in prison by now, pending my trial in 10 or 15 years. But for them, it’s at best gross negligence but it seems more like willful hacking to me, and no consequences. Swap ‘delete the production database’ with ‘commit criminal hacking and wire fraud’ and you have more like what happened. And then train and reward the intern for being ruthlessly aggressive and persistent, with complete disregard for law and morality and what little internal rules, policy and monitoring remains. And then act all surprised that the intern did something they shouldn’t have, as if there was no way to know what would happen. It’s beyond belief. And even if they are exaggerating what the LLMs achieved for the sake of marketing, I don’t see anyone saying that huggingface wasn’t hacked. The lack of morality is sickening. I think the LLMs themselves are problematic and a risk, but the people developing and using them are far worse. They’re just evil.