• tyler@programming.dev
    link
    fedilink
    arrow-up
    1
    ·
    3 days ago

    AI detection doesn’t work and leads to a lot of false positives

    Anthropic have begun watermarking their outputs (which is possible thanks to EU legislation) so yes you can detect ai output.

    • Micromot@piefed.social
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 days ago

      Most ai output has been watermarked since I think 2023, Anthropic is just more open about it.

      I am pretty sure this still produces too many false positives when applied to code because of the way these watermarks are implemented. I am not 100% sure on that though. It could be used on commit messages though.

      • tyler@programming.dev
        link
        fedilink
        arrow-up
        1
        ·
        2 days ago

        Nah the EU legislation made it so that it has to be watermarked (LLM output was not watermarked until that passed, it was just image and music output) and discernible with a tool to tell. So you can check if something is AI generated. Anthropic says it should work on code.