Researchers have found that large language models (LLMs) tend to parrot buggy code when tasked with completing flawed snippets.

That is to say, when shown a snippet of shoddy code and asked to fill in the blanks, AI models are just as likely to repeat the mistake as to fix it.

  • @xia@lemmy.sdf.org
    link
    fedilink
    English
    111 days ago

    I noticed they aggresively build out todo comments, even if it’s not possible to do in place they take a wild stab at it.