IT consultant Mark Pesce was building an LLM-based similarity finder for a legal client. He discovered a prompt that reliably caused multiple LLMs to go nuts and output complete gibberish: “it desc…
  • kbal
    43•5 months ago

    If models are trained on data that it would be a security breach for them to reveal to their users, then the real breach occurred at training.