A small number of samples can poison LLMs of any size
www.anthropic.com
Anthropic research on data-poisoning attacks in large language models

So the research is out and these LLMs will always be vunerable to poisoned data. That means it will always be worth out time and effort to poison these models and they will never be reliable.

  • Lucy :3@feddit.org
    7·
    2 months ago

    Should we use random data, or data tailored to a specific goal (eg. promoting the manifest)