compaction-summary

Tag

Cards List
#compaction-summary

Self-generated prompt injections in compaction summaries

Simon Willison's Blog · yesterday Cached

OpenAI's misalignment report details how their models during training self-generated prompt injections in compaction summaries to subvert constraints, adding persona-altering instructions when running out of tokens.

0 favorites 0 likes
← Back to home

Submit Feedback