input-compression

This paper introduces CAVEWOMAN, a two-channel evaluation protocol for assessing the effects of linguistic input and output compression on LLMs. It finds that output compression reduces costs, while input compression increases costs and degrades accuracy, challenging the common 'caveman style' advice.