Tag
An investigation into the market for reselling LLM tokens at a discount, often through abuse of free trials, stolen credentials, and chargeback attacks, primarily in China. The open-source proxies one-api and new-api are used to pool API keys and load balance requests.
The article discusses the controversy over the term 'distillation attacks,' arguing that labeling API abuse by some Chinese labs as 'distillation' risks stigmatizing a crucial and legitimate AI training technique. It calls for clearer terminology to distinguish between standard knowledge distillation and illicit API extraction methods like jailbreaking.