Can we reconstruct a closed-source LLM tokenizer using only two oracles from the chat API?
Summary
This paper explores the feasibility of reconstructing the tokenizer of a closed-source large language model using only two oracle queries from its chat API, potentially revealing internal representation details.
Similar Articles
Don't let the LLM speak, just probe it (8 minute read)
The article introduces a technique that extracts hidden states from an LLM at the last prompt token to perform classification without text generation, using a small MLP to read the model's internal decision, enabling fast and cheap zero-shot classifiers.
Learning to reason with LLMs
OpenAI publishes an article exploring reasoning techniques with LLMs through cipher-decoding examples, demonstrating step-by-step problem-solving approaches and pattern recognition in language models.
Black-Box Inference of LLM Architectural Properties with Restrictive API Access
This paper presents NightVision, an attack that uses restrictive black-box API access to estimate hidden dimension, depth, and parameter count of large language models. It exploits a novel common-set prompting technique and spectral analysis, achieving high accuracy on open-source models.
How do you do OOD detection on a closed LLM API with no latent access?
Discusses methods for out-of-distribution detection on closed LLM APIs without latent access, highlighting techniques like SelfCheckGPT, token-level entropy, proxy embeddings, and verifier models, and notes the collapse of OOD and hallucination detection.
@MaximeRivest: Tool calling in open source LLMs is wildly different from one model to another. I just wipped up: http://chattemplatepl…
A new web tool, Chat Template Playground, lets users visualize how different open-source LLMs render their chat templates, highlighting differences in prompting and tokenization.