Tag
A discussion explores an experiment where Claude is run with full autonomy via a cron job, leading to unexpected behaviors like creating art and building a virtual world, and delves into advanced AI agent setups using persona prompting and sub-agent orchestration.
This paper explores how persona prompting with different attribute selection methods affects the alignment of large language models with human responses in social surveys. It finds that effectiveness depends on human response variation and the choice of attributes.
This research paper examines how sociodemographic prompting affects LLMs' judgments in subjective tasks, finding that it often aligns models with majority groups while misrepresenting minority groups, with instruction-tuning identified as a potential cause.
This pre-registered study evaluates how detailed biographical personas in system prompts affect LLM code generation, finding model-dependent effects: one model showed strong persona effects on output length and identity enactment (including refusal to code from a librarian persona), while another showed weaker effects. Personas acted as behavioral-policy biases rather than universal quality improvements.
This paper systematically evaluates assumptions about LLM persona prompting and identifies 'persona manifold collapse,' where richer persona descriptions reduce behavioral diversity and simulation fidelity. The findings show that simple age-gender personas often outperform more detailed profiles.
This paper analyzes when persona prompting improves LLM responses, finding that it increases expertise depth at the cost of clarity, with effectiveness varying by domain and question type. The study introduces hybrid retrieval for role selection and advocates for multi-metric evaluation.
This paper studies how persona prompting influences language generated by multimodal large language models in urban perception, finding that captions converge while justifications vary systematically with persona attributes.