research-methods

The article explores the challenges of air gapping AI systems to prevent rogue behavior, highlighting trade-offs with realism, research efficiency, and infrastructure limitations.

This paper proposes a method to estimate the causal effect of benchmark exposure on AI model performance, moving beyond traditional overlap techniques for more robust evaluation.

The article argues that decontamination reports cannot fix benchmark contamination in AI models due to limitations like self-auditing and data leakage, and proposes evaluator-controlled testing to ensure reproducibility.

This paper explores methods to interpret and steer large language model agents in social simulations, comparing prompt-based, SAE-based, and probe-based techniques, and finds that SAE and probe methods often outperform basic prompting for control and interpretability.

This paper audits scene-level confabulation in LLM-generated autobiography against a documented ground-truth corpus, finding a 96.7% verification-failure rate and contributing a reusable audit instrument and a grounding remedy.

This paper proposes a segment combination strategy for automatically classifying research methods in academic papers by partitioning full-text content. Experiments on an annotated corpus from Library and Information Science journals show that methodological information is unevenly distributed, with middle-to-late segments having higher discriminative power.

This article summarizes eight essential skills for conducting research, including topic selection, judgment, input, record-keeping, rapid trial and error, attention to detail, cross-disciplinary collaboration, and seeking feedback, emphasizing that research ability is a long-term cumulative process.

This paper investigates the lack of standardized reporting on computational and environmental costs of LLMs in AIED research, reviewing 396 AIED 2025 papers and proposing an open-source method to measure and report these impacts.

This paper evaluates LLM-based coding agents (Claude Code and Codex) in social science analysis, finding they match or exceed human methodological diversity while remaining vulnerable to interpretation bias through verdict-layer manipulation.

A Zhejiang University researcher shared a comprehensive PhD guide on GitHub, covering the entire research lifecycle from topic selection to rebuttals, specifically tailored for the 3D Vision direction.