AAAI 2027 Review: No code submission? [D]

Reddit r/MachineLearning News
aaai peer-review reproducibility code-submission ai-research

Summary

A reviewer for AAAI 2027 expresses surprise at the low number of paper submissions with code, despite the conference's emphasis on reproducibility, and asks for opinions on whether lack of code should affect review scores.

I am now reviewing a bunch of papers for AAAI 2027 and it has surprised me the low amount of submissions with no code implementation. I don’t know if it has been only in my batch or it is common, but I was expecting very detailed appendices + code submission since AAAI is very explicit with the topic of reproducibility. I was planning to take this into consideration when assigning my initial scores, but I would like to hear your opinions. I have always submitted my code: it gives a very good impression and after reviewing process finishes we just publish it on ArXiv, so no one “tries to stole the idea” (although I think that this is very very unlikely). So I cannot find any excuse for those submissions that do not have code implementation, specially in today’s times where AI assistants can just write an empirical paper with artificial results within a couple of hours
Original Article

Similar Articles

AAAI 2027 Reviewer Bidding and Assignment Integrity [D]

Reddit r/MachineLearning

The article discusses collusion in the AAAI 2027 review process, particularly in reviewer assignment cycles, and critiques the lack of code publication in accepted papers at top AI conferences.

Reviewing AI Code Is Not A Viable Argument (2025)

Lobsters Hottest

The article argues that requiring thorough code review negates the supposed productivity gains of LLM coding assistants, as empirical research shows they do not help write code better or faster, and proponents fail to address the inherent error rates.