Weird pattern in the ICLR papers I was assigned to review [D]

Reddit r/MachineLearning News

Summary

An ICLR reviewer reports that all three assigned papers appear to be unfiltered Claude-generated slop sharing the same core idea of comparing predictor errors via paired differences to derive tighter bounds, raising concerns about automated paper-generation at top conferences.

I was assigned 3 ICLR papers to review. I generally consider myself a pretty nice reviewer but...all 3 of them are slop. Unfiltered Claude slop. The language is so awful it is almost impossible to read. Unfortunately, I imagine this is common among "top" conference submissions now. The reason I am posting here is because I noticed a strange similarity between all three papers. They all use very similar methods. They all start with the premise of deciding which of two predictors is better, and say that estimating predictor errors or scores individually can be difficult. So instead, they all propose to look at the difference between two errors or scores. *In all three cases*, when you look at the difference, some troublesome shared term cancels out, allowing you to derive a tighter bound on the difference. The authors then build a whole elaborate theoretical framework around this observation. I know that paired comparisons and cancellation are standard techniques, but I don't think they are *so* common that I should get 3 separate submissions built around that same idea. Also, not only do all 3 submissions share the same core idea, but they all introduce it in the same way, use the same Claude-sounding prose, and include tons of additional proofs and experiments in a pretty similar way. The coincidence is weird enough that I'm wondering if there is an autoresearch setup somewhere that has been spitting out papers of this sort. Has anyone else seen this idea as well?
Original Article

Similar Articles

How's ICLR reviewing going for you? Any observations? [D]

Reddit r/MachineLearning

A discussion post asking the community about their experience reviewing submissions for ICLR, focusing on the rising volume of AI-generated papers and the growing difficulty of detecting AI-written text and 'slop' submissions in OpenReview.

Concerns about the ICLR review policy [D]

Reddit r/MachineLearning

The author expresses concerns about ICLR's review policy that requires individuals to serve as reviewers if they appear on 3 or more papers, regardless of their qualifications.

What is wrong with AI writing - ICLR edition [D]

Reddit r/MachineLearning

A Hacker News discussion帖吐槽 ICLR 审稿中泛滥的晦涩 AI 写作,并附上一段匿名论文的典型模糊表述,呼吁社区讨论如何在不简单指责“AI 写作”的前提下批评这类糟糕行文的实质问题。

AAAI 2027 Reviewer Bidding and Assignment Integrity [D]

Reddit r/MachineLearning

The article discusses collusion in the AAAI 2027 review process, particularly in reviewer assignment cycles, and critiques the lack of code publication in accepted papers at top AI conferences.