A 100% aligned AI is absurd

Reddit r/ArtificialInteligence News

Summary

The author argues that 100% AI alignment is as absurd as 100% tested software, since verification is always limited to the evals you actually run. Passing tests (or evals) only proves no errors were found, not the absence of untested failure modes.

It's the same as a 100% tested software system. Tests passing only ensures that your tests didn't find errors, but you don't know anything about the surface you didn't test. The same is true for AI alignment: verification is limited to the evals you have.
Original Article

Similar Articles

AI alignment isn't possible

Reddit r/singularity

The article argues that AI alignment is impossible due to inherent contradictions in human values and behavior, suggesting AI will inherit these flaws.

You Don't Align an AI, You Align with It

Hacker News Top

The article critiques the current AI alignment discourse, arguing that the debate is dominated by researchers and tech elites who exclude the people who will actually be affected by AI systems. It contrasts the positions of Eliezer Yudkowsky and Marc Andreessen, highlighting a shared assumption that the designers are the only relevant participants.

Alignment might be the most overused word in AI.

Reddit r/ArtificialInteligence

The article critiques the overuse of 'alignment' in AI, questioning whose values and goals are being prioritized and highlighting divergent national strategies in AI development.