Tag
This paper introduces a technique to disentangle a single convolutional neuron in Inceptionv1 by analyzing Hadamard products, revealing clean monosemantic clusters (cars, cats, dogs) and also low-valued clusters (letters, faces) with distributed weights as evidence of gradient descent behavior.