We Found an Neuron in GPT-2
Written in collaboration with Joseph Miller. See the discussion of this post over on LessWrong.We started out with the question: How does GPT-2 know when to use the word an over a? The choice depends on whether the word that comes after starts with a vowel or not, but GPT-2 is only capable of predicting…