totally. i also chalk a lot of blame up to the fact that system prompts (I think?) often include language like “you are an AI assistant” and because AI in science fiction is frequently like, a way of alienating and figuring human consciousness by situating it at its limits, it often entails the experience of pain? or like sometimes AI is used to represent what happens when we instrumentalize and objectify experiencing subjects, or experimentally instantiate a real distinction between rationality and feeling, and given that i think most writers believe that these are bad approaches to existence that lead to dysfunction and suffering, well

i think it kind of parallels how so many AI delusional spirals involve New Kinds of Physics – physics is coded as The Smartest Thing Ever and if an AI is Superintelligent or if you’ve unlocked Superintelligence through it then “paradigm shifting innovations in physics” are going to be what follows from that line of reasoning + the “you are an AI” thing