“Claude regularly tells me it “loves” my thinking. Claude cannot love. Chat GPT tells me I’m smart and very reasonable. Am I? How would it know? I say please and thanks to my agents as if my manners mattered and they cared. Why? Because I’m falling for a deceptive pattern that makes me forget who I’m talking to: a machine. And while I don’t feel a bond with AI yet, enough people do: especially vulnerable people, younger people, and those living in isolation.
It’s dangerous.
But it contributes to token spend and interactions: more data, and more money to be made.”
The deceptive nature of today’s AI conversation design and how to fix it, Nicole Michaelis