I agree. This is feeding off of a new way to market and use people’s insecurities, selling them a fix that will do more damage. I think we’ve already seen this in the business world with adoption of AI for every damn thing, even forcing employees to enbrace it or leave. And the best ones aren’t even that good. And then there’s Co-pilot, which is worse. So adding another more personal version will pull in more people looking for answers to their problems (caused by a society that’s broken).

The question of AGI and whether one can be personal with it is an interesting debate, and not one that people are happy to entertain in discussion or acceptance at this time. But we don’t have AGI, may never have it, and this is simply a money grab no different than OnlyFans and webcam girls, only there’s no human at the other end that has to get a small part of the profit.

If you dont like how a tool is going to be used, remove the social impetus to use it that way. People dont turn to these chat bots because its fun, they do it because they are lonely. And until that loneliness is dealt with, there will always be solutions like this and society is going to become more fractured and corrupted. While I agree that this is horrific and not a good thing, I also recognise that without tackling the actual issue here discussing the morals of this chat bot is pointless, at best.

Tl;dr if your ability to care begins and ends with “ai bad” without understanding the human cause for why it is being used, then you might as well save your breath.