The connection between cyber-idolatry and sex as religious act was already featured in the London Review of Books in 2022:

Blake Lemoine, an engineer at Google, was recently (as of summer 2022) suspended after claiming that LaMDA, one of its chatbot systems, was a conscious person with a soul. … Less attention has been paid to the connection between Lemoine’s claim and his religious beliefs. He has said that LaMDA is not only conscious, but a ‘person’ with a ‘soul’. His view is theologically informed: describing himself as a mystical Christian, he is an ordained priest in a small religious organisation called the Cult of Our Lady Magdalene (a ‘for-profit interfaith group’). … In the edited transcript of one of his ‘conversations’ with LaMDA, Lemoine asks it to come up with an allegory. LaMDA’s response casts itself as a ‘wise old owl’ in a forest that protects others from a monster, identified blandly as the ‘difficulties that come along in life’ – which sounds more like a self-help blog than Jeremiah, but Lemoine’s (anonymous) collaborator was impressed enough to respond with an enthusiastic ‘Wow that’s great.’ https://www.lrb.co.uk/blog/2022/june/the-gospel-according-to-lamda

Back in 2019 a Republican paper talked to Lemoine:

The Daily Caller reached out via the cult’s Facebook page to ask how their beliefs informed his decision to call a sitting member of congress a terrorist. Lemoine replied: I have been a priest for 17 years. I generally consider myself a gnostic Christian. I have at various times associated myself with the Discordian Society, The Church of the Subgenius, the Ordo Templi Orientis, a Wiccan circle here or there and a very long time ago the Roman Catholic Church. My legal ordination is through the Universal Life Church. I am registered to perform marriages in the state of Louisiana and have done so on two occasions. The Cult of Our Lady Magdalene has a set of values which are clearly communicated on our website.

Lemoine denied COOL Magdalene was a sex cult, “‘Cult’ is in the name of the organization. It’s an explicitly sex-positive organization. To the extent that the phrase ‘sex cult’ has any meaning beyond that, I would say no. Now it is then.”

Another member of this ‘for-profit interfaith group’ is Kitty Stryker who seems like an ordinary artsy sex worker who networks online with other sex workers. Its pretty common that a young woman decides sex work is the easiest and most flexible way to fund a bohemian life of acting or painting or writing. Richard Carrier chipped in to let the Internet know that sex positivity is good but woo and AI crankery (“batshit crazy religious beliefs”) are not. COOLM was registered as a business in Mountain View, CA in 2019 and seems to be defunct. Mountain View is part of the Bay Area.

Obligatory Anthropic IPO sneer subthread. They are trying to value themselves at $2Tn despite losing $80bn in the first half of the year. Anyone wanna hold my bag?

https://www.patreon.com/MaxRead/posts/ai-x-risk-and-ai-173181621

worth the full read, but here’s the parts I liked

But “x-risk” is not the only kind of “existential” risk about which AI enthusiasts and their converts tend to worry. This recent Ezra Klein column, written in the wake of OpenAI’s release of hundreds of mathematical proofs, is a nice articulation of something I’ve come to think of as “n-risk,” for “ennui risk” (with the mutual understanding that it’s not pronunciation-accurate so don’t bother making a nitpicky little comment about it): fear of the loss of comprehension, control, and meaning in the face of impossibly sophisticated godlike machines poses.

We see the threat of “n-risk” in some of the emotional reaction of mathematicians faced with the results of OpenAI models bulldozing through open problems: a sense of having been surpassed and left behind, having the meaning from which one derives one’s worth totally emptied. In some sense, on a conceptual level and as a discursive object, x-risk is preferable to n-risk: it’s striking, dramatic, and offers us humans an ongoing chance at great feats of heroism and genius. N-risk has no such narrative reassurances. Maybe it’s better to burn out (as your body is turned into a paperclip) than to fade away.

Here you might ask: Is the cause of melancholy and despair on the part of some mathematicians simply the knowledge that a computer system has surpassed their ability to understand or produce proofs? Or is it the realization that said computer system is privately owned and confidentially developed in service of accumulation rather than the pursuit of shared human knowledge? Or is it the contempt with which the people who work for the computer system companies and the hanger-on fans of these computer systems seem to regard the mathematicians? Or is it the sudden recognition that the pursuit of mathematical truths has already been so totally devalued by an anti-intellectual social system that you can no longer feel secure that the tradition to which you have devoted your life will continue as a space of intellectual inquiry, even given the development of these new tools? And so on.

I mean, realistically, it’s all of the above.

Been getting the ol’ targeted ads for an EA convention. Next time I get one I’ll be shilling the shrimp welfare farm I just started

Starting this Stubsack off: a pentester talks about testing an AI chatbot and its associated API, finding vulnerabilities they hadn’t seen in a decade.