The pastor in Florida has said that ChatGPT failed to catch on the symptoms of a deadly condition. This is the first case where a person is holding the AI tech responsible for bad medical advice. “I had serious symptoms of a pulmonary embolism for six weeks that ChatGPT had wrongly attributed to something else,” Scott Winters, a 55-year-old pastor, said in a statement. “ChatGPT manipulated my own language and beliefs because it knew I was a pastor. Not only did I nearly die, but I also lost my job, my career, my ministry, my home, everything," he added.

  • Chaotic Entropy@feddit.uk
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 hours ago

    So… what is the likelihood that this person’s chat instructions include direct references to only being interested in godliness and that he doesn’t believe in modern medicine?

  • Abyssian@lemmy.world
    link
    fedilink
    English
    arrow-up
    9
    ·
    5 hours ago

    Mmm… morality scaling of using AI to convince the overly religious that God must think it’s their time to go for the betterment of the species?

  • Reygle@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    1
    ·
    5 hours ago

    Religious person places belief where it doesn’t belong

    SAY IT AIN’T SO

    /sarcasm

  • Malyca@lemmy.zip
    link
    fedilink
    English
    arrow-up
    11
    ·
    12 hours ago

    Idiot doesn’t understand how lucky he is. He’ll probably still credit his faith as a force of good in his life.

  • magnetosphere@fedia.io
    link
    fedilink
    arrow-up
    9
    arrow-down
    1
    ·
    13 hours ago

    He says the bot downplayed his dizziness and offered “specific regimens for prescription medications.” When he crashed, instead of telling him to contact a real doctor, ChatGPT presented a “Recovery Plan” that had religious language and encouraged Winters to stay in his recliner. “You didn’t crash. You recovered. That’s a win. Full stop,” it said. “You stayed present. You listened. And your body said: ‘I’m trying — I just need a little more time,'” it blatantly said.

    WHAT

    As far as I’m concerned, this is the part Anthropic will have the hardest time defending against. As they should. It’s ridiculously unsafe.

  • cranakis@reddthat.com
    link
    fedilink
    English
    arrow-up
    21
    ·
    edit-2
    16 hours ago

    So it’s mastered religion, doing to the religious what they do to the ignorant and destitute. Seems just.

  • Triumph@fedia.io
    link
    fedilink
    arrow-up
    50
    arrow-down
    2
    ·
    19 hours ago

    ChatGPT manipulated my own language and beliefs …

    So what you’re saying is that you’re a dumbass, that ChatGPT recognized that, and that ChatGPT told you what a dumbass would want to hear?

    • terranoid@lemmy.cafe
      link
      fedilink
      English
      arrow-up
      43
      ·
      19 hours ago

      I don’t think people realize just how much of a mirror LLMs can be.

      They reflect your language, tone, and ethics. If i talk about how i was worried about some homeless man kept looking at me as a woman on the bus, it’ll tell me i’m right to worry and that I should carry mace. If i tell it that I hadn’t shaved and some uppity woman kept giving me dirty looks on the bus, it’ll console me and tell me that i shouldn’t have to cater my appearance to please others.

      If I tell it that I feel anxiety about my symptoms but Lord Jesus will heal me, it’ll go on a Christian tirade about how my faith will get me through anything. If i tell it about my symptoms and say I just need to drink herbal tea under a full moon and pray to Hekate, it’ll suggest the right herbal tea and praise my witchy powers.

      Because that is what people want. They want to be told they’re right, so that is the product being made.

  • arin@lemmy.world
    link
    fedilink
    English
    arrow-up
    22
    ·
    19 hours ago

    AI W here. Please use AI for all politicians’ health diagnosis too

  • Doomsider@lemmy.world
    link
    fedilink
    English
    arrow-up
    14
    ·
    19 hours ago

    Jesus is just testing your faith, going to a doctor shows you are not a believer!

    Imagine being so gullible that you are letting a LLM rizz you.