ChatGPT can get worse over time, Stanford study finds | Fortune
fortune.com
ChatGPT went from answering a simple math correctly 98% of the time to just 2%, over the course of a few months.

Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds. Researchers found wild fluctuations—called drift—in the technology’s abi…::ChatGPT went from answering a simple math correctly 98% of the time to just 2%, over the course of a few months.

  • DominicHillsun@lemmy.worldEnglish
    1·
    1 year ago

    It seems rather suspicious how much ChatGPT has deteorated. Like with all software, they can roll back the previous, better versions of it, right? Here is my list of what I personally think is happening:

    1. They are doing it on purpose to maximise profits from upcoming releases of ChatGPT.
    2. They realized that the required computational power is too immense and trying to make it more efficient at the cost of being accurate.
    3. They got actually scared of it’s capabilities and decided to backtrack in order to make proper evaluations of the impact it can make.
    4. All of the above
    • Windex007@lemmy.worldEnglish
      1·
      1 year ago
      1. It isn’t and has never been a truth machine, and while it may have performed worse with the question “is 10777 prime” it may have performed better on “is 526713 prime”

      ChatGPT generates responses that it believes would “look like” what a response “should look like” based on other things it has seen. People still very stubbornly refuse to accept that generating responses that “look appropriate” and “are right” are two completely different and unrelated things.