• FaceDeer@fedia.io
    link
    fedilink
    arrow-up
    173
    arrow-down
    14
    ·
    5 months ago

    That’s because this isn’t something coming from the AI itself. All the people blaming the AI or calling this a “hallucination” are misunderstanding the cause of the glue pizza thing.

    The search result included a web page that suggested using glue. The AI was then told “write a summary of this search result”, which it then correctly did.

    Gemini operating on its own doesn’t have that search result to go on, so no mention of glue.

    • morrowind@lemmy.ml
      link
      fedilink
      English
      arrow-up
      72
      arrow-down
      4
      ·
      5 months ago

      Not quite, it is an intelligent summary. More advanced models would realize that is bad advice and not give it. However for search results, google uses a lightweight, dumber model (flash) which does not realize this.

      I tested with rock example, albiet on a different search engine (kagi). The base model gave the same answer as google (ironically based on articles about google’s bad results, it seems it was too dumb to realize that the quotations in the articles were examples of bad results, not actual facts), but the more advanced model understood and explained how the bad advice had been spreading around and you should not follow it.

      It isn’t a hallucination though, you’re right about that

  • Tetsuo@jlai.lu
    link
    fedilink
    English
    arrow-up
    59
    arrow-down
    1
    ·
    5 months ago

    Big AI trying very hard to hide the truth about glue in pizza.

  • Mountain_Mike_420@lemmy.ml
    link
    fedilink
    English
    arrow-up
    36
    arrow-down
    1
    ·
    5 months ago

    You just haven’t gaslighted your ai into saying the glue thing. If you keep trying by saying things like “what about non-toxic glue” or “aren’t there glues designed for humans” the ai will finally give in and recommend the glue. Don’t give up. Glue is good for us.

  • Ghostalmedia@lemmy.world
    link
    fedilink
    English
    arrow-up
    30
    arrow-down
    3
    ·
    5 months ago

    I imagine Google was quick to update the model to not recommend glue. It was going viral.

    • Franklin@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      1
      ·
      edit-2
      5 months ago

      Main issue is Gemini traditionally uses it’s training data and the version answering your search is summarising search results, which can vary in quality and since it’s just a predictive text tree it can’t really fact check.

      • Balder@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        5 months ago

        Yeah when you use Gemini, it seems like sometimes it’ll just answer based on its training, and sometimes it’ll cite some source after a search, but it seems like you can’t control that. It’s not like Bing that will always summarize and link where it got that information from.

        I also think Gemini probably uses some sort of knowledge graph under the hoods, because it has some very up to date information sometimes.

        • Petter1@lemm.ee
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          1
          ·
          5 months ago

          I think copilot is way more usable than this hallucination google AI…

    • efstajas@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      edit-2
      5 months ago

      You can’t just “update” models to not say a certain thing with pinpoint accuracy like that. Which one of the reasons why it’s so challenging to make AI not misbehave.

  • istanbullu@lemmy.ml
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    1
    ·
    5 months ago

    These are statistical models, meaning that you’ll get a different answer each time, also different answers based on context.

    • BradleyUffner@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      1
      ·
      5 months ago

      Not exactly. The answers would be exactly the same given the exact same inputs if they didn’t intentionally and purposefully inject some random jitter into the algorithm each time specifically to avoid getting the same answer each time

      • pup_atlas@pawb.social
        link
        fedilink
        English
        arrow-up
        11
        arrow-down
        1
        ·
        5 months ago

        It’s not just random jitter, it also likely adds context, including the device you’re using, other recent queries, and your relative location (like what state you’re in).

        I don’t work for Google, but I am somewhat close to a major AI product, and it’s pretty much the industry standard to give some contextual info to the model in addition to your query. It’s also generally not “one model”, but a set of models run in sequence— with the LLM (think chatGPT) only employed at the end to generate a paragraph from a conclusion and evidence found by a previous model.

      • EmoDuck@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        2
        ·
        5 months ago

        That jitter is automatically present because different people will get different search results, so it’s not really intentional or purposeful

        • Turun@feddit.de
          link
          fedilink
          English
          arrow-up
          6
          arrow-down
          2
          ·
          5 months ago

          Yes it is intentional.

          Some interferences even expose a way to set the “temperature” - higher values of that mean more randomized (feels creative) output, lower values mean less randomness. A temperature of 0 will make the model deterministic.

          • istanbullu@lemmy.ml
            link
            fedilink
            English
            arrow-up
            1
            ·
            5 months ago

            even at 0 temperature the model will not be deterministic, because it depends on the seed used as well as things like numerical noise.

            • Turun@feddit.de
              link
              fedilink
              English
              arrow-up
              1
              ·
              edit-2
              5 months ago

              Yeah no, that’s not how this works.

              Where in the process does that seed play a role and what do you even mean with numerical noise?

              Edit: I feel like I should add that I am very interested in learning more. If you can provide me with any sources to show that GPTs are inherently random I am happy to eat my own hat.

  • Retiring@lemmy.ml
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    1
    ·
    5 months ago

    Ask it five times if it is sure. You can usually get it to say outrageous things this way

  • Lvxferre@mander.xyz
    link
    fedilink
    English
    arrow-up
    11
    arrow-down
    3
    ·
    5 months ago

    I’m almost sure that they use the same model for Gemini and for the A"I" answers, so patching the “put glue on pizza” answer for one also patches it for another.

    • Balder@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      5 months ago

      Nope it’s because on Search it was summarizing the first results, the “pure Gemini” isn’t doing a search at that time, it’s just answering based on what it knows.

  • IsThisAnAI@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    29
    ·
    edit-2
    5 months ago

    Y’all losing your mind intentionally misunderstanding what happened with the glue. Y’all are becoming anti ai lemons just looking for rage bait.

    The AI doesn’t need to be perfect. Just better than the average person. That why the shitty Tesla said driving has such good accident rates despite the fuck ups everyone loves to rage about in the news cycle.

    • catloaf@lemm.ee
      link
      fedilink
      English
      arrow-up
      5
      ·
      5 months ago

      The average person isn’t going to recommend putting glue in pizza.

      • yukijoou@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        5 months ago

        the avreage person also isn’t as convincing as a bot we’re told is the peak of computer intelligence