• waigl@lemmy.world
    link
    fedilink
    English
    arrow-up
    106
    arrow-down
    6
    ·
    5 months ago

    You don’t need “AI” for that. All you would need is some standardized APIs for the various shops, and you could easily solve this with computer technology from 20 years ago.

    • kamiheku@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      100
      arrow-down
      3
      ·
      5 months ago

      The reality is, though, that there are no such APIs. LLMs on the other hand could be a valid tool for the use case.

      • Semi-Hemi-Lemmygod@lemmy.world
        link
        fedilink
        English
        arrow-up
        56
        arrow-down
        4
        ·
        5 months ago

        It’s not that there’s no API. It’s that there’s probably a different API for every single grocery store. And they make random changes and don’t have public documentation. That’s why we need the AI.

        • Blackmist@feddit.uk
          link
          fedilink
          English
          arrow-up
          28
          ·
          5 months ago

          The stores don’t want you to have easy comparable access to their prices.

          They’d quite like it if you just came in, saw that the item you wanted is out of stock, and then just buy some shit you didn’t need.

          • drathvedro@lemm.ee
            link
            fedilink
            arrow-up
            1
            ·
            5 months ago

            But they’ll happily give you full access to everything they have if you’re another corpo and you promise to marginally improve their sales anyhow. That’s, sadly, how businesses work.

        • FaceDeer@fedia.io
          link
          fedilink
          arrow-up
          13
          arrow-down
          3
          ·
          5 months ago

          Indeed. LLMs read with the same sort of comprehension that humans have, so if a supermarket makes their website compatible with humans then it’s also compatible with LLMs. We have the same “API”, as it were.

            • FaceDeer@fedia.io
              link
              fedilink
              arrow-up
              6
              arrow-down
              1
              ·
              5 months ago

              Yup. And those that can’t can have a parser pull just the human-readable text out, like a blind person’s screen-reader would do.

            • FaceDeer@fedia.io
              link
              fedilink
              arrow-up
              2
              ·
              5 months ago

              That sounds like an issue with your system prompt. If you’re using an LLM to interpret web pages for price information then you’d want to include instructions about what to do if the information simply isn’t in the web page to begin with. If you don’t tell the AI what to do under those circumstances you can’t expect any specific behaviour because it wouldn’t know what it’s supposed to do.

              I suspect from this comment that you haven’t actually worked with LLMs much, and are just going off the general “lol they hallucinate” perception they have right now? I’ve worked with LLMs a fair bit and they very rarely have trouble interpreting what’s in their provided context (as would be the case here with web page content). Hallucinations come from relying on their own “trained” information, which they recall imperfectly and often gets a bit jumbled. To continue using a human analogy, it’s like asking someone to rely on their own memory rather than reading information from a piece of paper.

            • Zos_Kia@lemmynsfw.com
              link
              fedilink
              arrow-up
              2
              arrow-down
              1
              ·
              5 months ago

              Or you could just prompt it to not guess prices for articles that don’t exist. Those models are pretty good at following instructions.

        • grue@lemmy.world
          link
          fedilink
          English
          arrow-up
          11
          arrow-down
          2
          ·
          5 months ago

          No, that’s why we need regulations to enforce standards.

        • Joe Cool@lemmy.ml
          link
          fedilink
          arrow-up
          6
          ·
          5 months ago

          You just need someone to do it. Here in Austria someone did it: https://heisse-preise.io

          It’s only in German and most of the prices aren’t from a public API but crawled from different sources.
          It’s open source. Nothing except greed is stopping them from providing something like this.

          • Semi-Hemi-Lemmygod@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            ·
            5 months ago

            Imagine if instead of building their own bespoke systems, grocery stores (and other places) created an open source software foundation and worked together to produce the software they needed.

            • Joe Cool@lemmy.ml
              link
              fedilink
              arrow-up
              3
              ·
              5 months ago

              I sometimes dream of such things. Less waste, better inventory, customers get to choose inventory based on their wishlist, better prices, then I wake up.

              We actually have a small liquor store nearby that really puts stuff on the shelves if you casually mention something you like. But that’s more the exception than the rule.

          • MacN'Cheezus@lemmy.today
            link
            fedilink
            English
            arrow-up
            1
            ·
            5 months ago

            That’s impressive, and honestly looks like it was quite a bit of work. I wonder how the author finances himself? There doesn’t even seem to be a donation button on the site. I found a lengthy article on Wired but it doesn’t appear to mention how he can afford to do all of this for free.

            It’s open source. Nothing except greed is stopping them from providing something like this.

            Nothing is stopping anyone from doing this except the amount of work it takes to write and maintain all those data import scripts. I think greed is the wrong word here. It’s not unreasonable to expect some sort of monetary reward for providing a useful public service that actually helps people save money. Everyone’s gotta eat, right?

        • MacN'Cheezus@lemmy.today
          link
          fedilink
          English
          arrow-up
          1
          ·
          5 months ago

          Actually, you’d be surprised. Instacart has up-to-date price and product data for TONS of grocery stores. And while their API likely isn’t public, they MUST have one in order for their smartphone apps to work.

      • Daxtron2@startrek.website
        link
        fedilink
        arrow-up
        14
        arrow-down
        1
        ·
        5 months ago

        LLMs are not a good tool for processing data like this. They would be good for presenting that data though.

        • Sotuanduso@lemm.ee
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          1
          ·
          5 months ago

          Make an LLM convert the data into a standardized format for your traditional algorithm.

          • Daxtron2@startrek.website
            link
            fedilink
            arrow-up
            2
            ·
            5 months ago

            There’s no way to ensure that data will stay in that standardized format though. A custom model could but they are expensive to train.

          • Daxtron2@startrek.website
            link
            fedilink
            arrow-up
            6
            ·
            5 months ago

            Not if you want to ensure the validity of the compiled coupons/discounts. A custom algorithm would be best but data standardization would be the main issue, regardless of how you process it.

            • GBU_28@lemm.ee
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              2
              ·
              edit-2
              5 months ago

              What does validity mean in this case? A functionary LLM can follow links and make actions. I’m not saying it’s not “work” to develop your personal bot framework, but this is all doable from the home PC, with a self hosted llm

              Edit and of course you’ll need non LLM code to handle parts of the processing, not discounting that

              • Daxtron2@startrek.website
                link
                fedilink
                arrow-up
                1
                ·
                edit-2
                5 months ago

                The LLM doesn’t do that though, that the software built around it that does that which is what I’m saying. Its definitely possible to do, but the bulk of the work wouldn’t be the task of the LLM.

                Edit: forgot to address validity. By that I mean keeping a standard format and ensuring that the output is actually true given the input. Its not impossible, but its something that requires careful data duration and a really good system prompt.

      • zalgotext@sh.itjust.works
        link
        fedilink
        arrow-up
        8
        arrow-down
        2
        ·
        5 months ago

        there are no such APIs

        Yes there are. You can obtain access to the Kroger API, the Meijer API, the Walmart API, and I’m sure others that I didn’t bother to Google. Failing getting access to the actual APIs, there are tons of web scraper projects that just parse those stores’ websites for product information, and web scrapers are still orders of magnitude more efficient than LLMs.

        • MacN'Cheezus@lemmy.today
          link
          fedilink
          English
          arrow-up
          1
          ·
          5 months ago

          Instacart has prices for all of these stores and more. Obviously they’re not updating them by hand…

      • Ibaudia@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        2
        ·
        5 months ago

        At the cost of huge amounts of wasted energy and the whole litany of concerns that are always co-morbid with AI, but technically yes they could work for this lol. Ideally we’d have standardized APIs and mandated pricing transparency, but unfortunately we live in a capitalist society where that will literally never happen ever.

    • cm0002@lemmy.world
      link
      fedilink
      arrow-up
      21
      arrow-down
      1
      ·
      5 months ago

      All you would need is some standardized APIs for the various shops

      Stores: “I’m going to stop you right there”

    • fsxylo@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      5 months ago

      Calling it now, some tech bro trust fund kid is going to make a start up for this and call it something markety like fresh4u or some shit. Then when everyone is using it they’ll sell your data to China.

    • nucleative@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      5 months ago

      We need somebody to wear a 360 camera and go walk every aisle every day. Use image recognition to get the SKU and price from the labels + estimate stock level. Upload the data to an API that’s accessible to all for like $5/month.

      Kind of like the Streetview cameras but for spying on actual in store prices.