• eicker@lemmy.world
    link
    fedilink
    English
    arrow-up
    25
    ·
    3 days ago

    1.5 TB of unified memory sounds less like a computer and more like Apple preparing for the moment your local AI starts asking for a raise. Plot twist: by 2028 the RAM upgrade still costs more than the rest of the machine combined.

    • AA5B@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      ·
      3 days ago

      Remember this is “unified”, it’s not like you can upgrade, nor is it available in the “cheap” packaging we’re used to.

      You’ll get whatever Apple puts on the SoC, and you’ll be happy with it

      • eicker@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        ·
        3 days ago

        The upside is that unified memory is genuinely different from traditional RAM. The CPU, GPU and Neural Engine all share the same memory pool, so data doesn’t need to be copied back and forth. That reduces latency, improves efficiency and lets AI models, graphics and other workloads access much larger datasets. It also uses less power and saves board space. The downside is obvious: because it’s integrated into the chip, you have to choose the right amount upfront, since it can’t be upgraded later.

        • NotMyOldRedditName@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          3 days ago

          Ya, these high memory amounts and ever increasing memory bandwidth are heavily (but not only) targeting people wanting to run local large AI models like a full deepseek on their machines.

          You might not be able to train as well on them as NVIDIA + CUDA, but for local inference, they’re an alternative to NVIDIA and more reasonably priced for the model sizes you can run, and each iteration they get better as the bandwidth increases.

        • BigPotato@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          3 days ago

          I slowly turn to dust as I recall cracking open 2013 MacBook Pros and just putting more memory in.

          The memories of loading up the G3 with SDRAM so I can fiddle with Photoshop 5, lost like tears in the rain.

    • plyth@feddit.org
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 days ago

      Plot twist: by 2028 the RAM upgrade still costs more than the rest of the machine combined.

      Won’t at least China have production capacities ready by then that make the price drop?

    • mecen@lemmy.ca
      link
      fedilink
      English
      arrow-up
      0
      ·
      3 days ago

      Doesn’t big companies try open models. Microsoft was testing deepseek.

        • mecen@lemmy.ca
          link
          fedilink
          English
          arrow-up
          0
          ·
          3 days ago

          But I bet next they will close it after gaining bigger foothold. I wonder how would you prevent this.

          • eicker@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            3 days ago

            I don’t think open-weight models can be prevented, as ‘everyone’ knows how distillation works these days and, clearly, no one can do anything to stop it.

                • mecen@lemmy.ca
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  2 days ago

                  Yes, but expertise is not there and when they will lead in ai they will turn it into proprietary software. Afterwards no-one will know how to develop it further.

                  At least I think so.