• 9488fcea02a9@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    1
    ·
    11 months ago

    I dont understand the VRAM cuts… The RAM fabs have been cutting production because of low prices

    I would love more VRAM so that i can have a GPU that can do a bit of gaming and dabble in some AI stuff. 100% agree i’d pay for more VRAM instead of horsepower

    • CaptainProton@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      11 months ago

      More memory means you can do real work with it, and enterprise AI training is a money printer that they’d be scavenging the shit out of with cards that are closer substitutes.

      • tal@lemmy.today
        link
        fedilink
        English
        arrow-up
        1
        ·
        11 months ago

        Honestly, the gap between the server parallel compute cards and the home video cards isn’t that large. 24GB on video cards, 80GB for a compute card.

        That’s not even two binary orders of magnitude. That’s a narrow window to try to make their money from. Plus, some tasks can be subdivided and run on multiple GPUs, and they can’t segment up the market for those.

        Like, in general, my bet is that when for most things that fit the above requirements of fitting in that window and having a task that can’t be subdivided, there’s probably enough room for algorithmic improvements to get two binary orders of magnitude of reduction in memory requirements.