• 0 Posts
  • 44 Comments
Joined 1 year ago
cake
Cake day: June 12th, 2023

help-circle



  • Taking ollama for instance, either the whole model runs in vram and compute is done on the gpu, or it runs in system ram and compute is done on the cpu. Running models on CPU is horribly slow. You won’t want to do it for large models

    LM studio and others allow you to run part of the model on GPU and part on CPU, splitting memory requirements but still pretty slow.

    Even the smaller 7B parameter models run pretty slow in CPU and the huge models are orders of magnitude slower

    So technically more system ram will let you run some larger models but you will quickly figure out you just don’t want to do it.















  • Pumpkin Escobar@lemmy.worldtoUnixporn@lemmy.ml*Permanently Deleted*
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    7 months ago

    Agreed, the meta+arrow shortcuts to move windows around are great. That defaults to half/quarter windows. You can also define a custom layout (meta+t to configure). The meta+arrow shortcuts still work on half/quarters of the screen, but you can shift+drag a window to drop it into one of the custom layout tiles/areas… gives a lot of flexibility.