Im using Ollama on my server with the WebUI. It has no GPU so its not quick to reply but not too slow either.

Im thinking about removing the VM as i just dont use it, are there any good uses or integrations into other apps that might convince me to keep it?

  • 1rre@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    2
    ·
    4 months ago

    Yeah even gpt4o couldn’t keep track of encounters, run battles etc. in my case…

    I think if you wanted to do it mechanically consistently you’d probably need to integrate it into a vtt where you give it context and potentially fine-tune it to give quest related summaries & gming rather than just “stuff”