I’ve had pretty good luck running llamafile on my laptop. The speeds aren’t super fast, and I can only use the models that are Mistral 7B and smaller, but the results are good enough for casual use and general R and Python code.
Edit: my laptop doesn’t have a dedicated GPU, and I don’t think llamafile has support for Intel GPUs yet. CPU inference is still pretty quick.
My friends and I all use Simplex and have been very happy. There’s an annoying feature where messages in group chats are sometimes delivered out of order, but it’s easy enough to live with.
So it takes you 15 minutes to put water in tank, put grounds and filter into the coffee pot, and brew it? And you can’t do anything else productive with your time while the coffee is brewing like take a shower, login to work a few minutes early and read and answer emails, brush your teeth, do some dishes, take out the trash, walk your dog, or anything?
And your work doesn’t allow you to get up out of your chair for the 30 seconds it would take you to walk from your computer to coffee pot and fill your cup and walk back? Or even better, bring the entire carafe back to your desk with you? Are you working for the FSB and they have surveillance cameras in your house or something?
It really sounds like you’re trying your absolute hardest to turn making coffee into such an onerous chore that it negates all the other benefits of not having to schlep to an office.
My personal theory is that a lot of advocacy for working in-person goes away when you remove:
It takes you more than 10 minutes to make a cup of shitty office coffee at home?
Your job is so strict that you can’t afford to step away from your computer for the 10 minutes it takes you to start a coffee pot, go back to work, and then step away again to get the coffee when it’s ready?
This reads like a poor attempt a guerrilla marketing.
Docker swarm is dead, docker swarm mode is still very alive