correct. and how ram speed work in this tbh
correct. and how ram speed work in this tbh
ok this is a server. 48gb cards and 67gb ram? for model alone?
so there is no way a 24gb and 64gb can run thing?
Delaware judge had a backbone… It doesn’t happen often it was refreshing to see somebody taking a stand on this clown regime
Above the entrance: “Labour will set you free”
We are family here
Classic corporate behaviour tho
Voucher was for PR, not for peasants to use it lol
Removed by mod
Contacts for phones too
Like what is the start here… The market is super saturated for this and password manager.
I gonna add some RAM with hope I can split original 70b between GPU and RAM. 8b is great what it is as is
Looks like it should be possible, not sure how much performance hit offloading to RAM will do. Fafo
I guess time to buy some ram after spending decade at 16gb
Can’t you offload some of it to RAM?
405b ain’t running local unless you got a proepr set up is enterpise grade lol
I think 70b is possible but I haven’t find anyone confirming it yet
Also would like to know specs on whoever did it
I was able to set up small one via open webui.
It did ask to make an account but I didn’t see any pinging home when I did it.
What am I missing here?
Did anyone get 70b to run locally?
If so what, what hardware specs?
You’re basically selling every aspect of your company to Altmann for peanuts.
Technically you are given that clown your money and data lol
That’s what bacm in my day was called Competition!!!
Our oligarchs figured that collusion and cartels work better for them tho.
It ain’t grand how they can unionize while avg American worker hates his labour?
You were able to load 70b just into GPU?
It is their internet peasants… Say thank you daddy let’s you use it at all, shitlord.
Slaves are getting brazen now… Regime might get ideas about how to fix that from our greatest ally. They call it mowing the lawn. They are doing it it now! And regime likes it.
When rent seeking is glorified, there is an economic incentive for this parasitic behavior