• 0 Posts
  • 62 Comments
Joined 1 year ago
cake
Cake day: June 16th, 2023

help-circle



  • Nearly every languages’ every core packages are written in C. And almost every higher packages have some amount of C. That doesn’t mean we get to say every program is done in C. And if you keep drilling down, everything is just machine lang. And certainly still disproves the OPs point of inefficient python.

    Saying it’s all done in C hardly even true. Just look at xformers library on GitHub. Only 2.7% of the code is C. And the entire library is about optimizing.

    Additionally, vast majority of the great leaps in ML efficiency changes hasn’t come from better programmed packages, though they too certainly made big strides. How we calculate itself has changed. That’s what makes the greatest optimizations in anything. It doesn’t matter what language it is, doing a loop 1000000 times to add 1 is going to be worse performance than just doing 1 multiplied by 1000000. How we calculate, what we choose to give up (such as determinism in some implementations if SDP attention changes) and such makes big differences.

    Optimizations also has to be done by someone. Whether that be data scientists or otherwise. The ability for higher level languages to enable them to do so like you say also makes a big difference. If all the programmers had to optimize in C only, we’d still be way behind where we are now in performance.

    Just swapping languages doesn’t yield better results like OP is implying.



  • Grumpy@sh.itjust.workstoMemes@lemmy.mlSoftware: Then vs Now
    link
    fedilink
    arrow-up
    3
    arrow-down
    1
    ·
    5 days ago

    What makes you think python is in optimized and bloated?

    Did you know vast majority of AI development happening right now is on python? The thing that literally consumes billions of dollars of even-beefier-than-4090 GPUs like A100. Don’t you think if they could do this more efficiently and better on C or assembly, they would do it? They would save billions.

    Reality is that it makes no benefit to move away from python to lower level languages. There is no poor optimization you seek. In fact if they were to try this in lower level languages, they’ll take even longer to optimize and yield worse results.








  • Actually statistics show that an encounter with a bear is orders of magnitude more dangerous than an encounter with a man. Obviously. I encounter 1000s of men as I was down the street and I’m not dead yet.

    Yes, it’s very unlikely to run into a bear. But if that’s the point you’re making, you’re missing the predicate of the question where the encounter is already assumed.


  • I think hyper polarization is one of the greatest societal issues we face currently. Whether it be war of genders, politics, etc. We are losing the calm middle ground that should be the majority without outside influence.

    It’s so incredibly easy to polarize. We see it in this thread too. The top of this comment thread is a polarization too. Essentially dividing men into 2 distinct set of groups. You’re either good or a villain. This dichotomy is ridiculous and every social community eats it up like crazy, this Lemmy included. These create effects of over abundance, as you mention of caution, fear and hate.

    If anyone actually thinks that they’d be better off with an encounter with a wild bear than a man, they’re just stupid and insane. Just walking down the street, I encounter 1000s of men. If there were 1000s of bears, I’m sure no one would go there. But we’re not appealing to logic. We’re appealing to feelings that’s been derived from these polarizations and sadly I see no way for this to end.




  • There are many different niches of ML. 99% of hobbyist would use consumer grade hardware. It’s quite frankly more than good enough.

    Even in commercial usage, consumer GPUs provide better value unless you need to do something that very specifically require a huge vram pool. Like connecting multiple A100 GPUs to have hundreds or tens of thousands of gigabyte vram. Those use cases only come up if you’re making base models for general purpose.

    If you’re using it for single person use case, something like 4090 is actually the best hardware. Enough ram to run almost anything and it’s higher clock speed than enterprise GPU means your results come back faster.

    Even training doesn’t require that much vram. Chat models are generally more vram heavy but if you’re doing specific image training like stable diffusion for how to render your face, or some specific fetish porn, you only really need like 12GB of vram to do it. There are ways to even do it at lower like 8GB but 12 is sweet value spot where even 3060 or 4060ti can do. Consumer GPUs will get that trained in like 30min to 24hrs depending on settings and model.


  • I haven’t been part of the modding scene for a while now. But most likely, none of their public APIs were changed. Naturally, I could be wrong since I didn’t read the patch notes, but that’s typically not where it goes wrong.

    Many modder, and I mean many, do not find Bethesda’s provided APIs to be sufficient for their goals. So people extend those APIs further with their own libraries and scripting engines. Then other modders build on top of that extensions. These work against the binary code of the game and contain a list of pointer addresses in binary. So even the smallest changes to the game binary ends up making all of these extensions to stop working.

    These mods have a headache anytime any kind of updates are pushed. It’s an API thing, but it’s not the API Bethesda made.


  • There are multiple incorrect interpretations you are picturing. I did not say every behavior that came to existence are moral. Nor is evolution itself moral. I meant that morality came to existence because of human evolution as a whole, because it allows greater growth of humans and what is greater is selected through natural selection. Well being of humans is also not well being of singular or a single family. They would often be at counter to each other. Eating and killing others is obviously detrimental to humanity even if it would have benefited a single individual.

    Benefit of humanity extends indirectly to other animals. But not directly. That is, the benefit of other animal does not matter, cats and dogs included. But these animals, including farm animals, or wildlife, do bring positive value to humanity. As an hyperbolic example, if skinning cats alive somehow benefited humanity, I would consider that a moral act and our perception of that act would follow. Furthering this example, we don’t consider annihilation of mosquitos (which humans actively partake in) to be immoral (just questionable consequences) because they seemingly bring no benefit to humanity.

    My view on morality is not arbitrary. It is a question of what is good for humans as a whole. If yes, it is moral. If not, it is immoral.


  • Grumpy@sh.itjust.workstoMemes@lemmy.mlI'm too high for this
    link
    fedilink
    arrow-up
    6
    arrow-down
    1
    ·
    1 year ago

    Morals is not religion. If anything I vehemently dispute religion claiming any ownership of morals. See Plato on morals for more details. But I would say that highest of morals is the highest well-being of humans. This would apply not only from philosophical approach but also from an evolutionary one.

    Having said that, I don’t believe eating meat is immoral. It is how we evolved, and eating meat is part of what is to be human.