Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)BR
Posts
35
Comments
2,869
Joined
1 yr. ago

  • I feel like there’s a “bell curve” for Linux gaming enjoyment.

    If you’re even a little techy, like not using your PC begrudgingly and mostly live in iOS or whatever, the switch will feel like a relief. But many PC users aren’t; they arent interested in what a OS or file system is, they just want League or Sims to pop up and that’s it.

    …And then there’s me. I use Linux for hours every day, I’m pretty familiar with the graphics stacks and such… But I need the performance of stripped, neutered Windows I dual boot for weird, modded sim games I sometimes play. And frankly, it’s more convenient for many titles I need to get up and running quick for coop or whatever. There’s also tools like SpecialK that don’t work on Linux, and help immensely with certain games/displays.

  • Not everyone's a big kb/mouse fan. My sister refuses to use one on the HTPC.

    Hence I think that was its non-insignificant niche; couch usage. Portable keyboards are really awkward and clunky on laps, and the steam controller is way better and more ergonomic than an integrated trackpad.

    Personally I think it was a smart business decision, because of this:

    It doesnt have 2 joysticks so I just buy an Xbox one instead.

    No one's going to buy a steam-branded Xbox controller, but making it different does. And I think what killed it is that it wasn't plug-and-play enough, eg it didn't work out of the box with many games.

  • With respect, this doesn't make any sense. If you want a joystick controller, just buy an Xbox controller that everything's compatible with anyway?

    The trackpads shine when one needs to emulate a mouse/kb in non-controller games; a nightmare with joysticks.

  • My sister still has a working one that she treats like a religious artifact, as it's the best way to play mouse/KB games from the sofa.

    I see why they discontinued them though. They need custom configs for most games, and I think most people don't like that much tweaking.

  • The laptop APUs were better than Intel, with lower power, and far better graphics!

    It got even more dramatic in the 4000 series. Renior is one of the best chips AMD ever made.

    TBH the press just had a hard time comprehending it back then, and it was lest dramatic on desktop (or tanky desktop-sized laptops with dGPUs) because Intel's chips could clock higher for single-threaded workloads (at the expense of mad power usage).

  • Hmm, an aging population and the job/company market are going to exacerbate this even more. How do we fix it:

    • Democrats: Let’s keep doing exactly what we’ve been doing since the 60s! With leaders from the 60s! Strangles Madami in the corner.
    • Republicans: Let’s cut immigration (the only thing making our population skew young), make healthcare even more private, tax/inflame all our manufacturing suppliers, and make life even more miserable for child bearing women! Oh, and blow up the national debt so none of this can be fixed later. Now buy our crypto, YOLO!

    What about, like, enticing immigrants to balloon manufacturing with education grants and entrepreneur seeding, and, you know, making it not a nightmare to be naturalize, leveraging a huge advantage countries like China don’t have… Or tax the snot out of the rich and tighten government spending, modernize the military to cheaper drone based warfare, regulate healthcare to be less for-profit, all over reasonable timeframes?

    …Nah. Let’s specifically not do that.

  • A lot, but less than you’d think! Basically a RTX 3090/threadripper system with a lot of RAM (192GB?)

    With this framework, specifically: https://github.com/ikawrakow/ik_llama.cpp?tab=readme-ov-file

    The “dense” part of the model can stay on the GPU while the experts can be offloaded to the CPU, and the whole thing can be quantized to ~3 bits average, instead of 8 bits like the full model.


    That’s just a hack for personal use, though. The intended way to run it is on a couple of H100 boxes, and to serve it to many, many, many users at once. LLMs run more efficiently when they serve in parallel. Eg generating tokens for 4 users isn’t much slower than generating them for 2, and Deepseek explicitly architected it to be really fast at scale. It is “lightweight” in a sense.


    …But if you have a “sane” system, it’s indeed a bit large. The best I can run on my 24GB vram system are 32B - 49B dense models (like Qwen 3 or nemotron), or 70B mixture of experts (like the new Hunyuan 70B).

  • DeepSeek, now that is a filtered LLM.

    The web version has a strict filter that cuts it off. Not sure about API access, but raw Deepseek 671B is actually pretty open. Especially with the right prompting.

    There are also finetunes that specifically remove China-specific refusals. Note that Microsoft actually added saftey training to "improve its risk profile":

    https://huggingface.co/microsoft/MAI-DS-R1

    https://huggingface.co/perplexity-ai/r1-1776

    That's the virtue of being an open weights LLM. Over filtering is not a problem, one can tweak it to do whatever you want.


    Grok losing the guardrails means it will be distilled internet speech deprived of decency and empathy.

    Instruct LLMs aren't trained on raw data.

    It wouldn't be talking like this if it was just trained on randomized, augmented conversations, or even mostly Twitter data. They cherry picked "anti woke" data to placate Musk real quick, and the result effectively drove the model crazy. It has all the signatures of a bad finetune: specific overused phrases, common obsessions, going off-topic, and so on.


    ...Not that I don't agree with you in principle. Twitter is a terrible source for data, heh.

  • Nitpick: it was never 'filtered'

    LLMs can be trained to refuse excessively (which is kinda stupid and is objectively proven to make them dumber), but the correct term is 'biased'. If it was filtered, it would literally give empty responses for anything deemed harmful, or at least noticably take some time to retry.

    They trained it to praise hitler, intentionally. They didn't remove any guardrails. Not that Musk acolytes would know any different.

  • Traning data is curated and continous.

    In other words, one (for example, Musk) can finetune the big language model on a small pattern of data (for example, antisemetic content) to 'steer' the LLM's outputs towards that.

    You could bias it towards fluffy bunny discussions, then turn around and send it the other direction.

    Each round of finetuning does "lobotomize" the model to some extent though, making it forget stuff, overuses common phrases, reducing its ability to generalize, 'erasing' careful anti-reptition tuning and stuff like that. In other words, if Elon is telling his engineers "I don't like these responses. Make the AI less woke, right now," he's basically sabotaging their work. They'd have to start over with the pretrain and sprinkle that data into months(?) of retraining to keep it from dumbing down or going off the rails.

    There are ways around this outlined in research papers (and some open source projects), but Big Tech is kinda dumb and 'lazy' since they're so flush with cash, so they don't use them. Shrug.

  • My fantasy is Apple heating up a feud with Facebook and integrating some kind of “self hosting” into the iPhone. EG our Moms “upload” the video, but what really happens under the hood is the phone streams the video on demand to her family. IIRC there are similar swarming schemes out there already.

    It sounds crazy, and it used to be, but smartphones/modems are so fast now they could host little web servers on their efficiency cores, without breaking a sweat.

    …Otherwise, this is a difficult issue, as video is so expensive to centrally host.

  • It coincides with a bunch of other stuff, like hints at Tesla regulation, tariffs, and regular wild swings just from being Tesla.

    Tesla is up 16% over 1 year, 185.44% over 5 years, beating the S&P 500. Not that I would ever hold Tesla, but still, it's not like Musk's wealth has evaporated.

    CNBC is basically the Fox News of finance world. Big, sensationalist and basically catering to day trader hype (not the longer term buy-and-hold crowd. You know, what the stock market is supposed to be). So maybe there's some cause and affect here, but I don't trust them on headlines like this.

  • No, you misunderstand; it’s a sound scheme. I wouldn’t be against it.

    …Which just underscores how horrific of a situation we are in. It’s an akin to “okay, a meteor is coming; what about this plan to deflect it into the arctic?”

    Fossil fuel companies are lobbying for the “everything is fine” propaganda, not geoengineering schemes that indirectly reinforce how dangerously unstable the planet could be.

  • There is a nugget of 'truth' here:

    https://csl.noaa.gov/news/2023/390_1107.html

    I can't find my good source on tis, but there are very real proposals to seed the arctic or antarctic with aerosols to stem a runaway greenhouse gas effect.

    It's horrific. It would basically rain down sulfiric acid onto the terrain; even worse than it sounds. But it would only cost billions, not trillions of other geoengineering schemes I've scene.

    ...And the worst part is it's arctic/climate researchers proposing this. They intimately know exactly how awful it would be, which shows how desperate they are to even publish such a thing.

    But I can totally understand how a layman (maybe vaguley familiar with chemtrail conspiracies) would come across this and be appalled, and how conservative influencers pounce on it cause they can't help themselves.

    Thanks to people like MTG, geoengineering efforts will never even be considered. :(


    TL;DR Scientists really are proposing truly horrific geoengineering schemes "injecting chemicals into the atmosphere" out of airplanes. But it's because of how desperate they are to head off something apocalyptic, and it's not even close to being implemented. They're just theories and plans.

  • Technology @lemmy.world

    Shipping Listing Suggests 24GB+ Intel Arc B580

    Selfhosted @lemmy.world

    Guide to Self Hosting LLMs Faster/Better than Ollama

    Free Open-Source Artificial Intelligence @lemmy.world

    Qwen2.5: A Party of Foundation Models!

    LocalLLaMA @sh.itjust.works

    Qwen2.5: A Party of Foundation Models!

    Ask Lemmy @lemmy.world

    How does Lemmy feel about "open source" machine learning, akin to the Fediverse vs Social Media?

    AI @lemmy.ml

    Cohere Drops Command-R 35B 08-2024 Update, Just About a Perfect Local LLM for 24GB GPUs.

    Free Open-Source Artificial Intelligence @lemmy.world

    Cohere Drops Command-R 35B 08-2024 Update, Just About a Perfect Local LLM for 24GB GPUs.

    World News @lemmy.world

    Pressure grows as "last chance" negotiations for Gaza deal resume

    News @lemmy.world

    Hostage-ceasefire deal talks stall over new Netanyahu demands, Israeli officials say

    Technology @lemmy.world

    Alleged AMD Strix Halo APU Appears in Benchmark

    Star Trek @lemmy.world

    Paramount Acquisition Deal Falls Through

    Avatar: The Last Airbender @lemmy.world

    Paramount Acquisition Deal Falls Through

    Avatar: The Last Airbender @lemmy.world

    Paramount Sony Deal Not Looking Like A Bid For Whole Company Anymore

    Avatar: The Last Airbender @lemmy.world

    Paramount (Avatar IP owner) sale reopens, as Sony-Apollo swoops in

    Avatar: The Last Airbender @lemmy.world

    How do y'all watch Avatar? What screen? What source?