Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)BR
Posts
35
Comments
2,861
Joined
1 yr. ago

  • In the future, when we're transcendent tentacled robofurries doing poly in virtual space, on drugs (think Yivo from Futurama), we will look back in confusion at why so many people hate homosexuality so much. Like... don't they have other things to worry about?

    Or humanity will be all dead, I guess.

    And I'm talking about the mega conservatives protesting this; at least the Vatican is baby stepping and trying to minimize their cruelty.

  • Been trying to play with this in ik_llama.cpp, and it's a temperamental model. It feels deep fried, like it wants to be smart if it would just stop looping or getting its own think template wrong.

    It works great in 24GB VRAM though. I'm getting like 16 tok/sec at longish context, with 15 experts on the GPU and the rest offloaded.

  • I have the feeling that as soon as it ends up offloading some of the model into system ram is going to slow down to a crawl.

    Then don't offload! Since its 3000 series, you can run an exl3 with a really tight quant.

    For instance, Mistral 24B will fit in 12GB with no offloading at 3bpw, somewhere in the quality ballpark of an Q4 GGUF: https://cdn-uploads.huggingface.co/production/uploads/6383dc174c48969dcf1b4fce/tfIK6GfNdH1830vwfX6o7.png

    It's especially good for long context, since exllama's KV cache quantization is so good.

    You can still use kobold.cpp, but you'll have to host it via an external endpoint like TabbyAPI. Or you can use croco.cpp (a fork of kobold.cpp) with your own ik_llama.cpp trellis-quantized GGUF (though you'll have to make that yourself since they aren't common... it's complicated, heh).

    Point being that simply having an ampere (3000 series RTX) card can increase efficiency massively over a baseline GGUF.

  • Coffee Stain's another good example on the bigger end.

    It does seem like there's a danger zone behind a certain size threshold. It makes me worry for Warhorse (the KCD2 dev), which plans to expand beyond 250.

  • Funny thing is Teslas already have something more sophisticated. They could pipe the FSD's diagnostics to a HUD as a more polished, standard 'overlay' for the driver, literally run with the car's own hardware. You'd think Tesla execs would know about that since it's literally their business, and predates the LLM craze.

    ...But no.

  • This is so stupid.

    To me, "AI" in a car would be like highlighting pedestrians in a HUD, or alerting you if an unknown person messes with the car, or maybe adjusting mood lighting based on context. Or safety features.

    ...Not a chatbot.

    I'm more "pro" (locally hostable, task specific) machine learning than like 99% of Lemmy, but I find the corporate obsession with cloud instruct textbots bizarre. It would be like every food corp living and breathing succulents. Cacti are neat, but they don't need to be strapped to every chip bag, every takeout, every pack of forks.

  • I feel like there’s a “bell curve” for Linux gaming enjoyment.

    If you’re even a little techy, like not using your PC begrudgingly and mostly live in iOS or whatever, the switch will feel like a relief. But many PC users aren’t; they arent interested in what a OS or file system is, they just want League or Sims to pop up and that’s it.

    …And then there’s me. I use Linux for hours every day, I’m pretty familiar with the graphics stacks and such… But I need the performance of stripped, neutered Windows I dual boot for weird, modded sim games I sometimes play. And frankly, it’s more convenient for many titles I need to get up and running quick for coop or whatever. There’s also tools like SpecialK that don’t work on Linux, and help immensely with certain games/displays.

  • Not everyone's a big kb/mouse fan. My sister refuses to use one on the HTPC.

    Hence I think that was its non-insignificant niche; couch usage. Portable keyboards are really awkward and clunky on laps, and the steam controller is way better and more ergonomic than an integrated trackpad.

    Personally I think it was a smart business decision, because of this:

    It doesnt have 2 joysticks so I just buy an Xbox one instead.

    No one's going to buy a steam-branded Xbox controller, but making it different does. And I think what killed it is that it wasn't plug-and-play enough, eg it didn't work out of the box with many games.

  • With respect, this doesn't make any sense. If you want a joystick controller, just buy an Xbox controller that everything's compatible with anyway?

    The trackpads shine when one needs to emulate a mouse/kb in non-controller games; a nightmare with joysticks.

  • My sister still has a working one that she treats like a religious artifact, as it's the best way to play mouse/KB games from the sofa.

    I see why they discontinued them though. They need custom configs for most games, and I think most people don't like that much tweaking.

  • The laptop APUs were better than Intel, with lower power, and far better graphics!

    It got even more dramatic in the 4000 series. Renior is one of the best chips AMD ever made.

    TBH the press just had a hard time comprehending it back then, and it was lest dramatic on desktop (or tanky desktop-sized laptops with dGPUs) because Intel's chips could clock higher for single-threaded workloads (at the expense of mad power usage).

  • Hmm, an aging population and the job/company market are going to exacerbate this even more. How do we fix it:

    • Democrats: Let’s keep doing exactly what we’ve been doing since the 60s! With leaders from the 60s! Strangles Madami in the corner.
    • Republicans: Let’s cut immigration (the only thing making our population skew young), make healthcare even more private, tax/inflame all our manufacturing suppliers, and make life even more miserable for child bearing women! Oh, and blow up the national debt so none of this can be fixed later. Now buy our crypto, YOLO!

    What about, like, enticing immigrants to balloon manufacturing with education grants and entrepreneur seeding, and, you know, making it not a nightmare to be naturalize, leveraging a huge advantage countries like China don’t have… Or tax the snot out of the rich and tighten government spending, modernize the military to cheaper drone based warfare, regulate healthcare to be less for-profit, all over reasonable timeframes?

    …Nah. Let’s specifically not do that.

  • Leopards Ate My Face @lemmy.world

    MTG accuses Trump of "bait and switch" over Iran strikes

    politics @lemmy.world

    Trump floats regime change in Iran

    World News @lemmy.world

    Israel bombs Iranian state TV during live broadcast

    United States | News & Politics @lemmy.ml

    Scoop: Four reasons Musk attacked Trump's "big beautiful bill"

    World News @lemmy.world

    Israel plans to occupy and flatten all of Gaza if no deal by Trump's trip

    LocalLLaMA @sh.itjust.works

    Qwen3 "Leaked"

    LocalLLaMA @sh.itjust.works

    Niche Model of the Day: Nemotron 49B 3bpw exl3

    Ukraine @sopuli.xyz

    Trump threatens Putin with new sanctions after meeting with Zelensky

    Ukraine @sopuli.xyz

    Trump's "final offer" for peace requires Ukraine to accept Russian occupation

    LocalLLaMA @sh.itjust.works

    Niche Model of the Day: Openbuddy 25.2q, QwQ 32B with Quantization Aware Training

    Ask Lemmy @lemmy.world

    How do y'all post clips/animations on Lemmy? Only GIF seems to work.

    politics @lemmy.world

    Trump 2.0 initial approval ratings higher than in first term

    politics @lemmy.world

    Behind the Curtain: Meta's make-up-with-MAGA map

    Enough Musk Spam @lemmy.world

    Elon Musk's headline dominance squeezes other CEOs

    politics @lemmy.world

    Trump sides with Musk in H-1B fight

    politics @lemmy.world

    Elon Musk pledges "war" over H-1B visa program, calls opponents racists

    politics @lemmy.world

    Musk calls MAGA element "contemptible fools" as virtual civil war brews

    Leopards Ate My Face @lemmy.world

    MAGA vs. Musk: Right-wing critics allege censorship, loss of X badges

    Avatar: The Last Airbender @lemmy.world

    Brainstorming Post LoK/Avatar Seven Havens Story Ideas

    Avatar: The Last Airbender @lemmy.world

    'Avatar: Seven Havens' Rumors Emerge