Helmaar @ Helmaar @lemmy.world Posts 0Comments 2Joined 3 wk. ago
Helmaar @ Helmaar @lemmy.world
Posts
0
Comments
2
Joined
3 wk. ago
I was able to run a distilled version of DeepSeek on Linux. I ran it inside a PODMAN container with ROCM support (I have an AMD GPU). It wasn't super fast but for a locally deployed and self hosted option the performance was okay. Apart from that I have deployed Fooocus for image generation in a similar manner. Currently, I am working on deploying Stable Diffusion with either ComfyUI or Automatic1111 inside a PODMAN container with ROCM support.
Gotta Cash 'Em All.