An LLM on a Stick
An LLM on a Stick
www.hackster.io An LLM on a Stick
Binh Pham built an LLM into a USB stick powered by a Raspberry Pi Zero and gave it a user interface that is incredibly easy to use.
You're viewing a single thread.
3 comments
-
Because you can doesn't mean you should. With so little power is like having Fernando Alfonso riding a donkey.
-
Alonso riding a donkey can finish a race, I doubt this LLM is usable other than for extremely basic prompts.
-
It won't be usable at all. Alonso wouldn't finish the race, by the time he reaches the goal there would be no race at all.
-
-