[HN] Ask HN: Who is using small OS LLMs in production?

1 crossposts

TechTakes @awful.systems self @awful.systems 1 yr. ago

my chatbot is so efficient it only needs one $2000 GPU per user

news.ycombinator.com /item