Comment on
Sovcit needs some help.
Reply in thread
actually, that usage makes sense if you realize that you're licensing the roads, not the car.
Comment on
Sovcit needs some help.
Reply in thread
actually, that usage makes sense if you realize that you're licensing the roads, not the car.
Comment on
Getting Started with Self Hosted LLM
There's also llamafile, super simple: download and run it.
Comment on
Sovcit needs some help.
Reply in thread
Oh I'm not defending the Sovcit in the slightest. I'm just pointing out that the license still works in the same way as a software license, but the license is for the roads.
Comment on
Getting Started with Self Hosted LLM
Reply in thread
Iirc it can run anything llama.cpp can because it just uses that under the hood.
Comment on
Getting Started with Self Hosted LLM
Reply in thread
Ok. I haven't tried it so I'll take your word for it. I'm just offering an easier alternative since the topic was "getting started"
Comment on
Markdown tests
Markdown is not respected in post preview (can't attach an image apparently, but many posts on news communities will have a quote)
Comment on
Markdown tests
Comment on
[Resource] Llama3 70B Successfully Deployed on a Single 4GB GPU
Reply in thread
No, they just mention that only Apple silicon is supported if you're using MacOS
Comment on
Your Phone is an Entire Computer
Reply in thread
Sequoia? I felt like that was a nice improvement, do you mean Tahoe with its awful liquid ass design?