Comment on
What are some physics-based arguments against hard determinism?
Reply in thread
Do you have a degree in theoretical physics, or do you theoretical have a degree. ;)
Comment on
What are some physics-based arguments against hard determinism?
Reply in thread
Do you have a degree in theoretical physics, or do you theoretical have a degree. ;)
Comment on
Twitter bug causes self-DDOS tied to Elon Musk's emergency blocks and rate limits: "It's amateur hour"
Oops! :P
Comment on
What have you been up to recently with your local LLMs?
I used it quite a lot at the start of the year, for software architecture and development. But the number of areas where it was useful were so small, and running it locally is quite slow. (which I do for privacy reasons)
I noticed that much of what was generated needed to be double checked, and were sometimes just wrong, so I've basically stopped using it.
Now I'm hopeful for better code generation models, and will spend the fall building a framework around a local model. See if the helps in guiding the models generation.
Comment on
Faster hardware is a bad first solution to slow software
Hmm. I'd actually argue it's a good solution in some cases. We run multiple services where load is intermittent, services are short-lived, or the code is complex and hard to refactor. Just adding hardware resources can be a much cheaper solution than optimizing code.
Comment on
What have you been up to recently with your local LLMs?
Reply in thread
I learned the hard way to never generate anything I couldn't create myself, of at least verify its validity.
Comment on
What have you been up to recently with your local LLMs?
Reply in thread
Yeah, me too. After summer vacation it's hopefully available and I'll dig into it.
Comment on
What OS do you use on your pc and why?
Reply in thread
I've been running debian stable for work laptop, gaming PC and servers for years now. Can confirm it just works!
Debian 12 upgrade coming up soon. Probably (maybe not) some effort to upgrade everything, and that back to smooth sailing. :)
Comment on
llama.cpp for GPU only
Reply in thread
Haven't been able to test that out, but saw the change. Particularly interesting for my use case.
Comment on
llama.cpp for GPU only
Reply in thread
I've looked at that before. Do you use it with any UI?