Spyke

Replies

Comment on

My experience with local LLM

Reply in thread

hey, thanks for your response.. yeah that's what I meant, the 2b models aren't usable in today's state, but more practical for everyday use if they work out..

I actually meant the 31b models are useful for my purpose. I don't do full-on agentic coding, just interactive chat/prompting. Example, I make good use for making linux shell scripts (as I don't know howto myself). Currently I use qwen3.5-flash via cloud. It's as good as the frontier models back then if not better..

Comment on

My experience with local LLM

Reply in thread

I didn;t try any 7b ones lately, they may be better fit for 16gb I think. I was able to try the 2b ones as I mentioned (on cpu). they are subpar. like mentioned the usable ones were 31b, I think you need atleast 24gb vram for most models though. maybe someone else can suggest better.

Comment on

Ditching the VPN and port forwarding the selfhosted way

Reply in thread

Thanks for the feed back. I started out with that post I referenced in my article, which had fewer entries. It didn't work. Caveat was although the online port checkers were reporting the port as open, it was not actually making through the tunnel!

I actually solved it by asking chatgpt!! I put in the suggestions and it worked. I'm also no expert on creating iptables, but once it was in place it seemed self explanatory.

I ran netcat as client-server to test it actually worked.