Spyke

Replies

Comment on

Do you host your own AI?

Reply in thread

Curious about the quant tho.

Q8 from unsloth.

Something like Qwen3.5-122b

My go to model for knowledge. Definitely much faster at Q5 but it lacks the tool calling quality of the Qwen3.6 models. Really hoping we see a Qwen3.6-122b soon...

Comment on

Do you host your own AI?

Yes, I got a Strix Halo machine before the RAM price hike and use it to run all my ML stuff on it.

Currently using llama-swap with llama.cpp/ComfyUI and opencode/Open WebUI as frontend.

I'm running Qwen3.6-27b, Voxtral Mini 4b, Piper and Qwen Image. Also, some embedding and reranking models.

I use them for:

  • Tagging and classification of my documents in Paperless
  • Home Assistant (voice assistant)
  • Translations (both text and image)
  • Transcriptions
  • Some light coding and debugging
  • Avatar/Backdrop generation for DnD sessions

Comment on

We don't talk about IPv5

My favorite thing to use IPv6 for is to use the privacy extension to get around IP blocks on YouTube when using alternative front ends. Blocked by Google on my laptop? No problem, let me just get another one of my 4,722,366,482,869,645,213,696 IP addresses.

I have a separate subnet which is IPv6 only and rotates through IP addresses every hour or so just for Indivious, Freetube and PipePipe.

Comment on

*Permanently Deleted*

Reply in thread

Besides what was mentioned below, it's not about making competitive products but about Nvidia being an absolute asshole since the 2000s and they got even worse ever since the crypto and AI craze started. AMD and Nvidia are both corporations but they are not even playing the same game when it comes to being anti-competitive.

There's a reason why Wikipedia has a controversies section on Nvidia: https://en.m.wikipedia.org/wiki/Nvidia#Controversies

That list is far from exhaustive. There's so much more about Nvidia that you should remember vividly if you were a PC gamer in the 2000s and 2010s with an AMD GPU, like:

  • When they pushed developers to use an unecessary amount of tesselation because they knew tesselation performed worse on AMD
  • When they pushed their Gameworks framework which heavily gimped AMD GPUs
  • When they pushed their PhysX framework which automatically offloaded to CPU on AMD GPUs
  • When they disabled their GPUs in their driver when they detected an AMD GPU is also present in the system
  • When they were cheating in benchmarks by adding optimizations specific to those benchmarks
  • When they shipped an incomplete Vulkan implementation but claimed they are compliant

Nvidia has been gimping gaming performance and visuals since forever for both AMD GPUs and even their own customers and we haven't even gotten to DLSS and raytracing yet.

I refuse to buy anything Nvidia until they stop abusing their market position at every chance they get.