I finally got TruNas running an LLM on my AMD GPU!!!
And I'm making everyone go to my gotosocial post because the server is running, so I'm going to use it!
https://gotosocial.michaeldileo.org/@mdileo/statuses/01JQA4M4Q33PMCADH9M2AWQSS8Open linkView original on lemm.ee
You missed an e
Because it doesn't feel real 😉
Edit: i thought you referred to TrueNas. I'm tired
I think you are still missing an e in the title.
Cool project though
Congrats!!
Thank you! This took so long to figure out
I bet! That's a lot of technical info to sort through, understand and create.
Congrats! I just got a similar running on Arch with a 5700 XT. When I looked at it a couple years ago, it wasn't really possible. Now, smooth sailing.
That's so cool!!