When I first got into local LLMs nearly 3 years ago, in mid 2023, the frontier closed models were ofcourse impressively capable.

I then tried my hand on running 7b size local models, primarily one called Zephyr-7b (what happened to these models?? Dolphin anyone??), on my gaming PC with 8GB AMD RX580 GPU. Fair to say it was just a curiosity exercise (in terms of model performance).

Fast forward to this month, I revisit local LLM. (Although I no longer have the gaming PC, cost-of-living-crisis anyone 😫 )

And, the 31b size models look very sufficient. #Qwen has taken the helm in this order. Which is still very expensive to setup locally, although within grasp.

I'm rooting for the edge-computing models now - the ~2b size models. Due to their low footprint, they are practical to run in a SBC 24/7 at home for many people.

But these edge models are the 'curiosity category' now.

I've been blogging over 4 years and the reach has Plateaued.

I'm wondering if there is any service that helps reach/discoverability (like medium platform) while I stick to my own hosting?

Thanks!

Maybe I've been mind controlled, but I'm used to the algorithmic feed of youtube and reddit. The default simple reverse chronological method of mastodon is hard to use for me.

I'm not interested in reading each and every post, but prefer the most sensational ones upfront..

I've tried googling but couldn't find much apart from a third party website I had to put my login creds into..

Do you guys have a better solution for this?

cross-posted from: https://lemmy.ml/post/44422946

Just curious if any people make steady income from a side devblog? I know there are dedicated youtubers, but I'm not into that..

I've been blogging over 4 years but the reach is still poor, just wanna rethink my strategy..

Thanks!

Just curious if any people make steady income from a side devblog? I know there are dedicated youtubers, but I'm not into that..

I've been blogging over 4 years but the reach is still poor, just wanna rethink my strategy..

Thanks!

HI

I'm looking to write a programming guide for general line cortex-M0 TI MSPM0G1106.. For C, covering the main peripherals, SPI, DMA etc..

Using the sphinx book structure.

I'm choosing to write this because, though there are good beginner books for STM32, there's none for TI..

I'm semi experienced in the field.

But I've written article series on other microcontrollers in the past in my blog. Anyone willing to critique them?

Many thanks :)

Here's a risc-v one: https://simplycreate.online/tags/ch592

I'm a long time reddit user.. I should say I'm quite hooked. But lemmy feels a lot quiet. My primary interests are electronics, embedded programming, piracy 😏 and selfhosting. Apart from the last community the others are quite deserted.

I'v been on and off since past 1 1/2 years. No change..

On the other hand Mastodon is going well. And I nurture the interactions there. Lemmy could be the same. I too feel Reddit is kinda on-to-your face and aggressive.

Hi all! I'm a firmware developer with little knowledge in analog electronics.. I deal with firmware for IOT projects all the time.

I had to make a breakout board with an off the shelf RF module with self contained PCB antenna. Now I'm intrigued in the hardware side. I'm inclined to design them from scratch myself. (Obviously ignoring the EMI and FCC certifications for the time being).

What concepts should I be familiar with to achieve this? Starting on I figured to brush up on circuit theory and signals. Where do I go from here? What materials would you recommend? Hopefully I don't need to get into hardcore RF theory to design these PCBs (I know kicad already has these premade antenna blocks).

Thank you.

Hi, I have a home server (basically a NAS) currently running Debian. Basically it's configuration is as follows

• debian host running 3 VMs

• debian running inside each VM as docker host

I just manually install KVM on the host then docker on each VM after creating each of them. I documented the process so I know how to replicate it in case I need to rebuild.

I now dream of being able to automate the rebuild process using config files. I know this is done using Ansible.

But I've now heard of Talos.. (A thin layer for kubernetes) and intrigued. But I suppose I need a setup for the VM host to achieve automation through config files..

What setup are you guys using?

Thank you.

Thanks for all your suggestions! I've chosen to go with just bash scripting (given my simple setup) and keep the setup as it is.. Just gotta learn bash and virsh :)

So I've just found out about Lemmy. (Although I'm a big FOSS enthusiast)

Choose this app for my Android device, and boy nothing beats it's minimalism!

For folks that are unable to port forward on the local router (eg CGNAT) I made this post on doing it via a VPS. I've scoured the internet and didn't find a complete guide.