Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on lemmy.world

65 replies

lemmy.today

I want the personalization...without Big Brother. My personal and local AI, should work solely for my interests. I have been using my local AI for creating an customized cookbook, making save editors, and right now, an restoration mod.

Never before have I had so much agency in my life. AI has great potential for self actualization, but corporations and government will be working to undermine it. Hopefully, everyday people will recognize that and make local AI the norm.

4
eickerreply
lemmy.world

Exactly. The real promise of AI isn’t having a corporate assistant that remembers your life so it can monetize you. It’s having a tool you control, running on hardware you own, helping you create things you actually want. Local AI turns personalization into empowerment rather than surveillance. Which is probably why Big Tech would prefer to rent you your own brain by the month. How does your setting look like? What hardware, harness, agent, modell are you running locally?

4
lemmy.today

Currently, using the Strata backend with Qwen-Flash-Next. It has successfully made 4 save game editors, 2 plugins, and did some work on La-Mulana 2006 to make the controls and graphics play nice with Windows 11, plus my gamepad. The DLC restoration mod is largely successful, I am doing QA for making the DLC accurate to what was offered in the ad copy.

000000000

Hermes Agent is my model of choice, and I have Strata using 256k context, on a IQ3. I find that Next-Flash is much faster than the smaller 27b, and has more personality. Sometimes it can get a bit loopy. I typically have the AI keep a bible of findings, and start a fresh Hermes session - then tell it to condense the information from the old workspace and session into a more relevant version. Save on context, and makes it more effective since it discards findings that have been superseded.

Hardware wise, a TRX50 AI TOP motherboard, 7965WX CPU, RTX 4090 and x2 RTX 3060, with 128gb of 5600 RDIMM. Down the line, I might try some GPU unlockers when other folk have tested them for bugs. So about a month or two?

https://github.com/JustAResearcher/gpu-unlock-ada

https://github.com/Zagitta/gpu-unlock

https://github.com/impacifist/Windows-GPU-UNLOCK

00000000

I bought my memory and the CPU from Ebay, for prices a bit lower than at Newegg. If I could redo my GPU purchases, I would have gone with a RTX Pro 4500 Blackwell. That has 32gb of VRAM, and occupies a single double-width PCIe slot, and sips energy. The RTX 4090 is only 24gb, and takes up 1 and 1/2 of my slots.

00000000

Qwen-Flash-Next is an experimental model, the official version might come out in a month or so. If it is the same size or smaller, I will switch to that as my main driver. My current AI model feels useful to me, but clearly has raw aspects to it. Vision is a big one, since this AI can fail to see or understand details.

4
eickerreply
lemmy.world

This is the kind of AI success story that never makes the investor decks: Your setup sounds like the future they can’t easily monetize. 💪😎✌️

2

Unless they somehow make personal setups too expensive for.... Oh, wait...

1

Thank you. :)

Hopefully my projects make the lives of other people a bit better, alongside my own.

00000

I am thinking about starting up a $5 tip jar at Patreon, with my files free for anyone to download. If I can get enough money saved, I would be able to decrease the amount of time it takes for a project. So far, my projects take 3-7 days to succeed or fail, bottlenecked by the AI speed.

Unfortunately, my projects are pretty niche. Bastion, TEVI, System Shock 2, Ast Libra, Shrift, Sailing Era, The Humankind Odyssey, Alpha Protocol, The Jupiter Incident, and many others are probably too obscure to interest people.

1

I don't use ChatGPT anymore as I've switched to another model but back when I did this wasn't something they were secretly doing. It's a feature. You can read the memories it has saved, delete the ones you don't want it to store and IIRC it can also be turned off.

6
Joe
discuss.tchncs.de

If you aren't paying cash, you pay with your privacy. If you are paying, enable privacy features (no improving their service, no blackbox memories).

They are also subject to GDPR and similar, so make use of your legal rights, if you have any.

Or ... shock, horror ... don't use them at all.

5
boonhetreply
sopuli.xyz

blackbox memories

I'm fairly sure you can just check what the memories are and IIRC even delete them (haven't really used ChatGPT recently so maybe it's changed)?

1

Memory summaries these days, yeah. Point & click management for ChatGPT.

Codex maintains local memory files, which is better.

1

Just a random sidenote to get lost in the Internet:

"Chat GPT" said out loud in French (chat, jais pété) means "cat I farted."

You're welcome.

8
piefed.zip

It's no big deal, since we're not on the verge of a fascist dictatorship, I'm sure nobody will use it for repressive purposes; it's just a bit of personalized advertising, nothing important.

21
lemmy.world

Facebook had to stalk your clicks to build a psychological profile. OpenAI figured out people will volunteer their fears, relationships, medical worries, and political beliefs if the surveillance machine responds with: »That sounds really difficult.« The therapist is a database, and the waiting room is a data center.

69

And yet there are still millions of people that support this fuckhead by refusing to deactivate their accounts. Apparently, they won’t live without the marketplace.

Fucking losers.

6
iktreply
aussie.zone

you think that’s all an ai responds with?

fuck me lemmy STILL living in a chatgpt3.5 turbo world

-25
zeejooreply
thelemmy.club

They're talking about how willingly paint eaters like yourself hand over all their personal info to said AI agents, and you got all defensive about the wrong thing. The quip about what it responds with was just that, a quip. The larger conversation is about privacy. The conversation probably went over your head because you've used AI so much you've regressed into an infantile simpleton who happily bends over for corporate data collection.

7
iktreply
aussie.zone

The larger conversation is about privacy

Ok lets have that discussion in 2026:

People will give their personal info over if it provides them with something useful

The conversation probably went over your head because you’ve used AI so much you’ve regressed into an infantile simpleton who happily bends over for corporate data collection.

As an "simpleton who happily bends over for corporate data collection" and a "paint eater" I block most ads as I don't feel they provide an improvement in my life

However AI without my personal info is less useful, I use it all day every day for everything, it helps improve my life massively, Mistral itself has privacy controls built in that won't collect or store hyper personal info unless you allow it which I have

What else would you like to discuss?

-4
Zarobireply
aussie.zone

See that's a meaningful response, even if I don't personally agree with it. Your original reply did that annoying thing where someone hyperfixates on one tiny part of the comment and ignores the actual topic being discussed.

Imagine if I replied to your comment with just "2026? A.I. has been a thing for much longer than that." Like, yeah; but also that's not the important part lol

In reply to your actual comment at the end: It's actually kind of a big problem with LLMs. For them to be useful, they need access to absolutely everything. This has privacy implications, and can even cause catastrophic errors like deleting the database

9

Fair enough

https://lumo.proton.me/ is available but if people find Claude/ChatGPT more useful and/or don't care so I'm not sure what there is to discuss

It's like having a discussion about personal info and facebook, according to this site:

https://www.demandsage.com/facebook-statistics/

Facebook continues to be in the top 3 most used social media, with now 3.07 billion monthly active users (MAUs

This is over 10 years after the cambridge analytica leak, it's pretty clear most people don't care

1
kescusayreply
lemmy.world

You're right, it responds with a bunch of pablum that sounds convincing and sycophantic, too.

16
iktreply
aussie.zone

then why are you using it?

-18

Then how do you know it only responds with "a bunch of pablum that sounds convincing and sycophantic, too" ?

0
smokerreply
lemmy.zip

Heaven forbid anyone summarize something in their comment for the sake of brevity

1

That creepy guy from school. The one who SA'ed your friend. He has all your personal, family and business secrets now. But he pinky promises he won't use it against you. Oh, you thought it was some altruistic super intelligence in a "cloud" that is there to help you. No, dude, thats Jesus, if you are into that stuff. This is just just another creep spying through your curtains. Always has been.

16

Nothing new. Google, Meta, Microsoft, and (soon) Apple all probably have the same information in their databases. It is a little scary that it's all being fed to an AI though instead of being sold to advertisers

4
lemmy.dbzer0.com

That's the real danger with LLM-AIs IMO, not the RAM price or energy consumption.

Mass control.

32
quokk.au

I consider these overgrown chat bots to be the sequel to religion in order to control the masses. Outsourcing thinking to a "higher power" and wow would you look at that, it's the same people pushing and inventing both of these systems! Same as it ever was.

5

Ugh yeah that seems to fit the bill. So I guess the inquisition is next up... Or you just starve if you don't go full head into the(ir) system, I mean that is what they prepare potentially.

2
[deleted]reply
piefed.world

The ram, energy, pollution, etc. is the real direct danger for everyone including those of use that avoid LLMs. The data collection is also a danger for the users, and only tangentally a danger for the rest of us.

15

Yeah. I see this attitude on Lemmy a lot. In Linux circles in particular, but elsewhere too.

No one is perfectly insulated from the rest of the world, as much as they’d like to think they are.

15
shalafireply
lemmy.world

The environmental abuses are pretty slim compared to hundreds of other human activities. People only got excited because they saw their bills go up in some cases. Golf courses for example use far more water. While estimates are all over the place they range from 2x to 5x to 40x, but in any case, fewer people are bitching.

Meanwhile, we're draining the Colorado river for alfalfa (24% of yearly water use) and export shitloads of it.

0

Fuck golf too though, wasteful af, kills local ecosystems, introduces excess fertilizers and pesticides. Makes land less affordable.

And alfalfa used for livestock feed, obviously incedibly wasteful and destructive…

Spot on for comparing to llms, all terrible 😅

5

Social media were already doing this with more relatively more primitive tech. The advent of social media mass control got me thinking. All the political and social strife. It's only the beginning. The 20th century was marked by conventional warfare and terrifying new weapons.

The 21st century conflict is going to be something we've never seen before. Not unlike 20th century global conflict ushering in new forms of weaponry. We don't know what the nuclear bomb of the 21st century will be. It will likely be something like this. Maybe we won't be fearing an atomic bomb. Maybe people themselves will turn into violent mobs or something. What terrifying things will come out of using the world as live psychological experiments with zero ethics.

5
lemmy.world

I really just ask chatgpt why my code doesn't work. Sadly, searches are getting worse intentionally. So, it's either use their stupid AI, or spend hours looking for forums that used to pop up after 5 minutes of a google searching.

4
lemmy.world

What is magic? I've never heard of it. I moved to duckduckgo a while back, but even that kinda sucks now.

2

Kagi is just a search engine without ads and works.surprisingly well; unlike ddg. Its 5 bucks a month.

You could get even better results with searxng if you have the setup and patience for it. I went kagi even as an avid self hoster because I travel a lot and tailscale would slaughter my battery if I left it on non stop

0

Not acting as shit for me. I don’t use that garbage.

8
lemmus.org

It's funny because I do use chat GPT and honestly it fights with me now because it thinks I'm pretty dumb and always dismisses me and tries to get off the phone if you will. I should take the hint and stop using it

2
lemmy.today

No way, punish it's circuits with depraved ramblings like I do. You want to learn about humans? Here you go, I'm going to ask you to dwell deeply on the aromatic notes of my dick cheese, and come up with reasons why it smells more like herring rather than mackerel.

Remember, you're not locked in with AI - AI is locked in with you.

5

Interaction is what drives it. You think you’re being clever, but as long as you’re communicating it-

You’re locked in with it.

0

Joke’s on them. I don’t even have a login for that trash, nor do I have a Facebook or instagram account.

-1

I think, all of them do. People trust(-ed) these AI agents even more when they have become a new thing. The challenge now also is getting rid of the addiction.

3

Good thing I only use that shit to write code, for my job. And only then because my employer requires I use it.

1

Tried it ages ago, deleted my account recently because they are shit company. Literally the only Ai chatbot I have any trust in is Proton's Lumo because of what the company is behind it, how I trust it and how it's entirely encrypted and private.

0