Spyke

who says that about any search engine? can you trust them? searXNG is usually run by random people who are less likely to use your data than a larger search company

7

At least with Google it wont be an individual that can open my data (most likely).
Probably only the AI or whatever can actually read any of it directly.

-5

If you're using a shared IP, it doesn't matter.

You are using a VPN or Tor, right?!?

-5
jol
discuss.tchncs.de

I still don't understand how Searx is able to operate for free. Don't the API calls cost money?

18

From what I've read, I believe it's a combination of donations. sponsors, volunteer hosting from like minded organizations.

19
N.E.P.T.Rreply
lemmy.blahaj.zone

If I had to guess, they probably don't use the APIs, inside using scrapping of some sort.

9

My understanding is it scrapes what it can't meaningfully get out of an API. Public instances run into rate limiting, but private instances don't really have that problem.

1
lemmy.world

For anyone wondering xn--gckvb8fzb.com is マリウス.com

Also: Maybe they should get a "normal" domain when you post english articles...

12
mesareply
piefed.social

Does the url not resolve on certain browsers or something? I usually just copy/paste or use a firefox plugin to generate posts for lemmy/piefed/fediverse.

1
carrylexreply
lemmy.world

It resolves well but punnycode is disabled in some browsers or security enhanced profiles, so that you can easier detect punnycode domains that try to fake other domains.

6
lemmy.ml

The search engines that searxng interact with still track you. For this reason I will always use a public instance to mix up the tracking with everyone else using it.

7
pineapplereply
lemmy.ml

Using a public instance is more private than using a private selfhosted instance.

3
lemmy.world

..a public Lemmy instance? How is that related to the the search engine?

-2

Is metasearch really the best we can do? What about YaCy, or something else more like that?

7
sopuli.xyz

Or how about YaCy. It's self-hostable & you can have your own web index and start your own web-crawler.

It's peer-to-peer too

7
motruckreply
lemmy.zip

This is exactly what I came here to find. Thank you for posting it. If I can be so bold selfhosters should really be leaning this way searxng is great but it still uses big tech.

The other thing we need is a way to identify good crawling agents or *smol agents over corporate bots that just steal content.

If selfhosters can unite and build a good index perhaps searching can go back to the way it was vs a vector to sell you more and collect your data.

3

You know what else I like ? Fossil

It's a FOSS alternative to Git itself, their official site itself is a self-hosted instance of Fossil.

1
lemmy.ml

I used to self-host searxng for a while, but somehow the search results were always off and mixed with to much non-relevant results :/.

It's not about searxng itself... Rather how the most relevant info gets drown into AI slope and non-sense bullshit. The best blogposts/info are transmitted from people to people...

I'm kinda sad to admit that stupid AI "solved" this issue and had better results :/

5
lemmy.world

I used to self-host searxng for a while, but somehow the search results were always off and mixed with to much non-relevant results :/.

I mean, getting non-relevant results happens with every search engine anymore.

The days of your search results being relevant, and what you want on the first page, are long dead thanks to SEO and other factors.

3
N0x0nreply
lemmy.ml

Yeah you're right ! However, ages ago, I still remember how you could go to page 20+ and still find some really interesting things !

Here, past page 2 it's just some random shit...

2
lemmy.world

Most of its just AI generated websites. Search for any topic and you're likely to get 50 AI generated website that give a similar bulletpoint presentation of what search item X is according to the AI that generated the site.

2

50 AI generated website that give a similar bulletpoint presentation of what search item X is according to the AI that generated the site.

Yeah that's what I meant by "random" shit ! 😁

1
sunstonedreply
lemmus.org

You can self host that too ;)

OpenWebUI + Ollama + SearxNG. OpenWebUI can do llm web search using the engine of your choice (even self hosted SearxNG!). From there it's easy to set the default prompt to always give you the top (10, 20, whatever) raw results so you're not confined to ai results. It's not quite duck.ai slick but I think I can get there with some more tinkering.

2
dubyakayreply
lemmy.ca

Is there a guide on how to do this on Linux + 16GB Radeon?

3

I mean, I could write one! I kind of just pieced it together from guides on the three individuals

Edit: back of the napkin guide below is basically in the OpenWebUI docs already! I use NixOS (btw) but docker/podman should work well.

OpenWebUI + Ollama setup -- tl;dr docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main

OpenWebUI SearXNG guide -- a little more involved, but not difficult.

7

Ohoho? That's interesting. I don't have the horse power to selfhost an AI, but that's good to know !

Thanks for the pointer !!!

1
lemmy.ca

Thanks for posting, both a great reminder to try setting this up on my unraid, and also to add the RSS feed of that site to Feeder.

4
Be Your Own Privacy-Respecting Google, Bing & Brave | Spyke