Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on sh.itjust.works
asklemmy·AsklemmybyAquila

Is it possible to de-duplicate lemmy posts from other instances?

It’s annoying seeing the same headlines numerous times linking to same stuff because it’s cross posted to 3+ instances.

Is there a setting to reduce that or app that handles that well?

View original on sh.itjust.works
69

14 replies

sopuli.xyz

The default webUI de-duplicates cross-posts. I don't know if any apps do.

26
sbvreply
sh.itjust.works

They have to be actual cross posts though, don't they? Would that catch the same link spammed across multiple instances and communities?

13
MentalEdgereply
sopuli.xyz

There are no "actual" cross posts. Cross-posts on Lemmy are just all posts that have the exact same URL in the URL field.

9
MentalEdgereply
sopuli.xyz

Not a cross post. It just creates a post that links to the first post.

If you made a third post that also linked to the first post using the same url as the second post, that would be detected and get linked up as a cross-post to the second post.

Actual cross-posts work in both directions. Lemmy detects them as the same thing, both posts link to the other.

Not in the post body, the post body quote and "cross-posted from" text is completely meaningless and just gets added by most clients, adding it doesn't make something a cross-post, and removing it doesn't break the actual cross-post feature, which shows up as a little "cross-posted to: list of communities" thing on the post page.

Thunder has it, Photon does it, and the default webUI does it.

2

No, the posts are separate. But each post will list every other post so you can visit the other comment sections.

1
Andrewreply
piefed.social

Yeah - I think anything the UI is doing, it's getting the info from the API, so the poster would've had to use the 'cross-post' feature. There are some apps (e.g. Voyager) that try to wrangle cross-posts by title or URL, but title-matching can give false postives, and URL-matching usually assumes that one link hasn't picked up some cruft, and it can't do much for uploaded images if the poster didn't cross-post (because it'll be 2 different files with different URLs)

4
MentalEdgereply
sopuli.xyz

Different people posting the same URL get their posts linked up as cross posts.

The cross post button just copies the post text into a new post. It doesn't do anything special.

5

Oh, right. Sorry. I've gone back and checked the post I was thinking of when I made that comment, and - yeah - it turns out I was misremembering / didn't properly investigate the first time.

2
Aquilareply
sh.itjust.works

News to me! Good to know. Will have to see how that’s handled and maybe make pr to my favorite apps

7

If you find any with it let me know. Not hopeful for Sync.

2

I just block the users who do it. Requires a few seconds and then I don't worry about it again.

1

You reached the end

Is it possible to de-duplicate lemmy posts from other instances? | Spyke