I wish more people clean URLs before sharing it to others.
I see a lot of people, including friends and family, sharing URLs rife with tracking parameters.
I feel alone in making sure that I'm sharing the cleanest possible URLs to others. For example, checking if the URLs are shortened to hide plenty of tracking params.
Just need to vent, thanks for reading.
Edit: adding some context for future references.
By using url tracking params, tech companies can track who shares the content and who clicks on that specific shared urls. A simple but effective tracking method.
Try sharing Instagram post or YouTube video from the apps.
Instagram adds 'igshid=' . YouTube adds 'si='.
If you share the same IG or YouTube content from different accounts. The 'igshid', 'si' value will be different.
This can be used to tag who shares it, and who clicks on that specific url param value.
TikTok hides a ton of such params behind shortened url. Try expanding tiktok shared urls.
If you use android, use this app to expand, analyze and clean up urls https://github.com/TrianguloY/UrlChecker
If you use Firefox (you should), install ublock origin and add this url tracking filter maintained by adguard: https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_17_TrackParam/filter.txt
Friends and family don't know what cleaning a URL means. Nobody does.
And ironic that OP doesn't share how to clean them.
Because it's different for every website.
There's a lot of common patterns, but you have to understand how URLs work. You have to recognize which URL parameters are tracking ones or even just might be tracking. And that means you have to know how they work and that takes a moment.
In brief, URL parameters start after a ? in the URL and are formatted like key1=values&key2=value2. You can't usually remove all parameters because not all are tracking. To further complicate things, URLs can also have an anchor starting with a # character which will be after the URL parameters. You often don't want to remove that (though theoretically the anchor could in fact contain tracking details).
It's often trial and error to see which parameters you can remove. I do this a lot since I write a lot of technical documentation. Clean URLs make the documentation more compact and less likely to break. It's not just tracking stuff, but sometimes you need to remove temporal data that makes a page display data from a specific time when you want it to just default to the current time (etc).
On YouTube links, delete anything after the ?
Someone post the next website
That's terrible advice, you'd just be left with
https://youtube.com/watch
You need the "?v=" and the jumble of letters immediately after.
For example: https://youtube.com/watch?v=dQw4w9WgXcQ
XcQ, link stays blue
Here is an alternative Piped link(s):
https://piped.video/watch
https://piped.video/watch?v=dQw4w9WgXcQ
Piped is a privacy-respecting open-source alternative frontend to YouTube.
I'm open-source; check me out at GitHub.
Now that is even better! That is clean! :-D
They're talking about the query param that gets added when using the Share button: https://youtu.be/dQw4w9WgXcQ?si=dwX01vG-EivlOoYe - the ?si=... should be removed.
That shit is so annoying and they just started to add it.
Here is an alternative Piped link(s):
https://piped.video/dQw4w9WgXcQ?si=dwX01vG-EivlOoYe
Piped is a privacy-respecting open-source alternative frontend to YouTube.
I'm open-source; check me out at GitHub.
I have memorized this link so I know what is rickroll without opening it.
Is it really? It reliably protects people from all the garbage content on youtube.
Wait shit you're right. I'm too used to the mobile links that have the ID after the slash
www.urlex.org
Remove everything after the question mark.
This may work for sharing links to static content, but it is terrible advice for anything interactive. That removes all URL params and will break lots of interactive sites.
What would be considered interactive vs static? How would I explain that to someone, for example?
Most things you share will be static. These are things like news articles and webcomics where the output of the page is always the same no matter what you do. Things like google searches or YouTube links that are different depending on some way you interact with the site are dynamic. If you search for “apples” in google you’ll get different results than if you search for “oranges.” If you share the apple search with someone, your apple text will be coded as a parameter after the ?. If you strip that off they’d go to google.com and not see any apples. Trackers and other surveillance tools are also captured in the query params so for dynamic content it can be tricky to know which params to remove and which to keep. For static content you can just remove them all because the content doesn’t change based on the params you pass it
Very helpful, thank you
Like a YouTube link with a timecode, for example
Try it on a Google search results page
I'm not responsible for their shite code
That’s just how http requests work though. It’s not their code it’s…the internet
No, absolutely everything has to be a separate URL!
^/s^
Oh god could you imagine? Combinatorial explosion
If your url for a single item is a paragraph long - often repeating itself - and including shit that can be handled by css that is absolutely shit code. Temu is a particularly batshit example of this.
Ok but that isn’t the most common reason for url params
also kinda common sense if you know anything about urls
Because I don't expect the target audience to be here in /c/privacy
You don't think anyone is here to learn how to be more private on the Internet? You just expect everyone to already know everything
Look, the point is that I've tried explaining it to friends and family and whoever want (and don't want) to listen.
This post is a rant / wishful thinking as stated as being so, I'm not in the mood of explaining everything again. I've done that in my personal blog, etc.
You're good, no worries. You created a lot of dialog, and most of it is helpful. I'm not complaining.
Thanks. Looking back, maybe I should've at least explained about it a little more. At the time I just wanted to blow off some steam.
I could have worded my response better myself.
I'm looking forward to your next rant, tbh
Rants are rants, that’s fine imo
How so? This is a rant post, I'm not trying to present it differently.
No but that's what the comments are for. I share if the discussion is relevant.
Don't worry mate. I've never heard the term but I knew exactly what you meant. I cleaned a url earlier today for Lemmy.
I had someone watch me edit a URL in the address bar and she clearly thought I was just fucking around, because there was no possible way that any human could edit the Matrix language up there and accomplish anything productive.
That's part of my point. Most people just don't know.
That's like telling someone to just tune their carburator.
inb4 you get an indignant reply suggesting that carburetor tuning is a must-have skill for absolutely anyone who owns anything that has one
LOL, wait, is it copypasta or does that guy just post that a lot?
It is now.
Brake line bleeding is a must-have skill for anyone with brakes. Otherwise you can never be sure not to have air in the brake lines. Really it's irresponsible not to know how to do this if you have a vehicle with idraulic brakes.
Or you can get your mechanic to do it. It's not like brakes get air bubbles during normal operation, it's only a risk when working on the brakes in any other way
(Was your comment a poke at the previous one, pointing out that one doesn't really need those skills? If so I think it's reasonable for a person with a carburettor vehicle to learn how to tune it, as the skills are becoming rare)
Being able to adjust your sarcasm detector is a must-have skill. Sarcasm levels fluctuate wildly depending on platform, community, season, and topic. Otherwise you can never know if you're making an ass of yourself when replying to other comments. Really, it's irresponsible to partake in social media without a finely tuned sarcasm detector.
I take it you missed my bracketed comment acknowledging it was probably sarcastic.
LMFAO, I'm actually dying over here. 😂
Have you met... Anyone?
Thank you for the suggestion. Downloaded
Great extension and good recommend
They don't necessarily need to; hopefully we can help people install uBlock Origin which removes tracking query parameters from URLs. See privacy.txt
Thankfully uBlock Origin removes those parameters for us. The default filters include a whole bunch of
removeparamfilters; e.g. privacy.txt See also removeparam.Maybe you could help your friends and family install Firefox and/or uBlock Origin? Every little bit helps :)
As long as they don't link them to those links, thereby confusing them to the point of being completely turned off to the idea
To be honest 99% of people, certainly including me, probably don't recognize tracking elements in a URL unless they're like affiliate links.
If people were really good at removing that info, they'd probably create a unique hash including all that data that we wouldn't be able to edit.
I mean, I've seen companies start shortening links with the tracking info inside it. Amazon and Spotify are ones I see frequently
There it is :/
Pretty much all junk which isn't human readable is tracking info
Hard to follow that as a rule. Consider any YouTube video, the video id isn't exactly human readable.
Actually it's pretty easy. While not necessarily universally true, 98% of the time if there is a question mark everything after it is completely useless and can be removed.
for example of youtube, if you just use the share link from mobile you will get something like this
https://youtu.be/NMGQnFr0wMI?si=wcY56UThMAL6qkeg
However the only thing needed is
https://youtu.be/NMGQnFr0wMI
discord is similar, share a picture and you get shit like
https://media.discordapp.net/attachments/425755272191934466/1160245184110526586/1696478537347025.png?ex=6533f588&is=65218088&hm=99b1064b483405f42e2f8d18b7c01fc55934434d9178c5cf8d5611870d8a34e4&
but all that's needed is
https://media.discordapp.net/attachments/425755272191934466/1160245184110526586/1696478537347025.png
the ? is almost always used as an escape from the actual url. So if you see a question mark, Just remove everything after it and things will most likely still work.
This holds true for youtu.be links, but not youtube.com/watch?v=
Discord file url parameters are to prevent using discord as a free cdn. I believe discord plans on actually enforcing expiration later this year or early next year, at which point those extra url parameters will actually be necessary (and the links will no longer work indefinitely)
By the way for anyone who doesn't know, the ? only appears once in the url. Successive question marks are instead denoted by &
Here is an alternative Piped link(s):
https://piped.video/NMGQnFr0wMI?si=wcY56UThMAL6qkeg
https://piped.video/NMGQnFr0wMI
Piped is a privacy-respecting open-source alternative frontend to YouTube.
I'm open-source; check me out at GitHub.
Yeah it doesn't work for every website, but it's an okay starting point
I'm aware that with most privacy issues, a lot of people have limited understanding about it. Hell, I'm probably ignorant on many other privacy issues outside of this topic.
Phones and chrome are designed to prevent people from noticing that they're being tracked and helping big tech track others
Indeed. I use Léon on Android, very straightforward, open source, and easy to install and configure...
https://github.com/svenjacobs/leon
Nice. I personally prefer using this one: https://github.com/TrianguloY/UrlChecker
This app is awesome, using it and really enjoying it
I would say this is my app do the year
It looks like Lèon is for sharing (outbound) links to others whereas UrlChecker handles shared (inbound) links. Is that right? Or can UrlChecker also scrub a link before I send it?
It fortunately does both. You "share" a gross link to URLCheck, clean it up within the app, then can share the clean URL to whatever app.
Thanks. I tried it briefly along with Leon and LinkSheet (also mentioned in the comments). URLCheck is hands down the best of the bunch, but its UI is so terrible and obtuse that I can't bring myself to have to interact with it regularly. Will keep an eye on it though!
Agreed. Recently youtube started adding tracking parameters (
?si=) to their share links. I always clean them up.This would be a good feature add to Lemmy. Clean pre-post.
People generally don't care (I myself am not at the level of this community). It also involves enough technical know-how that most people won't care. It's like asking people to use a CLI, not going to happen. I'm pretty sure I'm one of the few people who still C&P URLs to share, most people hit a "Share" button.
You're both right: most people don't know what any of this means, but also people who know often don't care. In my group of friends there are 2 programmers, they perfectly understand this yet they still share links full of trackers in the group chat.
My strategy is to friendly scold them (a programmer should know better) and in the same message share the same link without tracking rubbish. This way my non-technical friends can also see how short the same link can become.
Yea, I do it less for privacy reasons, and more for tidiness. Tracking parameters can be so unwieldly nowadays. Something that's 30-40 characters long can balloon to 200-300 characters.
That shit is insufferable. Mind your own business.
It's not just browser though, sharing links from apps also generate these URLs. A lot of people then share these links through chat apps.
I do realize that most people are not aware of it, that's why I said this is more of a rant. Just want to vent to fellow privacy minded people.
https://raw.githubusercontent.com/DandelionSprout/adfilt/master/LegitimateURLShortener.txt
Add that to people you know Ublock lists
Yeah I always mention it when people send a link with all the extra stuff, how you can usually delete everything past the question mark
Some apps are hiding it behind shortened URLs. So it looks clean, but if you expand it, then oh boy.
Yeah I hate that I never trusted shortened urls
I wish websites would clean their URLs
The OCD part of me really wants to clean up those URLs simply because the link becomes a massive novella of garbage that's harder to read than Yu-Gi-Oh card text.
I thought I was alone in my windmill-tilting on this one! Nice to see there are others who clean URLs of unnecessary querystring parameters
Urlcheck foss app also do very good work
Is it me or that feature make the the startup time unbearably slow? After I got tired of waiting seconds the app to show me the link opening options I just disabled that ajd keep URL check on the side for when I see the link is riddled with useless parameters (or even worse URLs inside URLs)
I do this because I hate super long URL's, but is this actually a problem for privacy? Does it not actually fuck with the tracking because now two separate people have got the same tracking Params? (Genuine question).
Nope. It's a nightmare. The ad company now knows that you are friends or family
But what If you send it via social media like Lemmy or Reddit?
Then they know who's the poster (you), they can know your username if they want to. A lot of people use the same username in many places, so unless you use different usernames in different social media, it's still valuable data.
If not that, seeing how the content spreads through social media and analyzing the reach is interesting data by itself.
Most tracking parameters actually just specify the source the link came from. Like Twitter or an email. I don't see a lot of tracking parameters that literally are tried to an individual account. But here you seem to be saying that's the most common type of tracking param
Try sharing Instagram post or YouTube video from the apps.
Instagram adds 'igshid=' . YouTube adds 'si='.
Try sharing the same IG or YouTube content from different accounts. The 'igshid', 'si' param value will be different
It can be used to tag who shares it, and who clicks on that specific url param.
TikTok hides a ton of such params behind shortened url. Try expanding tiktok shared urls.
Then they know that person follows you
I click links on Lemmy all over the place, I don't follow anyone in particular?
I wouldn't go as far as to say that once two people have clicked on the same tracking link the company behind it can tell what your relation is directly. What they will know is that the two or more people are connected in some way, to then infer in what way, they need other circumstantial data, maybe they have an account on that website and they share the surname or, even easier, without account they can tell that the requests came from IPs that come from a circumscribed area, and on and on, the more data points you add the better predictions the company can make.
If several IPs from disparate places in the world use the same link they can probably tell that the link was shared on social media, not knowing which one, but it was sent in a public internet space at least
Interesting, I never really thought about this before. I wonder if there’s a clipboard manager that does this automatically?
There is a Firefox plugin which I believe is called CleanURLs.
it's interesting that you mention the shorturls OP... I'm almost positive as of today that those links you can share that are like amazon.com/a/ab3cd4 are customized tracking links.
Problem is, if you paste it in your browser from the app, it doesn't go back to the original URL. You have to search the product again and customize the color, number, etc, and then strip tracking again from the url.
Most people just want to send a friend a link of the thing they think they'll like.
For android, I use this: https://github.com/TrianguloY/UrlChecker
For firefox, I use ublock origin and add then anti url tracking list. Adguard maintains such a list. I forgot the exact name though.
Edit: it's this one https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_17_TrackParam/filter.txt
I try to do it. Mainly i see a lot of ?utm_source shit and kill it.
I always remove anything after /ref= from an Amazon link before I forward it to my wife (she has the account and does the orders).
Filter cleaner should be built into the browser.
iOS 17 is supposed to do this automatically now.
https://9to5mac.com/2023/06/08/ios-17-link-tracking-protection/
Kind of annoying they only do it in Safari in private mode, and not as a default.
Is it? Found this setting: https://forums.macrumors.com/attachments/img_1639-png.2219522/
Not sure what the default is and I don't have iOS 17 yet.
mine was set to private only, but i’ve had ios17 since one of the early betas
Mine is set to all, but I think I might have done that and forgotten. I am not sure if this setting is also available on MacOS.
Most things iOS does when it comes to Safari is annoying.
I mean it takes 10 secs to hold the back key though and get rid of it
A personal gripe of mine. I can't get any of my friends/family to care...
It needs to be and should be automatic. But it's not in the interests of media platforms to add such functionality
https://github.com/TrianguloY/UrlChecker
I care about this also. I used to clean them up, but what I've started doing is adding and replacing parts of the share id. And I'll usually put something stupid in there like "booger", just to screw up their tracking data.
I shall do it, because i hate this URL ads, even more the fucking link shortener, because they disguised it and avoid to see the destination. Because of this i use 2 extension, a Link unshortener, which reveal the real URL, when i click on a shorten link also the Adguardfilter in the Vivaldi's own trackerblocker, You can find more filters here:
https://filterlists.com
I feel the same, I actually feel weird when someone shares with me a url with tracking or source tags, like bro you’re telling on yourself… do you not care?!
Amen.
I'm with you!!
I always just reply with the real URL.
does lemmy automatically clean urls?
Good reminder, I'd never considered that 😅 So why did lots of reddit subs discourage the use of URL shorteners? Was this just standard Reddit badness?
Because url shorteners can be used to hide affiliate links or even malicious URLs.
I agree completely but most good browsers will automatically filter that stuff out. (Extensions like ClearURL are completely obsolete)
I have no idea how to clean a URL and honestly I'm not interested in cleaning every URL I send.
At least you're honest about your ignorance
Yup this is true
Quick rule: Just remove all of the garbage after a "?" except what is directly following a "search=" or "query=" parameter.
Oh yeah I do that by default, if the URL is too long with random stuff at the end I remove what I can without breaking the link
As if "search" and "query" are the only two legit get parameters lol...
I sometimes leave some IDs in that don't change and seem to track me as a person so the tracking mixes them up with me if the trackers don't discard it on client change.
If anything that just makes it easier to map your social circle. Probably even intentional to see who you share links with.
Nah, that's when you leave the share tracking ID in. Keep up
Keep up with yourself?
idk, this seems like a 99 IQ strat
Brave includes “copy clean link” in the context menu in the desktop version.
I literally couldn't care less. You people have so much time on your hands to get mad over this dumb shit.