Spyke

Posts

Backing up AndroidFileHost. I need some help.

cross-posted from: https://lemmy.sdf.org/post/40623875

Hello. Me and a few friends are attempting to backup every files from AndroidFileHost, and we need some help in doing so.

For those who haven't heard of it, AndroidFileHost is a website that hosts various Android related files. It's one of the last surviving large Android related file serving sites, and holds a LOT of rare files especially for older android devices. (rip d-h.st) Despite being such a valuable site, it hasn't been well maintained for the past few years. Their Xitter account's last update is from around 2022, and the owner isn't replying to any e-mails. The site has been extremely unstable with various issues, most recently no file could ever be downloaded from it for about a month. Luckily, it has been (kind of) solved for now, and most (not all, about 20% files are still gone) files are back online now. However, it's clear this site needs a backup.

I have scraped their website which gives us the unique ID and MD5 hash for every files available on the site. Now, using this ID we can automate the process of requesting mirror links, downloading them and checking for integrity. (Please check an example file to understand how their system works -- https://androidfilehost.com/?fid=745425885120701975 )

The sum of every file sizes we know is roughly 180TB. It's impossible to download this on a single machine, so I've developed a "tracker" system to concurrently download multiple files using different machines. The tracker server keeps a list of every known file IDs (btw, it's 256,640 files which is a bit less than 277,467 displayed on their main page. I believe it includes deleted files as well but not sure atm), assign it to each clients that request and appropriately mark the file as downloaded. The system is pretty robust now, so our plan is working great. Except that our internet is pretty slow and we can't afford 180TB instantly.

By talking to friends and their friends, we've got quite a few people willing to help a bit here. Unfortunately many of them lack storage space, so they need to keep downloading from AFH and uploading to my server. This works for a few clients, but not for many. The "my server" here every client uploads to have 500Mbps internet, and it gets terribly slow pretty quick. Plus, 180TB of storage isn't really cheap and easy to afford.

Ideally, we need to get people with faster internet speeds (I'm in asia, so not the best place to fetch files from AFH servers mostly around Europe and America) and more storage space. If you have some bandwidth or storage to share, it would greatly help us.

I'm sorry if a post like this isn't welcomed here, if so please feel free to remove it. Thanks for reading this post.

P.S. Also worth checking out - related XDA thread https://xdaforums.com/t/did-anyone-else-notice-signs-of-androidfilehost-com-being-abandoned.4578561/ (I'm LegendOcta)

View original on lemmy.sdf.org

Backing up AndroidFileHost. I need some help.

Hello. Me and a few friends are attempting to backup every files from AndroidFileHost, and we need some help in doing so.

For those who haven't heard of it, AndroidFileHost is a website that hosts various Android related files. It's one of the last surviving large Android related file serving sites, and holds a LOT of rare files especially for older android devices. (rip d-h.st) Despite being such a valuable site, it hasn't been well maintained for the past few years. Their Xitter account's last update is from around 2022, and the owner isn't replying to any e-mails. The site has been extremely unstable with various issues, most recently no file could ever be downloaded from it for about a month. Luckily, it has been (kind of) solved for now, and most (not all, about 20% files are still gone) files are back online now. However, it's clear this site needs a backup.

I have scraped their website which gives us the unique ID and MD5 hash for every files available on the site. Now, using this ID we can automate the process of requesting mirror links, downloading them and checking for integrity. (Please check an example file to understand how their system works -- https://androidfilehost.com/?fid=745425885120701975 )

The sum of every file sizes we know is roughly 180TB. It's impossible to download this on a single machine, so I've developed a "tracker" system to concurrently download multiple files using different machines. The tracker server keeps a list of every known file IDs (btw, it's 256,640 files which is a bit less than 277,467 displayed on their main page. I believe it includes deleted files as well but not sure atm), assign it to each clients that request and appropriately mark the file as downloaded. The system is pretty robust now, so our plan is working great. Except that our internet is pretty slow and we can't afford 180TB instantly.

By talking to friends and their friends, we've got quite a few people willing to help a bit here. Unfortunately many of them lack storage space, so they need to keep downloading from AFH and uploading to my server. This works for a few clients, but not for many. The "my server" here every client uploads to have 500Mbps internet, and it gets terribly slow pretty quick. Plus, 180TB of storage isn't really cheap and easy to afford.

Ideally, we need to get people with faster internet speeds (I'm in asia, so not the best place to fetch files from AFH servers mostly around Europe and America) and more storage space. If you have some bandwidth or storage to share, it would greatly help us.

I'm sorry if a post like this isn't welcomed here, if so please feel free to remove it. Thanks for reading this post.

P.S. Also worth checking out - related XDA thread https://xdaforums.com/t/did-anyone-else-notice-signs-of-androidfilehost-com-being-abandoned.4578561/ (I'm LegendOcta)

View original on lemmy.sdf.org

mlmym looks weird

Since a few days ago I noticed some minor changes on mlmym (old.lemmy.sdf.org)

The logo on top left is low resolution, and the community info sidebar isn't shown by default.

Before: https://web.archive.org/web/20250127103600/https://old.lemmy.sdf.org/ After: https://web.archive.org/web/20250204090416/https://old.lemmy.sdf.org/

Does anyone know if this change was intended? At least I'm pretty sure the logo isn't.. Not sure where to report. thanks.

View original on lemmy.sdf.org
lemmyapps·Lemmy Appsbyhexagonwin

Android app with compact ui?

Hello. I used to use RedReader with reddit, but there doesn't seem to be such app for lemmy. Right now I'm using Voyager and it looks/works great, but it's super slow on my ancient phone. Is anyone aware of a native android lemmy client with a compact ui? I'm asking just in case there's something I missed. Thanks!

Edit: I switched to Boost, seems to work great. I do miss swipe to up/downvote though..

View original on lemmy.sdf.org
selfhosted·Selfhostedbyhexagonwin

Trying to get advice for photo/files storing/syncing

Hi. Sorry for the vague title. Nowadays I'm using multiple computers and get to need files and such from other machines pretty often. My music and photos library has also increased and it's getting much harder to maintain with it being scattered across many machines. Basically I'm trying to have a photo library and plain files(documents, music, etc) shared across computers.

For plain files I'm thinking nfs+samba would be the best approach, but there are problems. They have speed issues, but as I can't afford large space for all my machines I can't keep a full rsync'd local copies everywhere too.

The photos are my bigger concern, as I'm looking for a tagging feature. A plain directory structure would be easy to sync but those tags would differ by programs.. desktop programs like digikam or xnview(sadly proprietary) would work well if I didn't need syncing, but I'm not sure if they'd work reliably with all their configs/files stored over nfs. Plus, these programs would have incompatibilities by platform and not work at all on android.

Web based solutions like Immich or NextCloud Photos appear to be pretty famous nowadays, but I'm not sure about them as well. They seem to be overkill for my purpose, and those mostly tend to be very new & i'm not too sure about their future, as they store tags and such on their own formats.

Edit: Oops, forgot to say. I have multiple servers right now, one offsite running FreeBSD, another running Devuan, and one at home running FreeBSD.

I'd love to hear how others are maintaining their system. Thanks for reading.

View original on lemmy.sdf.org
softwareoptions·Software recommendationsbyhexagonwin

Looking for a program to document things in life.

Hello all. I'm looking for (a) program(s) to manage & document things in life. Mainly these features are what I need:

  • Diary, random notes(like a wiki?) with version control
  • TODO list, auto added to diary at that time period
  • Ability to attach images and text files to those diary, notes
  • Calendar with schedule synced with TODO
  • Easy backup, preferably in plaintext or simple db
  • Text search

Currently I'm using SeaMonkey and my phone(android) to manage calendar (so two separated ones), a paper note to write diaries and use dokuwiki for random notes. This setup is too complicated and isn't productive at all.

I do think my requirements are kinda abstract, and there most likely isn't a single program that can do all this. Although basic I'm a novice FreeBSD & Emacs+evil user so *nix-only or text-based utilities are okay. I'm not aware of any program that meets these needs, is there anything that resembles what I'm thinking? Thanks!

View original on lemmy.sdf.org
selfhosted·Selfhostedbyhexagonwin

XMPP as a Discord alternative for small group?

Hi. I have a group of 6 people using Discord to chat. Recently Discord changed a lot and we're looking for an alternative. We have a few requirements:

  • Good client on multiple platforms
  • Easy to use search
  • Self hosted
  • Permanently saved chat history & attachments on server (no expiration)
  • Easy image upload (Ctrl+V to post image from clipboard)

IRC isn't an option as chat history is saved on the client, and there's no good integrated way to share files and preview images. Matrix would be an overkill as we're a small group not interested in federation, and the available clients had a few bugs. Mattermost lacks a good mobile app (their current one had bunch of bugs). XMPP appears to be the best as it is extensible and has many clients available.

However, I tried configuring prosody on my FreeBSD server and it seems like it doesn't permanently save chat history or attachment files. Does anyone know if these can be solved? Or is there any better alternative than XMPP?

Thanks.

View original on lemmy.sdf.org
selfhosted·Selfhostedbyhexagonwin

[Question] Unbound and AdGuard Home with OpenWrt?

Hello. I just upgraded my ramips router (ipTIME A3004NS-dual, 256mb ram, 64GB USB) to OpenWrt 23.05, so far it's working well. I'd like some extra privacy (my country is known to do some internet censoring) and filter connections to sites I do not want (advertisements, telemetry) and AdGuard Home paired with Unbound seems perfect for this.

Before upgrading I used to run a DoH setup on OpenWrt with CloudFlare's DNS, but I now want to remove dependencies to these public 'private' DNS servers.

I did try searching a lot, but unfortunately as I'm pretty new to networking and hosting things I'm not quite able to understand what I read. Some guides mention using Unbound but still does setup Google/CloudFlare DNS, is that used as a fallback of some sort?

If someone has already done something similar I'd very much appreciate some guidance on how this should be done.. Thanks!

EDIT: I think I got it working.. but I'd be glad if someone can please tell me a way to test it. dnsleaktest.com shows "None" for hostname..

I followed [1] to install unbound, then changed unbound's port to 5353, set AdGuardHome's port to 53 and set AdGuardHome's DNS settings (Upstream, Bootstrap, Private reverse) to 127.0.0.1:5353. After a reboot it seems to work properly, except that I can no longer connect to other machines using their hostnames. (Previously I could just ssh the machine darkstar using ssh hexagonwin@darkstar, now I need to ssh [email protected]) [1]: https://openwrt.org/docs/guide-user/base-system/dhcp_configuration#replacing_dnsmasq_with_odhcpd_and_unbound

View original on lemmy.sdf.org

You reached the end