How to send backups on multiple location?
I have 3 servers:
- my house
- my sister house
- my parents house
My server has a lot of services (Nextcloud and Immich the ones that use more space), the other 2 servers only have Home Assistant, Frigate and some shared folders. On my server I use Backrest to backup locally and on Wasabi, the other 2...well...are not backed up 🙈 ...yet!
I was thinking to buy a couple of 14/20TB drives and install them in my parents and sister servers so that each server can backup data on the other 2. The backup will be done locally on all the servers with Backrest. How do I copy the backups across servers? Should I use Syncthing or is it better to use one repository per location on each Backrest? Or...other ideas?
Thanks!
31 replies
Configure and Pre backup the drives before bringing them to family members to save yourself some bandwidth
Definitely a good suggestion!
As for the other question in thr post: If you are using btrfs or zfs I believe both of those have a send function that operates at a block level and will only send block changes rather than full file changes
I have an offsite NAS where I run the Restic REST server as a docker container. I connect to it over Nebula but you could also use a traditional VPN, Tailscale, Headscale, Pangolin or whatever.
Works like a charm.
Tailscale+Headscale or Zerotier, use whatever backup software you want for the local backups. Simple script to rsync backups to other sites and remove copies past a certain age.
Pretty simple, and no need to expose machines in any less than safe ways.
Why Tailscale AND Headscale? Arent't they the same thing?
Tailscale is both a client and server. If you use only Tailscale, you have to pay for the service after so many devices are connected, which by all means support the company and do so and avoid using Headscale.
Headscale is an open source implementation of the Tailscale service, so it's free to use with all the usual Tailscale clients published. You setup Headscale somewhere, register your Tailscale clients to it, and use it like usual. It's just skipping the need to pay for Tailscale servers as a service, and gives you greater control over how traffic routed. Completely optional.
Yeah but it's like 100 devices, I think. And I believe 3 users (meaning under one account; sharing a device with someone who makes their own account doesn't count as a "user"). You're right, but they're pretty generous.
I don't think it takes many resources to provide the service to consumers; it's not like you're using any of their bandwidth (minus the tiny amount used for coordination between clients). Oh, or if you use their DERP servers (encrypted, but still).
In general, people should know there are self hosted, truly private options, though. So thanks for mentioning Headscale.
I'd do it like this:
borg backup
(optional) borgmatic for easier use, but a diy shell script might suffice
(optional) https://github.com/Ravinou/borgwarehouse for easier gui based "serverside" setup on each location
(if you have no way to reach the servers from the internet yet) set up dyndns for each location so you can reach them by domain
might need to setup portforwarding rules in the router of each location
Didn’t know about borg warehouse. Thanks for the heads up!
I went a little crazy and setup my own wireguard VPN network, all the remote hosts connect to the VPN and the primary server connects to each of them and pushes backups. Because I use btrfs and lots of snapshots I use btrbk, annoying to setup but now my hourly snapshots get pushed everywhere, minimal bandwidth and it flawlessly has worked for years.
Whatever you end up with
I use rsync for a similar system. One of the nice things is that you can set a bandwidth limit so that it doesn't saturate your family's internet connections.
You don't want to send as that's means that an adversary can delete the backups.
Make each one do a pull instead.
Huh?
Configure each backup machine to read from the data you are backing up
You can do it that way, but I don't see how that's more secure. Fewer server bits to maintain I guess?
I think what he means is that if your backup is triggered from your main server and your main server is compromised the backups can also be attacked immediately. If the backup is requested from the backup machine you will at least have the time between the attack and the next backup to prevent the attack from reaching your backup machines.
I'm sorry, but I still don't understand what you mean. Could you please elaborate bit? Thanks!
You configure the backup systems to connect to the device to be backed up. The idea is if something bad happens on the main machine it won't impact the backups
Got it, good idea, thanks!
I use sync thing with untrusted keys. That way the data ends up in multiple locations but it's not accessible remotely. If you don't care about the data and the locations you don't have to do that but it's a nice feature.
Honestly, if I were you, I’d install Proxmox VE for the VMs/containers, and Proxmox backup server (possibly as the VMs) for the backups in all the locations. Super easy to configure the backups, and super easy to restore them. All done via a nice enterprise-ready GUI and free of charge
Oh, Proxmox backup server can be installed in a VM? I'll think about installing it in a VM on Hyper-V on an office server. I already had plan to install Proxmox backup server on a spare PC that I've got laying around and turn it on nightly to backup all the Proxmox server. Apart from that, I need to backup data too because in case of any crash, a VM backup is useful, but sometimes you just need to retrieve some file.
Sure! https://pbs.proxmox.com/docs-1/installation.html#install-proxmox-backup-server-on-proxmox-ve
After your comment I went to ser this video and...I'm gonna install PBS tomorrow! Thanks!
Glad you found it helpful! If you use Proxmox VE, I can 100% recommend PBS as a backup solution!
Just run backrest backup on each server three times, one for each remote backup tepository. Easy enough.
How would you create the remote repository? With rest-server?
The same way you back it up, using ssh remotely for example
I like borg with rsync.