SOLVED: lemmy.cafe down
lemmy.cafe seems down. it returns a 502, indicating that something behind nginx went wrong. i checked ![email protected], but the last post is ~2 years ago. does anybody know whether .cafe has some planned downtime, or something else announced?
just prodding around, i also typed https://status.lemmy.cafe/ into my browser. that leads to their grafana login :-)
thanks to everyone contributing. but especially @[email protected] for not only maintaining the instance but also swiftly bringing it back up!
25 replies
Things should be back.
There's a problem I never got to figure out where the internal nginx container - sitting between anubis and UI containers - does not come back up after a restart.
The VM this was running on had a fault on DigitalOcean side and got moved to another host. This included booting it back up, which did not bring that nginx container up. API worked, so all apps worked. It's just the standard, photon and voyager UIs were down.
Apologies.
Does the container not start at all or does it crash? I forgot the specifics but nginx is kinda fragile when the site it's supposed to proxy to is not ready
It starts just fine, just doesn't come up on its own after boot. If you're interested - have a look https://gitlab.com/MithrilFoundation/lemmy.cafe/
It's probably something obvious like a missed anchor, but it just doesn't happen often enough for me to assign mental capacity to this.
Seems like it's missing 'restart: always' in both green and blue. Anubis is lacking those as well though?
Yep, thanks! Pushed the fixed config
You made me took at this now :D Found the problem. Missing
restart: alwaysFWIW I've had multiple DigitalOcean VMs die seemingly out of nowhere.
Never had a problem with OVH nor Hetzner.
This was a first for me in ~7 years I've been using them. I've always found them really good, albeit expensive. And with the ever growing database for lemmy - I'm starting to consider other options.
Ui seems to have gone down. API is still functional. Gimme a minute, will have a look at what's going on.
let us know if you're looking for additional admins or moderators
I'm not actively looking, but I am open to the idea. What I've found, though, is that usually people are not cool with what they find at https://lemmy.cafe/instances
your defed list looks fine to me
Would you mind explain to a newbie why?
lemmy.cafe is defederated from lemmy.ml
That is good, considering the staffs' behavior
I don't understand why you feel bad about that defederation
People are already rebuilding the same communities from that instance outside lemmy.ml, and you can just go to their GitHub for bug reports/support
I don't feel bad at all :)
I do not agree with the general political stance of the administration of that instance.
Thanks for holding on to literature.cafe! Do you have any news of Gabi, that started the whole instance?
I... am not entirely sure this message was intended to come my way, but just in case it was - I have nothing to do with literature.cafe. I remember suggesting keeping it alive as the admin was moving on, but that never materialised. Not sure who's running it now.
The other comment said you were an admin?
I'm an admin of the lemmy.cafe instance. Literature.cafe is another instance on the same network.
I’m an idiot, thanks for dealing with me… totally misread stuff multiple times…
Happy to help :)
I hit archive.org's Wayback Machine—learned in the process, that apparently use of Anubis breaks the Wayback Machine, which is...a little concerning. I don't know how many websites out there aren't being archived now...
Anyway, from a pre-Anubis page Archive.org page, the admins appear to be:
Looking at lemmy.world's view of their user pages (which is still accessible):
I don't know whether user pages on remote instances than a user's home instance are complete; I'm a little suspicious that they might only display comments and posts to communities to which at least one user who subscribes to the community with the post/comment on the home instance. But with lemmy.world the largest instance, my guess is that that's the most-complete record of comments one might get.
On lemvotes.org, looking for vote activity (which is probably at least-as-current):
They might have non-admin accounts and use those for everything, but I'd guess that Illecors is likely going to be the only "active" admin, from that.
Based on the view of the lemmy.world user page for him, he does follow ![email protected] and a number of other major communities, so he might see something you post there if the instance is down and he's using an account on another home instance to get on. He does not list any non-lemmy.cafe contact information in his user bio.
The archive.org page I listed above does have:
I'm not familiar with SimpleX, and I don't know if that's still active or if it's possible to get to it through Archive.org's archived page, but it does show a page with a QR code, which you might be able to scan with a mobile client to reach it.
lemmy.cafe up