Federation seems to have broken down

I'm experiencing some odd behavior. Lemmy communities on my server seem to have stalled (no new posts and or comments) since 2 days.

I went ahead and upgraded lemmy to 0.19.5 and postgres to the current version but to no avail so far.

.ml got banned by fail2ban but I set it on the ignore list now. any ideas where to start looking for the problems? I checked for the other big communities and they're okay it seems.

I can of course start adding logs in here but I would love to know which service or log I should start with.

Thanks for reading. Have a good one.

Edit: outgoing federation works. this post made it to ml in seconds.

Max_P ,
@Max_P@lemmy.max-p.me avatar

This tool is great to see when remote instances will attempt to send activity to you and how far behind you are: https://phiresky.github.io/lemmy-federation-state

There's an exponential backoff, so sometimes it can take hours before you start receiving activity again, so it's nice to know when to expect it.

haui_lemmy OP ,
@haui_lemmy@lemmy.giftedmc.com avatar

Thank you very much! This tool is great indeed!

BlackEco ,
@BlackEco@lemmy.blackeco.com avatar

I believe there is a exponential backoff mechanism in place if an instance cannot push to an other's inbox, so other instances may not have any attempt left to retry if it has been two days. In my experience un-subscribing then re-subscribing to an instance's community was enough for it to send posts after a few hours.

tmpod ,
@tmpod@lemmy.pt avatar

That is strange. Check the logs show anything out of the ordinary.

haui_lemmy OP ,
@haui_lemmy@lemmy.giftedmc.com avatar

I solved it with help. My fail2ban filters were too strict.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • random
  • lemmy_support@lemmy.ml
  • test
  • worldmews
  • mews
  • All magazines
    •