i pinged @sunaurus@lemm.ee on matrix about 30h ago already about the issues with federation from lemmynsfw.com, as it was the first one i noticed, but I haven't heard back yet.
Wait, how do they get that data remotely? I was looking at my instance vs world and I saw there's like the +1 hour from a week or so ago when I upgraded to latest mbin lol.
I guess they're looking at common activities and when they appear on each?
lemmy has a public api that shows the federation queue state for all linked instances.
it provides the internal numeric id of the last activity that was successfully sent to an instance, as well as the timestamp of the activity that was sent, and also when it was sent. it also includes data like how many times sending was unsuccessful since the last successful send. each instance only knows about its own outbound federation, but you can just collect this information from both sides to get the full picture.
Looking at incoming request. .world is working OK for me. They seem to be batching stuff like I'll get nothing for 30 seconds, then over 3 seconds like 50+ requests.
Of course I don't know if their queue is backed up and I'm getting delayed stuff. I'd need to stop processing and look into the incoming queue to see what they're sending.
Bit of an edit. Looking at incoming again I can see under newest items, an entry from world that was 11 minutes old. Oh I have an idea. I'll see if this edit gets there in a timely manner.
Spoiler alert, it was instant.
Oh ignore me. It's specifically between those two instances I guess.
Aparently its between big instances and lemm.ee only. All of said instances use cloudflair. I suspect that cloudflair has blocked/rate limited the larger instances from reaching lemm.ee.
I think it must be hit/miss. Because I think those edits I made would have gone from my instance to world and then from world to .ee, and it was happening within seconds.
So, presumably random stuff is being dropped or delayed?
Admins have been talking about it, it looks like it has something to do with banning/unbanning users. Sometimes a ban/unban doesn't want to propagate to .ee and that causes a logjam somehow.
If its that bloody bot that bans u if ur comment karma is to low thats gonna be funny. I got banned/unbanned like 10 times in an hour cos my comment karma was fluctuating near the bots threshold.