Lemmy works by sending a message between servers, waiting for an OK, sending another message, waiting for an OK, etc.
That means if servers are on opposite sides of the world and it takes 0.2 seconds to send a message and get an acknowledgement, you have a hard limit of 5 messages that can be sent per second, even if they’re both on 100 gigabit links.
Lemmy.world was sending aussie.zone about 16,000 messages per hour, which is about 4.5 per second. So around 220 ms per message. And it wasn’t keeping up.
Now lemmy.world has… it looks like two separate connections sending messages to aussie.zone, so it can have two messages in flight at a time.
Since that started we’ve been getting two days worth of messages per day, and now we’re caught up.
Lemmy works by sending a message between servers, waiting for an OK, sending another message, waiting for an OK, etc.
That means if servers are on opposite sides of the world and it takes 0.2 seconds to send a message and get an acknowledgement, you have a hard limit of 5 messages that can be sent per second, even if they’re both on 100 gigabit links.
Lemmy.world was sending aussie.zone about 16,000 messages per hour, which is about 4.5 per second. So around 220 ms per message. And it wasn’t keeping up.
Now lemmy.world has… it looks like two separate connections sending messages to aussie.zone, so it can have two messages in flight at a time.
Since that started we’ve been getting two days worth of messages per day, and now we’re caught up.