Hello everyone!
I'm experiencing troubles with federation with other instance.
I get a lot of operation timed out in logs
Caused by:
0: error sending request for url (https://lemmy.world/u/Ricey): operation timed out
1: operation timed out, context: SpanTrace [{ target: "lemmy_apub::activities", name: "verify_person_in_community", file: "crates/apub/src/activities/mod.rs", line: 50 }, { target: "lemmy_apub::activities::voting::vote", name: "verify", file: "crates/apub/src/activities/voting/vote.rs", line: 57 }, { target: "lemmy_apub::activities::community::announce", name: "receive", file: "crates/apub/src/activities/community/announce.rs", line: 141 }, { target: "lemmy_server::root_span_builder", name: "HTTP request", fields: "http.method=POST http.scheme=\"https\" http.host=random-hero.com http.target=/inbox otel.kind=\"server\" request_id=5955a024-6b1e-458a-b846-156e14fe5368", file: "src/root_span_builder.rs", line: 16 }] }
2023-07-23T20:12:18.815121Z WARN lemmy_server::root_span_builder: data did not match any variant of untagged enum AnnouncableActivities
0: lemmy_apub::activities::community::announce::receive
at crates/apub/src/activities/community/announce.rs:46
1: lemmy_server::root_span_builder::HTTP request
with http.method=POST http.scheme="https" http.host=random-hero.com http.target=/inbox otel.kind="server" request_id=f61aeb28-fa30-464f-b9b8-648f480b3f06
at src/root_span_builder.rs:16
I get this from many instances but ping to them works just fine. I can't even add new communities now. I've increased federation workers but to no avail
It's all a matter of how many you think 'a lot' is. The major Lemmy servers that most small instances are drawing comments and posts from have had a series of major performance problems for the past 60 days. A fix is sitting on GitHub right now for one such serious problem.
lemmy.world has had serious problems recently. The 10-second timeout in the http connect doesn't give much time for it to respond.
I think it helps to get some idea of quantity of incoming comments and posts that you are successfully sending and receiving to other instances. Right now the federation protocol favors giving up quickly (10 seconds) and retries... and doesn't aim for guaranteed delivery.