Nothing4You

Then I generated sql statements to remove duplicate posts that had higher ids than the other posts theyre a duplicate of

i assume this was done after updating the other tables referencing this table, such as comments, votes, saved posts, as previously discussed on matrix?

while it may be omitted here for simplicity, it can be dangerous to not mention that for others that might find this in the future if they experience index corruptions on their own if they don’t fix all references, as that would result in data loss.

while this is generally what most people talk about when speaking of defederation, admins can also decide to remove communities locally without blocking the entire instance.

you might find some inspiration from https://breezewiki.com/ - either its codebase directly or using it as an intermediary while scraping

@[email protected] there’s also rss feeds for communities

lemmy.ml doesn’t use cloudflare, that’s strange.

i’ve also never had issues with this when looking at instances that do use cloudflare.

pretty much, yeah. lemmy has a persistent federation queue instead of fire and forget requests when activities get generated. this means activities can be retried if they fail. this allows for (theoretically) lossless federation even if an instance is down for maintenance or other reasons. if mbin has a similar system maybe they could expose that as well, but unless the system is fairly similar in the way it represents this data it will be challenging to integrate it in a view like this without having to create dedicated mbin dashboard.

lemmy has a public api that shows the federation queue state for all linked instances.

it provides the internal numeric id of the last activity that was successfully sent to an instance, as well as the timestamp of the activity that was sent, and also when it was sent. it also includes data like how many times sending was unsuccessful since the last successful send. each instance only knows about its own outbound federation, but you can just collect this information from both sides to get the full picture.

there is also https://phiresky.github.io/lemmy-federation-state/site to look at the details provided by a specific instance.

it’s not just lemmy.world.

of the larger instances, the following have trouble sending activities to lemm.ee currently:

• lemmynsfw.com -> lemm.ee: 2.81d behind
• sh.itjust.works -> lemm.ee: 1.04d behind
• lemmy.world -> lemm.ee: 22.5h behind

i pinged @[email protected] on matrix about 30h ago already about the issues with federation from lemmynsfw.com, as it was the first one i noticed, but I haven’t heard back yet.

at least the image resizing topic has recently been fixed in lemmy, thumbnails sizes are limited (at the time of thumbnail creation) in the latest release. I’d have to look closer at the other stuff, the api part is unlikely to have changed and will affect all frontends, but js part should differ depending on the front end. some instances already use other frontends by default and there is also a replacement for lemmy-ui being worked on (lemmy-ui-leptos), but I don’t know how they compare. either.

it should be taken into account though how much of this is cacheable as well, as it will then typically only affect the first load for the static files.

I can totally understand the issues in general though, I’ve been living with a 64kbps uplink for several years in the past.

requires sending ~25-fold less data per post

what are you referring to with this? AP traffic?

do you have some more information about this?

so just dropping duplicates then?

are there no references to the duplicates from posts? if there are and the duplicate rows are just deleted it’ll cascade deletion and purge all those posts from the db as well

how are you planning to fix this?

this feels like more db index corruption that already existed for users previously, unlikely to be an issue in lemmy itself

Retaining old content has value

this 100%. this is exactly why i wouldn’t recommend any communities to be removed if there is still content in there, worst case just lock it.

cleaning up communities doesn’t make lemmy more active either. it may help to make active communities stand out more against inactive ones though.

cleaning up dead communities isn’t a great experience as it is today.

admins could purge communities, but this can cause unexpected breakages with other activitypub software that is more strict about cryptographic verification, as purging a community erases all information about it from the local instance, including the cryptographic private key. purging a community also only removes it on the local instance, so other instances would still have a cached (although possibly marked as deleted) copy of it. this would be the only method that frees up the name to allow creating a new community under the same name later on. locally this would also remove all posts and comments associated in that community, but other instances may think that they have users subscribed to the community and may still have posts and comments in there. this also means if a new community is created with the same name again, the local instance will still not know about older posts, but users on other instances might see them still, and the local moderator might be unable to interact with them at all, e.g. to potentially remove old problematic content.

the next option is removing a community as (instance-)moderator action. this will only mark the community as removed without further impact. regular users won’t be able to access the community on the local or any other instance anymore, but its contents are preserved in case it gets restored at a later point in time. the name is not released and there isn’t even an error message shown when trying to create a new community with the same name.

another option could be to “take over” the community and delete it, which is the act of the top community mod deleting the community (not a moderation action). in this case only the same top community moderator can restore it. this behaves mostly the same as removing it.

none of these options are good to use. imo purging should be avoided in any case, and the other options both require admin intervention to release a community later on and have no user feedback in lemmy-ui at this time, at least on 0.19.5.

for communities entirely without posts it is probably ok to just remove them and restore and transfer them if someone requests them. for communities with content the next best thing might be locking the community, potentially locking all posts if it’s just a small number, to prevent unmoderated new content in that community, and put up a pinned post asking people to reach out if they want to take over the community. otherwise, if the community was removed or deleted, all the posts and comments within them would also be taken down with the community.

for sure, but they’re neither mentioned on https://join-lemmy.org/docs/users/02-media.html nor on the linked CommonMark tutorial.

It’s not even just that. It seems that the extra @ acts as a separator, so you can’t even autocomplete e.g. @threelonmusketeers@sh as that’ll try to autocomplete @sh instead of taking the instance domain as part of the mention.

I’ve raised a GitHub issue for this now: https://github.com/LemmyNet/lemmy-ui/issues/2652

on firefox, if i type @gedal and click or press tab once it replaces the text with [@gedaliyah@lemmy.world](https://lemmy.world/u/gedaliyah) . the behavior is the same whether i hit tab, enter or click the text.

it does, but only if you use the autocomplete feature. it’s also a bit delayed without any indicator that it’s loading.

if you type @gedal and wait a moment it’ll load @[email protected] to be selected: