11
you are viewing a single comment's thread
view the rest of the comments
[-] flamingos@feddit.uk 2 points 2 weeks ago* (last edited 2 weeks ago)

I was curious to see how they handle this on the fedi side, because they obviously can't stop you from uploading images to other instances, so decided to do some digging myself.

The fedi code for this is here and looks like this:

# Alert regarding fascist meme content
if site.enable_chan_image_filter and toxic_community and img_width < 2000:  # images > 2000px tend to be real photos instead of 4chan screenshots.
    if os.environ.get('ALLOW_4CHAN', None) is None:
        try:
            image_text = pytesseract.image_to_string(
                Image.open(BytesIO(source_image)).convert('L'), timeout=30)
        except Exception:
            image_text = ''
        if 'Anonymous' in image_text and (
                'No.' in image_text or ' N0' in image_text):  # chan posts usually contain the text 'Anonymous' and ' No.12345'
            post = session.query(Post).filter_by(image_id=file.id).first()
            targets_data = {'gen': '0',
                            'post_id': post.id,
                            'orig_post_title': post.title,
                            'orig_post_body': post.body
                            }
            notification = Notification(title='Review this',
                                        user_id=1,
                                        author_id=post.user_id,
                                        url=post.slug,
                                        notif_type=NOTIF_REPORT,
                                        subtype='post_with_suspicious_image',
                                        targets=targets_data)
            session.add(notification)
            session.commit()

The curious thing here, apart from there being both an environmental variable and site setting for this, is the toxic_community variable. This seems to be a renaming of the low_quality field Piefed applies to communities, which are just communities with either memes or shitpost in their name.

You also don't get social credits docked for this.

this post was submitted on 28 Jan 2026
11 points (100.0% liked)

Fediverse

39067 readers
45 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, Mbin, etc).

If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!

Rules

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration)

founded 2 years ago
MODERATORS