117
submitted 1 month ago by jordanlund@lemmy.world to c/world@lemmy.world

We've had some trouble recently with posts from aggregator links like Google Amp, MSN, and Yahoo.

We're now requiring links go to the OG source, and not a conduit.

In an example like this, it can give the wrong attribution to the MBFC bot, and can give a more or less reliable rating than the original source, but it also makes it harder to run down duplicates.

So anything not linked to the original source, but is stuck on Google Amp, MSN, Yahoo, etc. will be removed.

you are viewing a single comment's thread
view the rest of the comments
[-] jordanlund@lemmy.world -5 points 1 month ago

Not seeing any suggestions there to improve the bot, but lots of bannable attacks on other users, mods and admins.

So I'll say it again, as I've told other people complaining, I'm open to making the bot better. If you have suggestions, I'd love to hear them.

  1. It has to be automated, which means accessible through an API.

  2. It has to be no/low cost. Lemmy.World doesn't have a budget for this. We met with an MBFC alternative, they wanted 6 figures. HARD no.

[-] PhilipTheBucket@ponder.cat 16 points 1 month ago

How much are you paying for the MBFC API? The page says it isn't free. I'll give you an API endpoint which will check sources against https://en.wikipedia.org/wiki/Wikipedia:Reliable_sources/Perennial_sources, if you pay me half of whatever you were paying MBFC previously. That list is quite a lot better than relying on MBFC.

I already scraped the list. It'll take around an hour for my script to finish going down the sources and assigning web sites to each one, but I can have a working API endpoint for you tomorrow morning. I can do the bot part also, if you prefer. That's probably easier than making a new endpoint and hooking it to a bot and debugging the connection and all.

Like I said, I think the idea that readers won't be able to determine that Breitbart is unreliable is missing a pretty big elephant in the misinformational room. If the issue that's causing you to keep MBFC is finding a better source that's programmatic, though, then solving that is almost trivially easy and at least seems like some kind of step forward.

[-] Rooki@lemmy.world 5 points 1 month ago

MBFC API is free as they gave us access for us as a Non Profit.

We already had in mind adding these sources to our bot but we didnt had the time and knowledge how to scrape that. Personally i would like to host it on our own server so that we dont require you to use your own money just for one bot, in what programming language did you write it?

Thanks a lot!
Rooki

[-] nmtake@lemm.ee 8 points 1 month ago

Since it's a MediaWiki page you can get Markdown source of the page with appending action=raw query to the URL.

load more comments (10 replies)
load more comments (12 replies)
load more comments (40 replies)
this post was submitted on 10 Oct 2024
117 points (85.9% liked)

World News

39021 readers
1441 users here now

A community for discussing events around the World

Rules:

Similarly, if you see posts along these lines, do not engage. Report them, block them, and live a happier life than they do. We see too many slapfights that boil down to "Mom! He's bugging me!" and "I'm not touching you!" Going forward, slapfights will result in removed comments and temp bans to cool off.

We ask that the users report any comment or post that violate the rules, to use critical thinking when reading, posting or commenting. Users that post off-topic spam, advocate violence, have multiple comments or posts removed, weaponize reports or violate the code of conduct will be banned.

All posts and comments will be reviewed on a case-by-case basis. This means that some content that violates the rules may be allowed, while other content that does not violate the rules may be removed. The moderators retain the right to remove any content and ban users.


Lemmy World Partners

News !news@lemmy.world

Politics !politics@lemmy.world

World Politics !globalpolitics@lemmy.world


Recommendations

For Firefox users, there is media bias / propaganda / fact check plugin.

https://addons.mozilla.org/en-US/firefox/addon/media-bias-fact-check/

founded 1 year ago
MODERATORS