90
BadWebsiteBlocklist: A blocklist I made that removes spam & misleading websites from search results (github.com)
submitted 2 months ago* (last edited 2 months ago) by popcar2@programming.dev to c/opensource@programming.dev
8 comments fedilink hide all child comments

Much like everyone else, I got fed up with search engines. So I decided to make a giant blocklist that cleans up garbage search results!

I browsed other blocklists and wasn't very satisfied from what exists now; the goal of this one is to be super organized and transparent, explaining why each site was blocked via issues. Contributions welcome!

Even though around 100 domains are blocked so far, I already noticed a big improvement in casual searches. You'd be surprised how some AI generated websites can dominate the #1 page on DuckDuckGo.

top 8 comments
sorted by: hot top controversial new old
[-] Semi_Hemi_Demigod@lemmy.world 9 points 2 months ago

I’d love a way to integrate this with Whoogle or SearX

[-] popcar2@programming.dev 9 points 2 months ago* (last edited 2 months ago)

I think both of them would have a way to filter domains if you're self-hosting. The blocklist uses simple regex so you can probably copy-paste the blocklist straight into your filters.

[-] Gullible@sh.itjust.works 7 points 2 months ago

[-] GoOnASteamTrain@lemmy.ml 5 points 2 months ago

Thank you for making this! It already is improving using DDG! :) The number of times I've given up searching because of AI slop and bad links in the past month has been surprising, so this is really nice to have :)

[-] kitnaht@lemmy.world 3 points 2 months ago* (last edited 2 months ago)

Will this "infinite scroll" something like Google and inline the results so the result page doesn't end up looking like a single entry for really gnarly searches?

I can imagine searching for something like 'baked bread' and getting more AI fluff than good results, enough where you might have to trod to a second page.

And I'm lazy.

[-] popcar2@programming.dev 5 points 2 months ago

I don't think so, it'll just remove the bad results and you'll have to click next page yourself. Technology has its limits.

[-] Lost_My_Mind@lemmy.world 4 points 2 months ago

Click to the next page??? Did you miss the part where he's lazy?

[-] isles@lemmy.world 2 points 2 months ago

Thanks for your work and I appreciate your efforts in transparency on why something is blocked!

this post was submitted on 14 Jan 2025
90 points (100.0% liked)

Opensource

2357 readers
53 users here now

A community for discussion about open source software! Ask questions, share knowledge, share news, or post interesting stuff related to it!

CreditsIcon base by Lorc under CC BY 3.0 with modifications to add a gradient

⠀

founded 2 years ago
MODERATORS
pylapp@programming.dev