61

From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Models https://aclanthology.org/2023.acl-long.656.pdf

you are viewing a single comment's thread
view the rest of the comments
[-] stefenauris@pawb.social 16 points 1 year ago

It's the end result of training your AI on mountains of biased human thoughts

[-] 0110010001100010@beehaw.org 2 points 1 year ago

Not trying to be a smartass, but what's the alternative?

[-] FaceDeer@kbin.social 8 points 1 year ago

Does there have to be one? It'd be nice if there were, of course, but this is currently the only way we know of to make these AIs.

[-] RickRussell_CA@beehaw.org 4 points 1 year ago

Well, you can focus on rule-based/expert system style AI, a la WolframAlpha. Actually build algorithms to answer questions that are based on scientific fact and theory, rather than an approximated consensus of many sources of dubious origin.

[-] parlaptie@feddit.de 3 points 1 year ago

Ooo, old school AI 😍

In our current cultural consciousness, I'm not sure that even qualifies as AI anymore. It's all about neutral networks and machine learning nowadays.

[-] stefenauris@pawb.social 4 points 1 year ago

I guess shoving an encyclopedia into it. I'm not sure really, it is a good point. Perhaps AI bias is as inevitable as human bias...

[-] interolivary@beehaw.org 8 points 1 year ago

Despite what you might assume, an encyclopedia wouldn't be free from bias. It might not be as biased as, say, getting your training data from a dump of 4chan, but it'd absolutely still have bias. As an on-the-nose example, think about the definition of homosexuality; training on an older encyclopedia would mean the AI now thinks homosexuality is a crime.

[-] RickRussell_CA@beehaw.org 4 points 1 year ago

And imagine how badly most encyclopedias would reflect on languages and cultures other than the one that made them.

[-] radix@lemm.ee 2 points 1 year ago

The alternative is being extremely careful about what data you allow the LLM to learn from. Then it would have your bias, but hopefully that'll be a less flagrantly racist bias.

this post was submitted on 07 Aug 2023
61 points (100.0% liked)

Technology

37703 readers
288 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS