481
submitted 4 months ago by silence7@slrpnk.net to c/technology@lemmy.world
you are viewing a single comment's thread
view the rest of the comments
[-] Aceticon@lemmy.world 23 points 4 months ago* (last edited 4 months ago)

Having worked in making software for almost 3 decades, including in Finance both before and after the 2008 Crash, this blind reliance on algorithms for law enforcement and victim protection scares the hell out of me.

An algorithm is just an encoding of whatever the people who made it think will happen: it's like using those actual people directly, only worse because by need an algorithm has a fixed set of input parameters and can't just ask more questions when something "smells fishy" as a person would.

Also making judgements by "entering something in a form" has a tendency to close people's thinking - instead of pondering on it and using their intuition to, for example, notice from the way people are talking that they're understating the gravity of the situation, people filling form tend to mindlessly do it like a box-ticking exercise - and that's not even going into the whole "As long as I just fill the form my ass is covered" effect when the responsability is delegated to the algorithm that leads people to play it safe and not dispute the results even when their instincts say otherwise.

For anybody who has experience with modelling, using computer algorithms within human processes and with how users actually treat such things (the "computer says" effect) this shit really is scary at many levels.

this post was submitted on 18 Jul 2024
481 points (96.5% liked)

Technology

59670 readers
1939 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS