737
you are viewing a single comment's thread
view the rest of the comments
[-] RussianBot8453@lemmy.world 79 points 15 hours ago

I'm a data engineer that processes 2 billion row 3000 column datasets every day, and I open shit in Excel with more than 60k rows. What the hell is this chick talking about?

[-] person420@lemmynsfw.com 20 points 14 hours ago

Some interesting facts about excel I learned the hard way.

  1. It only supports about a million or so rows
  2. It completely screws up numbers if the column is a number and the number is over 15 digits long.

Not really related to what you said, but I'm still sore about the bad data import that caused me days of work to clean up.

[-] Mniot@programming.dev 8 points 12 hours ago

The row limitation seems, to me, like an actually-good thing. Excel is for data where you might conceivably scroll up and down looking at it and 1M is definitely beyond the ability of a human even to just skim looking for something different.

An older version of Excel could only handle 64k rows and I had a client who wanted large amounts of data in Excel format. "Oh sorry, it's a Microsoft limitation," I was thrilled to say. "I have no choice but to give you a useful summarization of the data instead of 800k rows (each 1000 columns wide) of raw data."

[-] frezik@midwest.social 1 points 36 minutes ago* (last edited 35 minutes ago)

Some time ago, I heard a story of CS and Econ professors having lunch together. The Econ professor was excited that Excel was going to release a version that blew out the 64k row limit. The CS professor nearly choked on his lunch.

Dependence on Excel has definitely caused bad papers to be published in the Econ space, and has had real world consequences. There was a paper years ago that stated that once a country's debt gets above 120% of GDP, its economy goes into a death spiral. It was passed around as established fact by the sorts of politicians who justify austerity. Problem was, nobody could reproduce the results. Then an Econ undergrad asked the original author for their Excel spreadsheet, and they found a coding error in the formulas. Once corrected, the conclusion disappeared.

load more comments (1 replies)
load more comments (4 replies)
this post was submitted on 16 Mar 2025
737 points (98.9% liked)

Programmer Humor

21568 readers
2250 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 2 years ago
MODERATORS