245
submitted 10 months ago by Rapidcreek@lemmy.world to c/news@lemmy.world
you are viewing a single comment's thread
view the rest of the comments
[-] Maggoty@lemmy.world 1 points 10 months ago

No I'm angry they've put arbitrary limits on how they collect and give data. And over specifying is a form of obfuscation. You say you like tiny little slices pre made but any competent database query system will create any slice you want in seconds. Instead you're reduced to searching for the basic information among thousands of these slices. Or trying to put each slice together to stitch the data together.

This is not neglect, that would look like an abandoned data set or a data set with nothing but a 90's query. This is not benevolence, that would look like the CDCs query system. This is by design. Someone made the system shitty for anyone who wants to work outside their pre-made crumbs of data. What you're seeing isn't someone who wants pretty little graphs. It's someone who wants a million lines of data in a hundred tables with a query system that's worth a damn.

[-] Lauchs@lemmy.world 0 points 10 months ago

I've never had cause to play with the cdc data but from what I'm looking st in wisqars, it seems lile you're limited to a si goes query at a time and to .csv output, so are you manually putting those hundred tables together or is there another site or...?

For the bls, as with most organizations that do this sort of thing, there's a handy API so you** can easily** pull all the data and tables you'd like. Also, of course, they have most of their data available in large, admittedly flat, data files for the odd cross section of people who want to get down and dirty with the data but don't have the skills to pull JSON requests. Simply follow the original link I gave you, select all the groups/data of interest and to format options.

It really seems like you're just searching for a reason to be angry. At first you were railing because as far as I can tell, you blamed the BLS for free news sites being clickbaity. Then were raging about the unemployment number because you didn't understand how people were counted. Then got angry about having trouble finding the most basic info and when it was shown, are now angry it doesn't come in database format???

[-] Maggoty@lemmy.world 1 points 10 months ago

You don't need to put one together, they let you query theirs. That's the point. And "program a front end for our API" isn't an answer either. That's literally the opposite of making data easily available.

And then you suggest clicking hundreds of slices, requiring me to effectively create my own database. So now we're at create the back end and front end. You're getting less accessible, not more.

I never blamed BLS for CNBC's shittiness. Those were two separate things. And yes the arbitrary cut offs in data collection is a giant fucking problem. Not counting the bad thing so you can ignore it is one of the oldest ways governments use to ignore things. Such as the way we count unemployment, the 100,000 cap in income baskets, "core" inflation instead of real inflation, household median instead of individual median, etc, etc.

We're not going to have a clear picture of the real economy until we get rid of these diet statistics that serve to paint a false picture.

[-] Lauchs@lemmy.world 0 points 10 months ago

And then you suggest clicking hundreds of slices, requiring me to effectively create my own database.

No one suggested anything of the sort. I have no idea how "Simply follow the original link I gave you, select all the groups/data of interest and to format options." translates to hundreds of clicks. Make a click per group of interest (Black women, Hispanic men etc) and export.

Should you need to dig deeper, the BLS makes almost everything available at a high level of detail, e.g., you could drill down to Women in Seafood processing over time. I get that it can be daunting, but that's kind of the tradeoff; they give you access to way more info than you could need but it is up to you to comb through it.

It's not as pretty as Wisqars because this is for people who know what they are doing and looking for. If you are in school, you could ask a librarian to help you and they may be of assistance.

Such as the way we count unemployment

Again, read the definition and tell me specifically what you dislike.

It really just seems like you're insistent on being angry at the BLS because you didn't know how to find the data. Now that you've been shown the data, you don't have the maturity to admit "oh, cool, I didn't know you could grab it that easily."

[-] Maggoty@lemmy.world 1 points 10 months ago

Lmao. Wisqars isn't for grown ups. Oh dude. Hold on lemme go tell a bunch of bio phds that. It'll be good for laughs.

Having a more fucked up system isn't some badge of honor. It's not a mark of being better or smarter. It's just laziness, and that's the best interpretation. It's absolutely a case study for obfuscation by inundation.

You haven't shown any easy way to access the information. It's a fucked up search bar that throws hundreds, if not thousands, of slices of information at you. And God forbid you want historical data.

I was just screwing around with it again, to make sure you're actually gaslighting me and the reports it does give have columns with generic names such as "label" and "value". Where label was a date and value was the total number of non farm workers. This is ridiculous. And go look at the site on mobile, just once. You won't need to do it twice. You cannot easily find critical information; the front end itself is a F grade high school project; and the mobile formatting is actually non-existent.

So again. That's not a badge of honor. That's a failure. I want my tax money back.

[-] Lauchs@lemmy.world 0 points 10 months ago

Lol, mobile? Really? The BLS should configure their website in case you need to assess the state of the economy on the go?!?

Just... Wow. This is about the silliest possible take. I don't remember the last time I read anything quite so utterly ridiculous.

Thank you, I now have the ultimate reference when talking about the stupidity of internet disagreements.

[-] Maggoty@lemmy.world 1 points 10 months ago

So you can only access data on desktop computers? That's really the gatekeeping line you're drawing?

[-] Lauchs@lemmy.world 0 points 10 months ago

In terms of BLS priorities? Yeah, ignoring mobile seems pretty reasonable.

"Quick, I need to see seasonally adjusted farmworkers by gender while I'm in line for groceries! For reasons!!!"

Lol

[-] Maggoty@lemmy.world 1 points 10 months ago

Sure. That's the exact scenario...

[-] Lauchs@lemmy.world 1 points 10 months ago

Okay, I'll bite because this is too funny. What is your scenario where you need detailed, tabular American labour and economics primary source data on the go and google won't suffice?

[-] Maggoty@lemmy.world 1 points 10 months ago

When I'm sitting on the shitter talking to you. Or any time I'm traveling and don't want to bring a whole ass laptop? Formatting for mobile isn't exactly hard. You're not asking for months of work. And data about our economy is exactly the kind of data that needs to be as open as possible.

[-] Lauchs@lemmy.world 0 points 10 months ago

I think this is what you are fundamentally misunderstanding. BLS data is for doing actual analysis and is designed people like me who actually work with data can easily grab and compare from a couple dozen highly specialized tables at once. They have tens of thousands of tables and datasets as they track literally the entire economy.

Their website does not and should not sacrifice that just so you can hunt down data while you poop. That's why I asked what sort of question requires primary source data rather than google. What question do you imagine answering on your phone that google couldn't handle? (Or, that the BLS' "top data" section couldn't handle?)

[-] Maggoty@lemmy.world 1 points 10 months ago

Oh only for the blessed? Everyone else doesn't matter? No one else deserves to know what's going on? When you could just hook up a report generator?

How are you okay with being spoon fed information instead of pulling your own reports if you're a researcher? Seriously I've never met a researcher who was happy to let other people slice their data. And all of this of defense of them not doing a bog standard query generator. They could still cut the crust off your bread for you. It's not an either/or situation. And it's certainly not the standard in any other academic field.

[-] Lauchs@lemmy.world 0 points 10 months ago

What serious researcher is doing said serious research on their phone!?!?! Are you high?

this post was submitted on 28 Dec 2023
245 points (94.2% liked)

News

23311 readers
2029 users here now

Welcome to the News community!

Rules:

1. Be civil


Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban. Do not respond to rule-breaking content; report it and move on.


2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.


Obvious right or left wing sources will be removed at the mods discretion. We have an actively updated blocklist, which you can see here: https://lemmy.world/post/2246130 if you feel like any website is missing, contact the mods. Supporting links can be added in comments or posted seperately but not to the post body.


3. No bots, spam or self-promotion.


Only approved bots, which follow the guidelines for bots set by the instance, are allowed.


4. Post titles should be the same as the article used as source.


Posts which titles don’t match the source won’t be removed, but the autoMod will notify you, and if your title misrepresents the original article, the post will be deleted. If the site changed their headline, the bot might still contact you, just ignore it, we won’t delete your post.


5. Only recent news is allowed.


Posts must be news from the most recent 30 days.


6. All posts must be news articles.


No opinion pieces, Listicles, editorials or celebrity gossip is allowed. All posts will be judged on a case-by-case basis.


7. No duplicate posts.


If a source you used was already posted by someone else, the autoMod will leave a message. Please remove your post if the autoMod is correct. If the post that matches your post is very old, we refer you to rule 5.


8. Misinformation is prohibited.


Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.


9. No link shorteners.


The auto mod will contact you if a link shortener is detected, please delete your post if they are right.


10. Don't copy entire article in your post body


For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.

founded 1 year ago
MODERATORS