60
submitted 1 month ago* (last edited 1 month ago) by plantteacher@mander.xyz to c/scicomm@mander.xyz

The ACM.org website published the work of a team at Carnegie Mellon (#CMU) which was said to include source code. Then the code was omitted from the attached ZIP file, which only contained another copy of the paper. I asked the lead researcher (a prof) for the code and was ignored. Also asked the other researchers (apparently students), who also ignored the request. The code would have made it possible to reproduce the research and verify it. ACM ~~also ignored my request and~~ also neglected to fix the misinfo (the claim on the page that source code is available). Correction: ACM replied and tried to find the missing code but then just gave up.

It seems like this should taint the research in some way. Why don’t they want people reproducing the research? If the idea is that scientific research is “peer reviewed” for integrity, it seems like a façade if reviewers don’t have a voice. Or is there some kind of 3rd party who would call this out?

you are viewing a single comment's thread
view the rest of the comments
[-] jatone@lemmy.dbzer0.com 13 points 1 month ago

Provide a link to the paper

[-] plantteacher@mander.xyz 4 points 1 month ago
[-] jatone@lemmy.dbzer0.com 3 points 1 month ago

its from 2016. I doubt they have the code anymore. 🤷

[-] plantteacher@mander.xyz 2 points 1 month ago

They could try to say that but I doubt people would believe it.

Who throws away their own code particularly when it’s not junky commercial code but code their heart and soul was behind on a non-profit project? I keep my old code around if anything just to be able to search it to re-teach myself coding and design tips I forgot about. This code backs their research which they may need to refer to when a prospective employer asks for detail on how they executed the study.

[-] jatone@lemmy.dbzer0.com 2 points 1 month ago

Thats a you decision. Many people dont actually care about their phd or research studies. And this particular one looks very throw away.

this post was submitted on 04 Nov 2024
60 points (100.0% liked)

Science Communication

892 readers
1 users here now

Welcome to c/SciComm @ Mander.xyz!

Science Communication



Notice Board

This is a work in progress, please don't mind the mess.



About

Rules

  1. Don't throw mud. Be kind and remember the human.
  2. Keep it rooted (on topic).
  3. No spam.


Resources

Outreach:

Networking:



Similar Communities


Sister Communities

Science and Research

Biology and Life Sciences

Plants & Gardening

Physical Sciences

Humanities and Social Sciences

Memes

founded 2 years ago
MODERATORS