710

submitted 10 months ago by wise_pancake@lemmy.ca to c/programmer_humor@programming.dev

49 comments fedilink hide all child comments

So today I discovered that there's a cron job that holds non-reproducible state that died, and now our system is fucked.

The cron job doesn't live inside any source control. This morning it entered a terminal state, and because it overwrites its state there's no way to revert it.

I'm currently waiting for the database rollback and have rewritten it in a reproducible/idempotent way.

you are viewing a single comment's thread
view the rest of the comments

[-] wise_pancake@lemmy.ca 168 points 10 months ago

What's extra frustrating is the previous guy did create a git repo of these types of hacks, but this one doesn't live in it for no discernible reason.

[-] Colloidal@programming.dev 141 points 10 months ago

Job security

[-] wise_pancake@lemmy.ca 117 points 10 months ago

He does charge a consulting fee to "fix" these issues

Almost all of them are dumb shit like this, where something is built in super hacky and dumbass ways.

[-] blarth@thelemmy.club 103 points 10 months ago

It’s his kill switch and he forgot to check in.

[-] peregrin5@lemm.ee 59 points 10 months ago* (last edited 10 months ago)

Smart man. This is how we fight being replaced by AI.

[-] Agent641@lemmy.world 19 points 10 months ago

Judgement day postponed indefinitely due to "Object reference not set to an instance of an object"

[-] kiagam@lemmy.world 2 points 10 months ago

I don't know why but this is the first time I read this phrase and it actually makes sense.

I knew exactly what it meant before, but it didn't make sense until now

[-] Stanley_Pain@lemmy.dbzer0.com 14 points 10 months ago

Super hacky and dumb? Sign me up 😂

[-] swab148@lemm.ee 8 points 10 months ago

Me running all my services in tmux

[-] Sherry@programming.dev 4 points 10 months ago

that might be a stupid question, but why would you running all services in tmux be a bad idea? a co-worker of mine is doing exactly that right now, which is why I'm asking.

[-] swab148@lemm.ee 4 points 10 months ago

It's not horrible, like it'll do the job just fine, it's just probably a better idea to use systemd and like, containers and whatnot, but I couldn't be arsed to fiddle with all that for Jellyfin, caddy reverse proxy, and two modded Minecraft servers, so shell scripts and tmux won the day. It takes a little extra time to restart everything after an update, and maybe I'll get the motivation to do things "correctly™" one day, but today is not that day.

[-] mosiacmango@lemm.ee 6 points 10 months ago* (last edited 10 months ago)

Use the tmux resurrect plugin. It will restore your tmux session to its previous state after a restart, including programs if you like.

You can put off doing things "correctly™" even longer.

[-] whats_all_this_then@programming.dev 6 points 10 months ago

The "here's how you keep doing this poorly but more efficiently" energy on display here is a refreshing change of pace from the usual "here's how you do this correctly" crap peddled by normies (including me). You have my respect.

[-] mosiacmango@lemm.ee 4 points 10 months ago

If you're going to do something wrong, do it wrong right.

[-] Sherry@programming.dev 2 points 10 months ago

thank you very much for the detailed response :)

[-] qaz@lemmy.world 2 points 10 months ago* (last edited 10 months ago)

They're all gone when you restart
It doesn't properly deal with logging
You can't set up dependencies between services but that doesn't matter due to point 1

I recommend using systemd services and/or docker compose instead. systemd services are files that describe which program / script to run and when (like after networking is active or after a certain other service is loaded).