29
submitted 1 month ago* (last edited 1 month ago) by irmadlad@lemmy.world to c/selfhosted@lemmy.world

LOL Not really, but boy it has been a day. Started at 7:00 am and I finally resolved (?) the issue. In fact I've got through every last bit of my network, and at this point in the evening, I actually don't have a solid reason why the issue was present. Something in my VPN settings glitched, or something got triggered on pFsense and got hung up....something, something with Tailscale. It wasn't CLoudflare this time. LOL

You ever do so much to a problem that when you 'fix' it, you have no real idea what the fix truly was? You ever have a problem and find all the shit you cobbled together in the name of 'just get it running and back online'? I did, and decided that I would fix that shit too. It took all flippin' day.

You guys that do this for a living....I salute you! jebus crispies!

ETA: 8 bells and all's well today.

top 17 comments
sorted by: hot top controversial new old
[-] user224@lemmy.sdf.org 23 points 1 month ago

Touch it until it works, then never again while it still does.

[-] i_stole_ur_taco@lemmy.ca 16 points 1 month ago

“So what was the problem in the end?”

“Man, I don’t fucking know.”

  • me, every goddamn time
[-] Zanathos@lemmy.world 7 points 1 month ago

It's always DNS

[-] SnotFlickerman@lemmy.blahaj.zone 11 points 1 month ago* (last edited 1 month ago)

When you do it for work, you log what you have changed each time you make a change to try to fix it, and you log what you revert, so you can keep track of what you have tried, what worked, and what didn't and have a clearer idea of what the solution was.

Sometimes it really does take a while to nail down though, and sometimes it isn't entirely clear why what worked worked. Especially if you're a junior network engineer without as much experience.

[-] umbrella@lemmy.ml 1 points 1 month ago* (last edited 3 weeks ago)
[-] RamRabbit@lemmy.world 5 points 1 month ago* (last edited 1 month ago)

I hate, hate, hate when I fix something and I don't know why the fix worked (or what the fix even was...). I want my suffering to result in something learned so it doesn't happen again.

[-] corsicanguppy@lemmy.ca 2 points 1 month ago

This. If I pay the cost in frustration and anguish and soul-searching and demanding justice from an uncaring god, I want some thing for it. I want documentation. I want my lessons learned from the post incident review. I want something I can hack into mgmtConfig to make sure nothing else will do that too.

Struggling for no payoff is the absolute worst thing.

[-] possiblylinux127@lemmy.zip 2 points 1 month ago

I had bizarre DNS issue I could not figure out. It ended up being that I turned on hardware routing/NAT on my OpenWRT box and then forgot about it

[-] Tolookah@discuss.tchncs.de 2 points 1 month ago

I understand.

I learned again for the nth time that home assistant doesnt like refreshing my cert, and I can't go to the site to refresh the cert unless it has a valid cert...

Maybe I'll fix it tomorrow. It's valid again now.

[-] funkajunk@lemmy.world 4 points 1 month ago

Why not use a reverse proxy?

[-] 4am@lemmy.zip 3 points 1 month ago

Yeah I’ve got home assistant, a thing built for automating, but I leave that shit to certbot lol

[-] frongt@lemmy.zip 2 points 1 month ago

Sometimes the problem isn't on your end. The server might be having issues, or your ISP. Have to rule those out too.

[-] scrubbles@poptalk.scrubbles.tech 2 points 1 month ago

My mind went to this one

[-] dotslashme@infosec.pub 1 points 1 month ago

Man, I know that feeling. One thing that helped me better deal with issues like this, was to have a changelog. Basically I write down what a setting was, what I changed it to and a reason. If something goes wrong, I can at least undo what changes I've made and see if it helps. It's not perfect, but it might shave some hours off a RCA.

[-] Gobo@lemmy.world 0 points 1 month ago* (last edited 1 month ago)

Sometimes the fix has been done but the effect takes a while. For a cache to age out or a change to propogate. It all depends on what you are working with/on. Or you made a change but forgot to restart a specific service.

Meanwhile even though you did a fix correctly and aren't aware of it, since it doesn't seem to work you change something else and break it again inadvertently.

[-] irmadlad@lemmy.world 0 points 1 month ago

Note to self: Scan lab for hidden cameras

this post was submitted on 23 Nov 2025
29 points (96.8% liked)

Selfhosted

53973 readers
69 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

  7. No low-effort posts. This is subjective and will largely be determined by the community member reports.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS