WhyYesZoidberg ,

/me cries in open stack and no online disk resizing

kowcop ,

Sack both the capacity management and the reporting & analytics teams

MelodiousFunk ,
@MelodiousFunk@kbin.social avatar

I bet at one time they had a functional threshold alerting system. Then someone missed something (because they're human) and management ordered more alerts "so it doesn't happen again." Wash, rinse, repeat over the course of years (combined with VM sprawl and acquiring competitors) until there's no semblance of sanity left, having gone far past notification fatigue and well into "my job is just checking email and updating tickets now." But management insists that all of those alerts are needed because Joe Bob missed an email... which there are now exponentially more of... and the board is permanently half red anyway because the CTO (bless his sociopathic heart) decreed that 80% is the company standard for alerts and a bunch of stuff just lives there happily so good luck seeing something new.

...I was not expecting to process that particular trauma this evening.

MrPoopyButthole ,
@MrPoopyButthole@lemmy.world avatar

I had a call recording server crash 2 days ago and when inspected I found some jackass had partitioned the drive into 50G and 450G partitions and then never used the 450G one. The root partition had 20kb free space remaining. The DB was so beyond fucked I had to create a new server.

kylian0087 ,

I hope their where at least backups… so rebuild and restore.

Pons_Aelius , (edited )

$100 says there is a series of emails sent by a sysadmin/DBA over the past couple months warning about this issue in explicit detail and its increasing urgency, that have been ignored.

The person sending the emails will still get chewed out because they failed to make the higher ups realise this is a real problem.

Faceman2K23 ,
@Faceman2K23@discuss.tchncs.de avatar

Of course, to get anything done by corporate japan you need to put it in writing and fax it.

Toad_the_Fungus ,

my $100 goes to them storing so much of their customers' personal data on the servers

Pons_Aelius ,

While that story is shitty I doubt the manufacturing control DB and customer data DB are anywhere near each other.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • random
  • [email protected]
  • All magazines
    •