Home Improvement (Bort additions)

rm -rf *

1 Like

Idk what that means but im taking it as disrespect

1 Like

Iā€™m probably not alone, but still not seeing heart activity. Iā€™ll get a notification that I have received one, but canā€™t see it in the thread. Also, cannot see who else has ā€˜heartedā€™ posts which I have when I try to see that. Love you @stroot & thanks for all the hard work :+1:

8 Likes

Same and itā€™s giving me serious dopamine withdrawals
IMG_0641

5 Likes

Going to take some time to investigate today. Thanks for your patience

7 Likes

image

3 Likes

Is @stringz gonna fix the bort or nah?

@discobot fortune

2 Likes

:crystal_ball: My reply is no

5 Likes

Fucking knew it. Youā€™re a punk btw

4 Likes

Hi! To find out what I can do, say @discobot display help.

EAD

1 Like

:crystal_ball: Most likely

2 Likes

@stringz Remind me, is the Discourse commit at the latest and the docker commit rolled back? Wouldnā€™t this issue be something in the Discourse repo itself?

Timeline:

  • Upgrade to latest discourse tests-passing release
  • the post action 500s start
  • logs suggest redis ran out of memory (actually this has me suspicious now that something with asset caching and/or background jobs is causing the post likes not to propogate on frontend)
  • restart container
  • all hell breaks loose, container wont restart, database crashes, etc
  • figure out I can actually get the container to restart by checking out a specific commit in the docker_manager repo
  • ember frontend crashing on that commit, but application up and running
  • switch from tests-passing to a stable release
  • app actually works (sans like weirdness and discobot)
  • stop touching it for a bit because of stress

Nothing particularly interesting or frequent in the app error logs. I suspect its just compatibility with the current ember commit (3.3) and the way things are with our backend systems. I hope moving to tests passing will fix things

plans moving forward:

  • upgrade all system binaries, integrate better monitoring and metrics on resource usage
  • attempt rolling forward to tests-passing once docker_manager is up to date
  • actually maybe throw more RAM at this if redis is the issue smh :man_facepalming:
  • reimplement plugins once things are stable
3 Likes

Thatā€™s a phenomenal summary!

Are there any jobs in /sidekiq that are taking over Redis?

I dont know right now. Currently life is super stressful. I only stepped outside of my house once the past week, and I plan to go outside today and use my body.

make a list of questions, and I will triage them in the troubleshooting process incase there are things I am missing

1 Like

Love you dog. Go outside, Bortā€™s will survive without its likes for a while

3 Likes

Get Outside

3 Likes

:crystal_ball: My reply is no

3 Likes

Did discobot just turn self aware?

2 Likes