May 20, 2018 2:27 PM, "Alexander von Gluck IV" <kallisti5@xxxxxxxxxxx
(mailto:%22Alexander%20von%20Gluck%20IV%22%20<kallisti5@xxxxxxxxxxx>)> wrote:
May 20, 2018 11:48 AM, "Alexander von Gluck IV" <kallisti5@xxxxxxxxxxx
(mailto:%22Alexander%20von%20Gluck%20IV%22%20<kallisti5@xxxxxxxxxxx>)> wrote:
Good morning,
Gerrit began throwing 500 errors in it's UI this morning. After checking the
git repositories (they are still valid) I decided to restart the Gerrit
application.
Gerrit is now crashing OpenJDK on bootup. For the lovely backtrace see
https://pastebin.com/2cRgTypp ;(https://pastebin.com/2cRgTypp)
I'm looking at updating to OpenJDK 1.9 or 1.10 from our OpenJDK 1.8 to see if
it helps.
Stand-by
-- Alex
Everything is now down.
I was able to eliminate Gerrit as a potential cause of this issue by shutting
down all containers + docker, and
cloning the git repo from GitHub. I encountered the same problem when doing a
"git gc" on the server.
Cloning the same GH repo on my desktop and doing a "git gc" resulted in no
problems.
I began running through some system upgrades while the server was down and
encountered a backtrace from yum.
At this point i'm 85% sure we have a bad stick of memory. I've reached out to
Hetzner and requested a ram test + swap.
I'll keep everyone updated while this RAM Test + Swap is underway.
http://status.haiku-os.org ;(http://status.haiku-os.org/)
All services have been restored and tested functional (besides hooks, those are
always breaking :-|)
The memory replacement seems to have solved the issue.
-- Alex
