We have identified the issue impacting system performance and have resolved it. We are still investigating for the root cause, but we’re happy to report our platform is stable once again!
We are continuing to investigate the issue. Some details is you’re curious:
Beginning yesterday we began seeing memory spikes on our web servers without any changes prompted from our end. This results in failed requests and erratic behavior from retried processes (like template section double-ups).
This could be the result of external sources and/or bad actors, given our investigation so far and what we know. We are taking steps to alleviate the issue, spinning up additional servers and changing performance variables to run at lower memory thresholds. These will hopefully keep the system operational until we can unearth the root cause and add countermeasures to prevent it.
We are seeing additional server performance issues this morning. We are currently investigating.
Systems are now back to normal. We are monitoring the situation.
Currently experiencing some issues with our web servers failing to respond to some requests. We are investigating the cause.