We’re sorry for the issues syncing Proclaim on Sunday. You can view a timeline of the incident here: https://status.faithlife.com/incidents/0nzd027vswdf
What happened? Improvements to Proclaim Sync had been rolling out over the last few weeks, starting on July 1st, and successfully served traffic through the prior weekend and Wednesday.
On July 6th, we made the cut-over fully to the new system and provided a fallback in case of issues. We successfully served traffic through our Wednesday peak and things looked fine coming into Sunday.
On Sunday, around 6:28 AM Pacific time, Proclaim Sync was overloaded and not able to respond. This resulted in long syncs or the red sync icon in Proclaim.
By 6:43 AM, we implemented the fallback and traffic was being served again. Unfortunately, the large backlog of requests now overwhelmed other parts of our system, causing the recovery to take longer than anticipated.
By 7:45 AM, Proclaim Sync was back to acceptable performance levels.
What are we doing to prevent this from happening again? We have scheduled maintenance to improve our fallback recovery time. We have also fine-tuned the updates to Proclaim Sync and will continue to serve traffic from both the old system and the new, until we are confident the new system works correctly.
We apologize to those affected during this window and for the impact it had on your staff, volunteers, and congregation.
Note: Proclaim should not have been crashing during this time. Your presentations are downloaded to each computer and should have been fully accessible. If you did experience crashing, please ensure your Proclaim is up-to-date and submit an issue via the Help menu. This will send your logs to our CS team so we can investigate what happened in your individual cases.
