tag:status.tithe.ly,2005:/historyTithe.ly Status - Incident History2024-03-28T11:40:17-07:00Tithe.lytag:status.tithe.ly,2005:Incident/203608822024-03-26T07:46:23-07:002024-03-26T07:46:23-07:00Delays in SMS delivery<p><small>Mar <var data-var='date'>26</var>, <var data-var='time'>07:46</var> PDT</small><br><strong>Resolved</strong> - Our SMS provider is reporting that messages are sending as expected at this point. Our teams will continue to monitor this to ensure there are no needed actions from our Engineers.</p><p><small>Mar <var data-var='date'>26</var>, <var data-var='time'>05:47</var> PDT</small><br><strong>Monitoring</strong> - Our SMS provider is reporting that they've solved the issue affecting SMS delivery and are seeing improvement. We will continue to monitor this.</p><p><small>Mar <var data-var='date'>26</var>, <var data-var='time'>05:41</var> PDT</small><br><strong>Investigating</strong> - Our teams are aware of an issue affecting SMS delivery (Tithely Messaging and text giving) due to an issue with our provider, Twilio. We are monitoring their response closely and will update here as needed.</p>tag:status.tithe.ly,2005:Incident/200987692024-03-06T07:00:56-08:002024-03-06T07:00:56-08:00Planned Maintenance: Text Giving and Messaging Numbers<p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>07:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>06:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>08:18</var> PST</small><br><strong>Scheduled</strong> - On March 6h from 6:00-7:00 PST, our Engineering teams will be performing maintenance on the process that allows for the generation of Text Giving and Tithely Messaging numbers. <br /><br />During this period it will not be possible to generate numbers for Text Giving or Tithely Messaging. We will share updates as the maintenance progresses on this page.</p>tag:status.tithe.ly,2005:Incident/201714972024-03-05T17:43:58-08:002024-03-05T17:43:58-08:00Issues downloading CSV files<p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>17:43</var> PST</small><br><strong>Resolved</strong> - We have confirmed that this is fully resolved.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>17:41</var> PST</small><br><strong>Monitoring</strong> - We've implemented a fix and are seeing that exports are working as expected now.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>16:58</var> PST</small><br><strong>Investigating</strong> - We are investigating an issue where downloading a CSV file is not working as expected in the Admin areas of Tithely.</p>tag:status.tithe.ly,2005:Incident/200049292024-02-16T19:37:51-08:002024-02-16T19:37:51-08:00Errors when attempting to login for Admins<p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>19:37</var> PST</small><br><strong>Resolved</strong> - This issue has been resolved!</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>19:34</var> PST</small><br><strong>Investigating</strong> - We are investigating an issue affecting logging in for Admins.</p>tag:status.tithe.ly,2005:Incident/199681402024-02-15T15:08:52-08:002024-02-15T15:08:52-08:00Issues with Recurring Giving processing time<p><small>Feb <var data-var='date'>15</var>, <var data-var='time'>15:08</var> PST</small><br><strong>Resolved</strong> - Our Engineering teams were able to confirm that everything was fully resolved related to this issue. Please let our teams know if you need any assistance!</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>15:05</var> PST</small><br><strong>Update</strong> - Our Engineering teams have continued the process on this issue to ensure that all affected gifts were charged as expected. <br /><br />There was a connected issue that arose that caused some recurring gifts to show a future date and this will be resolved as part of their work. This is simply showing an incorrect date and the gift was charged correctly.</p><p><small>Feb <var data-var='date'>12</var>, <var data-var='time'>13:46</var> PST</small><br><strong>Monitoring</strong> - Our Engineering team has implemented a solution for this trouble and we are monitoring closely.</p><p><small>Feb <var data-var='date'>12</var>, <var data-var='time'>09:25</var> PST</small><br><strong>Identified</strong> - Our Engineers have identified the cause of the problem and they're working to resolve it as well as to charge the subset of gifts that did not charge as expected. <br /><br />No action is needed from any customers related to this incident.</p><p><small>Feb <var data-var='date'>12</var>, <var data-var='time'>09:00</var> PST</small><br><strong>Investigating</strong> - Our Engineering teams are investigating an issue where some recurring gifts did not process as expected over the weekend. We will be sharing additional updates soon.</p>tag:status.tithe.ly,2005:Incident/198849952024-02-05T12:41:01-08:002024-02-05T12:41:01-08:00Issues with Recurring Giving<p><small>Feb <var data-var='date'> 5</var>, <var data-var='time'>12:41</var> PST</small><br><strong>Resolved</strong> - Our Engineering team was able to confirm that the issue affecting recurring giving was fully resolved.</p><p><small>Feb <var data-var='date'> 1</var>, <var data-var='time'>18:25</var> PST</small><br><strong>Monitoring</strong> - Our Engineering teams have deployed a fix and are continuing to monitor transactions to ensure they are going through as expected.</p><p><small>Feb <var data-var='date'> 1</var>, <var data-var='time'>08:50</var> PST</small><br><strong>Identified</strong> - Our Engineering teams have identified the root cause and are working to fully resolve this.</p><p><small>Feb <var data-var='date'> 1</var>, <var data-var='time'>06:16</var> PST</small><br><strong>Investigating</strong> - Our Engineering teams are working on an issue where a subset of recurring gifts have not processed as expected or are not reporting as expected.</p>tag:status.tithe.ly,2005:Incident/199146682024-02-05T11:26:46-08:002024-02-05T11:26:46-08:00Issues with accessing login pages<p><small>Feb <var data-var='date'> 5</var>, <var data-var='time'>11:26</var> PST</small><br><strong>Resolved</strong> - We are seeing that things have fully stabilized and the issues are resolved. Our Engineers will continue to monitor performance.</p><p><small>Feb <var data-var='date'> 5</var>, <var data-var='time'>11:20</var> PST</small><br><strong>Monitoring</strong> - We are continuing to see improvement in accessing login pages. We will continue to monitor this to ensure things continue to improve.</p><p><small>Feb <var data-var='date'> 5</var>, <var data-var='time'>10:56</var> PST</small><br><strong>Update</strong> - As a temporary workaround we are seeing that logging in with an emailed link is successful.</p><p><small>Feb <var data-var='date'> 5</var>, <var data-var='time'>10:46</var> PST</small><br><strong>Identified</strong> - Our Engineering teams have identified the problem and we are seeing some improvement in the ability to login</p><p><small>Feb <var data-var='date'> 5</var>, <var data-var='time'>10:31</var> PST</small><br><strong>Investigating</strong> - We are investigating an issue affecting logging in to Tithely accounts and will update shortly.</p>tag:status.tithe.ly,2005:Incident/199093982024-02-04T21:49:53-08:002024-02-04T21:49:53-08:00Issues signing in to Admin pages<p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>21:49</var> PST</small><br><strong>Resolved</strong> - We’re back! The Admin Experience should be up and running. Thanks for bearing with us.</p><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>21:18</var> PST</small><br><strong>Update</strong> - This issue appears to also be affecting some donors from being able to login to the new giving form. This would impact their ability to make a donation for any churches that are using the new giving form exclusively. The legacy giving form and the Tithely Giving App are unaffected.</p><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>21:00</var> PST</small><br><strong>Investigating</strong> - We are investigating troubles with being able to sign in to the Tithe.ly Admin pages with an error message that states "Sign In Failed: Invalid credentials." even though the credentials are correct.</p>tag:status.tithe.ly,2005:Incident/199084482024-02-04T18:35:34-08:002024-02-04T18:35:34-08:00Issues signing in to Admin pages<p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>18:35</var> PST</small><br><strong>Resolved</strong> - We’re happy to report that our Engineers have confirmed this is resolved.</p><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>18:22</var> PST</small><br><strong>Monitoring</strong> - We are seeing pages and logins work as expected now, however we are still monitoring.</p><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>17:48</var> PST</small><br><strong>Identified</strong> - Our Engineering teams have identified the source of the problem and they're working to resolve this now.</p><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>17:14</var> PST</small><br><strong>Update</strong> - Our Engineering teams are currently engaged and working to resolve the issue affecting logging in to Tithely admin pages.</p><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>17:02</var> PST</small><br><strong>Investigating</strong> - We are investigating troubles with Admin pages not loading.</p>tag:status.tithe.ly,2005:Incident/197585942024-01-23T20:00:21-08:002024-01-23T20:00:21-08:00Website Maintenance<p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>20:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>19:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>15:11</var> PST</small><br><strong>Scheduled</strong> - On Tuesday, January 23 at 7:00 Pacific time, we will be performing an important infrastructure upgrade for all custom website customers. This upgrade will take approximately one hour, and during this upgrade the website will not be available to visitors or Admins. <br /><br />There is no action needed from customers as this upgrade occurs. Thank you for your patience and allowing us to serve you!</p>tag:status.tithe.ly,2005:Incident/198066212024-01-23T07:59:30-08:002024-01-23T07:59:30-08:00Issues accessing Apps from Tithely Dashboard<p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>07:59</var> PST</small><br><strong>Resolved</strong> - Our Engineering team was able to fully resolve the trouble here. Thank you for your patience!</p><p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>06:38</var> PST</small><br><strong>Investigating</strong> - We are investigating reports of errors when attempting to access Apps from the Tithely Dashboard. This is not affecting the performance of the Apps, simply the access from the Tithely Dashboard.</p>tag:status.tithe.ly,2005:Incident/197180432024-01-15T17:18:03-08:002024-01-15T17:18:03-08:00Images showing on sites<p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>17:18</var> PST</small><br><strong>Resolved</strong> - Our Engineering team has confirmed that these images are connected the default images for the website product. They will still be working to resolve the issue allowing these default images to show unexpectedly, but we will be closing the incident and handling this through our bug process.</p><p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>16:43</var> PST</small><br><strong>Investigating</strong> - We are investigating an issue that is allowing other images to show on websites.</p>tag:status.tithe.ly,2005:Incident/196937282024-01-15T11:58:15-08:002024-01-15T11:58:15-08:00Sites: Issues with Newsletters and Sermon Series<p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>11:58</var> PST</small><br><strong>Resolved</strong> - We are happy to report that our Engineers were able to get this issue resolved quicker than expected! Newsletters and sermon series are again working as expected. If you notice any troubles please contact our Support team by visiting help.tithe.ly!</p><p><small>Jan <var data-var='date'>13</var>, <var data-var='time'>15:13</var> PST</small><br><strong>Update</strong> - Our Engineering teams have worked through the day and will be working tomorrow on this as well. There are no significant updates to share at this point.</p><p><small>Jan <var data-var='date'>12</var>, <var data-var='time'>18:25</var> PST</small><br><strong>Identified</strong> - Since a database update our Engineering teams have been working to resolve a few issues that are affecting sites customers. We are aware that customers are not able to add images to newsletters, and sermons are not able to be added to sermon series. <br /><br />Our Engineering teams will continue to work through this weekend on these issues and it is currently expected that this will be resolved Tuesday. Due to the length of time this will be present we are creating this incident as a way to assist in sharing updates.</p>tag:status.tithe.ly,2005:Incident/196818092024-01-11T17:14:38-08:002024-01-11T17:14:38-08:00Slow Site Performance<p><small>Jan <var data-var='date'>11</var>, <var data-var='time'>17:14</var> PST</small><br><strong>Resolved</strong> - Our Engineering teams have resolved the issue affecting slow page loads when initially loading websites. There are some other followup tasks still to be completed, however we are seeing this incident as being resolved.</p><p><small>Jan <var data-var='date'>11</var>, <var data-var='time'>14:46</var> PST</small><br><strong>Update</strong> - Our Engineering teams continue to work through any issues affecting websites and will through the evening hours. We will continue to provide updates as needed and/or relevant.</p><p><small>Jan <var data-var='date'>11</var>, <var data-var='time'>13:23</var> PST</small><br><strong>Identified</strong> - Our Engineering teams have been actively working to resolve issues affecting website loading speeds. We are creating this incident for better visibility and sharing of updates.</p>tag:status.tithe.ly,2005:Incident/196682372024-01-10T07:05:38-08:002024-01-10T07:05:38-08:00Website Maintenance<p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>07:05</var> PST</small><br><strong>Resolved</strong> - Our teams have completed the maintenance and sites are loading normally again!</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>06:47</var> PST</small><br><strong>Identified</strong> - Our Engineering teams are working on a database update that has extended beyond the planned time. With that time extending we will be providing updates here.</p>tag:status.tithe.ly,2005:Incident/196671092024-01-10T06:30:26-08:002024-01-10T06:30:26-08:00Website Maintenance and Database Upgrade<p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>06:30</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>06:01</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>04:29</var> PST</small><br><strong>Scheduled</strong> - Our Engineering team will be making important updates that will result in your website being unavailable for approximately 15 minutes. There is no action needed from you as this upgrade occurs.</p>tag:status.tithe.ly,2005:Incident/195212252023-12-24T12:43:18-08:002023-12-24T12:43:18-08:00Issues with some custom websites<p><small>Dec <var data-var='date'>24</var>, <var data-var='time'>12:43</var> PST</small><br><strong>Resolved</strong> - Our Engineering team has let us know that this is resulted and sites are loading as expected. Please reach out to our support team (support@tithe.ly) if you are experiencing any troubles!</p><p><small>Dec <var data-var='date'>24</var>, <var data-var='time'>12:01</var> PST</small><br><strong>Monitoring</strong> - Our teams are seeing significantly improved performance across all sites. We will monitor for a bit longer before declaring this incident resolved.</p><p><small>Dec <var data-var='date'>24</var>, <var data-var='time'>11:26</var> PST</small><br><strong>Identified</strong> - We are noticing improvement across customer sites, however we are still seeing some errors so our teams are continuing to evaluate.</p><p><small>Dec <var data-var='date'>24</var>, <var data-var='time'>11:00</var> PST</small><br><strong>Investigating</strong> - We are investigating an issue affecting some customer's websites.</p>tag:status.tithe.ly,2005:Incident/194721292023-12-18T09:12:16-08:002023-12-18T09:12:16-08:00Errors with Tithely Giving<p><small>Dec <var data-var='date'>18</var>, <var data-var='time'>09:12</var> PST</small><br><strong>Resolved</strong> - This issue was identified to be very small in scope and has been resolved by our team.</p><p><small>Dec <var data-var='date'>18</var>, <var data-var='time'>08:50</var> PST</small><br><strong>Investigating</strong> - We are investigating an issue where a subset of people are reporting errors when attempting to process a gift. Our Engineering team is investigating this now.</p>tag:status.tithe.ly,2005:Incident/193675572023-12-07T08:54:34-08:002023-12-07T08:54:34-08:00Unable to load Messaging Blasts<p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>08:54</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>08:36</var> PST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>07:33</var> PST</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>06:54</var> PST</small><br><strong>Investigating</strong> - Contacts are not loading when attempting to create and send a blast. We are currently investigating this.</p>tag:status.tithe.ly,2005:Incident/192273712023-11-30T17:02:48-08:002023-11-30T17:02:48-08:00Issues Generating Tax Statements<p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>17:02</var> PST</small><br><strong>Resolved</strong> - The issue affecting the generation of tax statements has been fully resolved by our Engineering teams. Thanks for your patience while we needed to work through this and ensure things are working as expected for you!</p><p><small>Nov <var data-var='date'>27</var>, <var data-var='time'>08:04</var> PST</small><br><strong>Investigating</strong> - Our teams have been investigating issues generating tax statements and we are now escalating this to an incident for visibility.</p>tag:status.tithe.ly,2005:Incident/192180592023-11-27T07:06:27-08:002023-11-27T07:06:27-08:00Issues with email blasts sent through Tithely Messaging<p><small>Nov <var data-var='date'>27</var>, <var data-var='time'>07:06</var> PST</small><br><strong>Resolved</strong> - This issue has been resolved and emails are being delivered as expected now!</p><p><small>Nov <var data-var='date'>27</var>, <var data-var='time'>05:37</var> PST</small><br><strong>Update</strong> - Our teams are continuing to work with our email sending provider to resolve this. We are still experiencing the issue where no emails are sending through the Messaging product.</p><p><small>Nov <var data-var='date'>26</var>, <var data-var='time'>05:03</var> PST</small><br><strong>Update</strong> - Overnight our teams continued to work with our email provider to resolve the troubles affecting the sending of emails via Tithely Messaging. We will have another update as soon as possible.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>18:15</var> PST</small><br><strong>Identified</strong> - We have implemented a change and should be seeing this resolved soon.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>15:09</var> PST</small><br><strong>Investigating</strong> - We are currently experiencing an issue affecting the sending of emails using Tithely Messaging. Our Engineers are aware and working to resolve this.</p>tag:status.tithe.ly,2005:Incident/191269222023-11-27T04:15:10-08:002023-11-27T04:15:10-08:00Delays in Integration Sends<p><small>Nov <var data-var='date'>27</var>, <var data-var='time'>04:15</var> PST</small><br><strong>Resolved</strong> - Our team can confirm that issues affecting delays in the integration have been resolved.</p><p><small>Nov <var data-var='date'>20</var>, <var data-var='time'>10:13</var> PST</small><br><strong>Update</strong> - Our Integrations team has resolved troubles affecting several integrations, yet we are still experiencing slower than normal processing times for the Tithely Giving > Elvanto integration and work continues on this.</p><p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>04:20</var> PST</small><br><strong>Identified</strong> - Our team is aware that some integrations are delayed in the sending of some of the transactions. Our Engineering team is actively working on solving this. No action is needed from customers for this delay and we will update as we have more information.</p>tag:status.tithe.ly,2005:Incident/190777922023-11-09T14:20:21-08:002023-11-09T14:20:22-08:00Tithely People and Messaging are not loading<p><small>Nov <var data-var='date'> 9</var>, <var data-var='time'>14:20</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'> 9</var>, <var data-var='time'>13:55</var> PST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Nov <var data-var='date'> 9</var>, <var data-var='time'>13:43</var> PST</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.tithe.ly,2005:Incident/190043702023-11-06T21:30:06-08:002023-11-06T21:30:06-08:00Website Maintenance and Server Upgrade<p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>21:30</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>20:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>14:44</var> PDT</small><br><strong>Scheduled</strong> - Our Engineering team will be making important updates that will result in your website being unavailable for approximately 15 minutes. There is no action needed from you as this upgrade occurs.</p>tag:status.tithe.ly,2005:Incident/190027742023-11-02T12:26:22-07:002023-11-02T12:26:22-07:00Site Loading Time is Lagging<p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>12:26</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>12:08</var> PDT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>11:34</var> PDT</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>