tag:status.arundo.com,2005:/historyArundo Status Site Status - Incident History2024-03-27T21:50:54-05:00Arundo Status Sitetag:status.arundo.com,2005:Incident/203537952024-03-27T13:00:02-05:002024-03-27T13:00:02-05:00Marathon Production Release and Database Migration<p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>13:00</var> CDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>11:00</var> CDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>14:37</var> CDT</small><br><strong>Scheduled</strong> - As part of our scheduled Marathon production release we will be migrating and upgrading our time series database. This will cause access to the Marathon application to be down for up to 30 minutes and will pause data ingest and model processing for up to 2 hours, both of which will backfill after the upgrade is complete.</p>tag:status.arundo.com,2005:Incident/203554572024-03-27T04:30:02-05:002024-03-27T04:30:02-05:00Minor change to underlying infrastructure<p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>04:30</var> CDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>04:00</var> CDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>18:12</var> CDT</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p>tag:status.arundo.com,2005:Incident/202235682024-03-12T08:13:12-05:002024-03-12T08:13:12-05:00We are experiencing network issues in EMEA<p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>08:13</var> CDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>06:16</var> CDT</small><br><strong>Monitoring</strong> - A temporary fix has been implemented that seems to resolve the issue. Monitoring to make sure it works.</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>05:07</var> CDT</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.arundo.com,2005:Incident/201682742024-03-07T04:07:24-06:002024-03-07T04:07:52-06:00Upgrade of underlying infrastructure for US production environment<p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>04:07</var> CST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>03:00</var> CST</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p>tag:status.arundo.com,2005:Incident/201669912024-03-05T10:36:36-06:002024-03-05T10:36:36-06:00Upgrade of underlying infrastructure for EMEA production environment<p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>10:36</var> CST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>10:31</var> CST</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>09:55</var> CST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>08:35</var> CST</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p>tag:status.arundo.com,2005:Incident/199377752024-02-08T06:00:56-06:002024-02-08T06:00:56-06:00Upgrading underlying infrastructure of Arundo Identity<p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>06:00</var> CST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>05:00</var> CST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress, but delayed. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>03:43</var> CST</small><br><strong>Scheduled</strong> - This will affect all products that use Arundo Identity for authentication and authorization. We expect short service disruptions to users who log in.</p>tag:status.arundo.com,2005:Incident/192377892023-11-30T14:22:30-06:002023-11-30T14:22:30-06:00Routine Marathon Update<p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>14:22</var> CST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>14:16</var> CST</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>14:00</var> CST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>28</var>, <var data-var='time'>16:35</var> CST</small><br><strong>Scheduled</strong> - All Marathon production environments will undergo a routine update. No downtime is expected but some users may encounter a slower than expected response when first logging into the application after the update has been completed.</p>tag:status.arundo.com,2005:Incident/189931722023-11-02T09:06:11-05:002023-11-02T09:06:11-05:00Switching production database for Frontline<p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>09:06</var> CDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'> 1</var>, <var data-var='time'>15:18</var> CDT</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p>tag:status.arundo.com,2005:Incident/189723412023-10-31T04:42:01-05:002023-10-31T04:42:01-05:00Third-party outage affecting Arundo's services<p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>04:42</var> CDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>30</var>, <var data-var='time'>17:39</var> CDT</small><br><strong>Monitoring</strong> - The issue seems to be resolved by Cloudflare.</p><p><small>Oct <var data-var='date'>30</var>, <var data-var='time'>16:01</var> CDT</small><br><strong>Investigating</strong> - We are seeing networking issues with our third-party load balancer provider (Cloudflare) in some regions. This may impact your use of Arundo's products.</p>tag:status.arundo.com,2005:Incident/169942852023-04-29T02:51:15-05:002023-04-29T02:51:15-05:00Issue deploying correct application version<p><small>Apr <var data-var='date'>29</var>, <var data-var='time'>02:51</var> CDT</small><br><strong>Resolved</strong> - Issue fixed.</p><p><small>Apr <var data-var='date'>28</var>, <var data-var='time'>16:45</var> CDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Apr <var data-var='date'>28</var>, <var data-var='time'>09:41</var> CDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Apr <var data-var='date'>28</var>, <var data-var='time'>09:40</var> CDT</small><br><strong>Investigating</strong> - Reason for issue identified, we are currently working to resolve it.</p>tag:status.arundo.com,2005:Incident/169096092023-04-19T03:30:00-05:002023-04-19T04:31:25-05:00UI issue for "Cl2 - Operational Parameters"<p><small>Apr <var data-var='date'>19</var>, <var data-var='time'>03:30</var> CDT</small><br><strong>Resolved</strong> - Identified and fixed.</p>tag:status.arundo.com,2005:Incident/66600622021-04-02T00:30:16-05:002021-04-02T07:20:41-05:00Marathon and Edge Docs are experiencing infrastructure issues<p><small>Apr <var data-var='date'> 2</var>, <var data-var='time'>00:30</var> CDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Apr <var data-var='date'> 1</var>, <var data-var='time'>17:47</var> CDT</small><br><strong>Update</strong> - Microsoft rerouted traffic to their resilient DNS capabilities and we are seeing improvement in service availability. Microsoft are continuing to investigate the cause of the DNS issue.</p><p><small>Apr <var data-var='date'> 1</var>, <var data-var='time'>17:27</var> CDT</small><br><strong>Investigating</strong> - Starting at approximately 21:30 UTC on 01 Apr 2021 the Edge Docs (https://edgedocs.arundo.com) and Marathon (https://marathon.arundo.com) are experiencing infrastructure issues which can lead to downtime. Engineering teams have been engaged and are currently investigating a potential underlying DNS issue in Microsoft Azure.</p>tag:status.arundo.com,2005:Incident/49941362020-08-31T10:20:53-05:002021-03-01T11:55:18-06:00This is an example incident<p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>10:20</var> CDT</small><br><strong>Resolved</strong> - Empathize with those affected and let them know everything is operating as normal.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>10:10</var> CDT</small><br><strong>Monitoring</strong> - Let your users know once a fix is in place, and keep communication clear and precise.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>10:16</var> CDT</small><br><strong>Identified</strong> - As you continue to work through the incident, update your customers frequently.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>10:46</var> CDT</small><br><strong>Investigating</strong> - When your product or service isn’t functioning as expected, let your customers know by creating an incident. Communicate early, even if you don’t know exactly what’s going on.</p>