Active Incident

Updated a few seconds ago

Investigating issues with MaestroSecurity Issue

Incident Status

Security Issue

Components

Shared Services

Locations

Maestro


April 11, 2024 10:46AM EDT
[Investigating] We’re currently investigating reports of a potential service interruption with Maestro. We apologize for any inconvenience and will post another update as soon as we learn more.

April 11, 2024 10:46AM EDT
[Identified] Due to the recent security alert from CISA and Sisense, we have taken steps to ensure we mitigate any risk related to potential credential exposure. As such, Sisense / Maestro will be unavailable while we mitigate the issue. All credentials have been rotated per the vendors recommendation, and we have not seen any suspicious activity. We will continue to monitor updates from the vendor and implement their recommendations as they become available. As part of this remediation, we will be scheduling maintenance over the next few days to update the systems during low impact business times. Until this maintenance occurs Sisense/Maestro will be unavailable.

April 11, 2024 10:56AM EDT
[Monitoring] We’re currently monitoring the situation with Sisense. If we have any update we will post here on the incident.

Shared Services

Operational

Production TMS

Operational

Quality TMS

Operational

Final Mile

Operational

Back Office

Operational

Claims Services

Operational

ITS NxGen

Operational

Edge

Operational

External Services

AWS EC2

Amazon Web Services

Cloudflare

DHL

Fedex

MS Office365

Mimecast

SendGrid

Status.io

UPS

6

Upcoming Maintenances

0

Days Until Next Maintenance

2

Incidents Last 7 Days

Scheduled Maintenance

UPDATE: QA Refresh Taking Place On April 10-15 2024Planned Maintenance

Schedule

April 10, 2024 9:00PM - April 15, 2024 12:00PM EDT

Components

Quality TMS

Locations

APMT001QA, APMT101QA, NAMT000QA, NAMT001QA, NAMT002QA, NAMT003QA, NAMT004QA, NAMT005QA, NAMT006QA, NAMT007QA, NAMT008QA, NAMT009QA, NAMT010QA, NAMT011QA, NAMT012QA, NAMT013QA, NAMT014QA, NAMT015QA, NAMT016QA, NAMT017QA, NAMT020QA, NAMT021QA, NAMT100QA, NAMT101QA, NAMT102QA, NAMT103QA, NAMT104QA, NAMT105QA, NAMT106QA, NAMT107QA, NAMT108QA, NAMT109QA, NAMT110QA, NAMT111QA, NAMT112QA, NAMT113QA, NAMT114QA, NAMT115QA, NAMT116QA, NAMT117QA, NAMT118QA, NAMT119QA, NAMT120QA, NAMT121QA, NAMT122QA, NAMT018PW, NAMT000QA, NAMT004QA, NAMT009QA, NAMT020QA, NAMT021QA

Description

This note is to remind customers that the shared QA servers will be refreshed with Production data starting on Wednesday, April 10, 2024. Included in the subscription, this refresh occurs once per release cycle in order to prepare for our customer testing period for the next product release. The most up-to-date release schedule and release notes can be found in the Support Portal. Please note that customers will have use of their QA environment up until 8:00 pm EDT on Wednesday, April 10th. We ask that ANY configurations in QA that need to be backed up be copied to PROD prior to Tuesday, April 9th at 9:00pm EDT. This will ensure that they are included in the PROD backup and copied successfully back to QA after the refresh. The QA environments will be available for use again no later than 12:00pm EDT on Monday, April 15th, but may be online as early as Thursday April 11th at 12:00pm EDT. At this time, please test your workflows and any customizations that you may have. If you have any questions, please open a ticket in MercuryCommunity or reach out to your Customer Success Manager
Server MaintenancePlanned Maintenance

Schedule

April 16, 2024 10:00PM - 11:00PM EDT

Components

Final Mile

Locations

Final Mile US Prod, Final Mile US UAT, Final Mile US QA

Description

During this maintenance period, the FinalMile application and services may intermittently become unavailable, no action will be necessary on your part.
TMS Server MaintenancePlanned Maintenance

Schedule

April 16, 2024 10:00PM - 10:30PM EDT

Components

Production TMS

Locations

NADC263PA

Description

On April 16, between 10:00pm - 11:59pm ET, your TMS server will be unavailable for up to 15 minutes. No action should be necessary on your part. If you are unable to log into the server after 11:59pm ET, please open a Support Case in the MercuryGate Community Support Portal or call the Support Line at 877-537-6419.
TMS Server MaintenancePlanned Maintenance

Schedule

April 17, 2024 10:00PM - 11:59PM EDT

Components

Production TMS

Locations

NADC280PA

Description

On April 17, between 10:00pm - 11:59pm ET, your TMS server will be unavailable for up to 15 minutes. No action should be necessary on your part. If you are unable to log into the server after 11:59pm ET, please open a Support Case in the MercuryGate Community Support Portal or call the Support Line at 877-537-6419.
TMS Server Maintenance Planned Maintenance

Schedule

April 18, 2024 9:00PM - April 19, 2024 12:00AM EDT

Components

Production TMS

Locations

NADC263PA, NADC283PA, NAMT008PA

Description

On April 18, between 9:00pm - 12:59am ET, your TMS server will be unavailable for up to 90 minutes. No action should be necessary on your part. If you are unable to log into the server after 1:01am ET, please open a Support Case in the MercuryGate Community Support Portal or call the Support Line at 877-537-6419.
TMS Production PromotesPlanned Maintenance

Schedule

June 26, 2024 10:00PM - 10:30PM EDT

Components

Production TMS

Locations

NADC262PA, NADC272PA, NADC276PA, NADC278PA, NADC280PA, NADC283PA, NADC287PA, NADC299PA, NADC309PA

Description

As per our current update policy and previous notice, the below production tenants will be promoted to 3.38.8 on June 26th unless a prior promote is requested. If the tenants are promoted to 3.37 or higher prior to June 26th no promote will occur. See https://status-files.mercurygate.com/Update_announcment.pdf for details on the policy.

History (Last 7 days)

TMS Server Maintenance Planned Maintenance

Description

On April 15, between 9:00pm - 1:00am ET, your TMS server will be unavailable for up to 90 minutes. No action should be necessary on your part. If you are unable to log into the server after 1:01am ET, please open a Support Case in the MercuryGate Community Support Portal or call the Support Line at 877-537-6419.


Components

Production TMS


Locations

NADC264PA, NADC272PA


Schedule

April 15, 2024 9:00PM - April 16, 2024 1:01AM EDT


April 15, 2024 9:00PM EDT
[Update] Scheduled maintenance is starting.

April 16, 2024 1:01AM EDT
[Update] Scheduled maintenance is complete.
Server MaintenancePlanned Maintenance

Description

During this maintenance period, the FinalMile application and services may intermittently become unavailable, no action will be necessary on your part.


Components

Final Mile, Back Office


Locations

Final Mile US Prod, Final Mile US UAT, Final Mile US QA, Backoffice US Prod, Backoffice US UAT, Backoffice US QA


Schedule

April 15, 2024 10:00PM - April 15, 2024 11:59PM EDT


April 15, 2024 10:00PM EDT
[Update] Scheduled maintenance is starting.

April 15, 2024 11:59PM EDT
[Update] Maintenance has ended.
Emergency Maintenance April 14thPlanned Maintenance

Description

Due to the recent security alert from CISA and Sisense, we have taken steps to ensure we mitigate any risk related to potential credential exposure. As such, Sisense / Maestro will be unavailable while we mitigate the issue. All credentials have been rotated per the vendors recommendation, and we have not seen any suspicious activity. We will continue to monitor updates from the vendor and implement their recommendations as they become available. As part of this remediation, we will be scheduling maintenance over the next few days to update the systems during low impact business times. Until this maintenance occurs Sisense/Maestro will be unavailable.


Components

Shared Services, Production TMS


Locations

APMT001PA, NADC271PA, NADC302PA, NAMT012PA, NAMT016PA, NAMT020PA, NAMT021PA, NAMT003PA2, EUMT001PA, Maestro


Schedule

April 14, 2024 10:00PM - April 14, 2024 10:15PM EDT


April 14, 2024 10:00PM EDT
[Update] Scheduled maintenance is starting.

April 14, 2024 10:15PM EDT
[Update] Scheduled maintenance is complete.
TMS Server MaintenancePlanned Maintenance

Description

For up to 10 minutes during this period, the Production MercuryGate TMS application may not be available. No action should be necessary on your part.


Components

Production TMS


Locations

NADC309PA


Schedule

April 12, 2024 10:00PM - April 12, 2024 10:30PM EDT


April 12, 2024 10:00PM EDT
[Update] Scheduled maintenance is starting.

April 12, 2024 10:30PM EDT
[Update] Scheduled maintenance is complete.
TMS Server Maintenance Planned Maintenance

Description

On April 11, between 9:00pm - 11:59pm ET, your TMS server will be unavailable for up to 90 minutes. No action should be necessary on your part. If you are unable to log into the server after 12:01am ET, please open a Support Case in the MercuryGate Community Support Portal or call the Support Line at 877-537-6419.


Components

Production TMS


Locations

NAMT007PA, NAMT012PA, NAMT014PA


Schedule

April 11, 2024 9:00PM - April 11, 2024 11:59PM EDT


April 11, 2024 9:00PM EDT
[Update] Scheduled maintenance is starting.

April 11, 2024 11:59PM EDT
[Update] Scheduled maintenance is complete.
TMS Server MaintenancePlanned Maintenance

Description

There will be a CSR Promote to the current TMS Version, updating to version 3.37.14. For approximately 30 minutes during this period, the MercuryGate TMS application will not be available. No action should be necessary on your part. If you are unable to log into the server after 11:59am ET, please open a Support Case in the MercuryGate Community Support Portal or call the Support Line at 877-537-6419.


Components

Production TMS, Quality TMS


Locations

APMT001PA, NADC325QA


Schedule

April 11, 2024 10:00AM - April 11, 2024 11:59AM EDT


April 11, 2024 10:00AM EDT
[Update] Scheduled maintenance is starting.

April 11, 2024 11:59AM EDT
[Update] Scheduled maintenance is complete.
TMS Server MaintenancePlanned Maintenance

Description

There will be a CSR Promote to the current TMS Version, updating to version 3.37.14. For approximately 30 minutes during this period, the MercuryGate TMS application will not be available. No action should be necessary on your part. If you are unable to log into the server after 11:59pm ET, please open a Support Case in the MercuryGate Community Support Portal or call the Support Line at 877-537-6419.


Components

Production TMS, Quality TMS


Locations

NADC297PA, NADC304PA, NADC306PA, NADC344PA, NAMT000PA, NAMT001PA, NAMT002PA, NAMT004PA, NAMT005PA, NAMT006PA, NAMT007PA, NAMT008PA, NAMT009PA, NAMT010PA, NAMT011PA, NAMT012PA, NAMT013PA, NAMT014PA, NAMT015PA, NAMT016PA, NAMT017PA, NAMT018PA, NAMT020PA, NAMT021PA, NADC313QA, NADC332PA2, NADC410PA, NAMT022PA, EUMT001PA, NAMT023PA, NAMT024PA, NAMT025PA, NAMT026PA, NAMT027PA, EUMT002PA


Schedule

April 10, 2024 10:00PM - April 10, 2024 11:59PM EDT


April 10, 2024 10:00PM EDT
[Update] Scheduled maintenance is starting.

April 10, 2024 11:59PM EDT
[Update] Scheduled maintenance is complete.
TMS Server MaintenancePlanned Maintenance

Description

On April 10, between 10:00pm - 11:59pm ET, your TMS server will be unavailable for up to 15 minutes. No action should be necessary on your part. If you are unable to log into the server after 11:59pm ET, please open a Support Case in the MercuryGate Community Support Portal or call the Support Line at 877-537-6419.


Components

Production TMS


Locations

NADC284PA


Schedule

April 10, 2024 10:00PM - April 10, 2024 11:59PM EDT


April 10, 2024 10:00PM EDT
[Update] Scheduled maintenance is starting.

April 10, 2024 11:59PM EDT
[Update] Scheduled maintenance is complete.
Server MaintenancePlanned Maintenance

Description

During this maintenance period, the FinalMile application and services may intermittently become unavailable, no action will be necessary on your part.


Components

Final Mile, Back Office


Locations

Final Mile London Prod, Final Mile London UAT, Final Mile London QA, Backoffice London Prod, Backoffice London UAT, Backoffice London QA


Schedule

April 10, 2024 6:00PM - April 10, 2024 8:00PM EDT


April 10, 2024 6:00PM EDT
[Update] Maintenance is starting.

April 10, 2024 8:00PM EDT
[Update] Maintenance has ended.
TMS Server MaintenancePlanned Maintenance

Description

For up to 10 minutes during this period, the Production MercuryGate TMS application may not be available. No action should be necessary on your part.


Components

Production TMS


Locations

EUDC298PA, NADC250PA, NADC251PA, NADC253PA, NADC258PA, NADC261PA, NADC262PA, NADC263PA, NADC264PA, NADC265PA, NADC267PA, NADC268PA, NADC269PA, NADC270PA, NADC271PA, NADC272PA, NADC274PA, NADC275PA, NADC276PA, NADC278PA, NADC280PA, NADC281PA, NADC282PA, NADC283PA, NADC284PA, NADC285PA, NADC286PA, NADC287PA, NADC288PA, NADC290PA, NADC291PA, NADC292PA, NADC294PA, NADC295PA, NADC296PA, NADC299PA, NADC301PA, NADC302PA, NADC321PA, NADC334PA, NADC342PA, NADC343PA, NADC418PA, NADC418PA2, NADC389PA, NADC411PA, EUMT001PA, EUMT002PA


Schedule

April 10, 2024 1:00AM - April 10, 2024 3:00AM EDT


April 10, 2024 1:00AM EDT
[Update] Scheduled maintenance is starting.

April 10, 2024 3:00AM EDT
[Update] Scheduled maintenance is complete.
TMS Server MaintenancePlanned Maintenance

Description

For up to 10 minutes during this period, the QA MercuryGate TMS application may not be available. No action should be necessary on your part.


Components

Quality TMS


Locations

EUDC298QA, NADC042QA, NADC159QA, NADC250QA, NADC251QA, NADC253QA, NADC254QA, NADC258QA, NADC260QA, NADC262QA, NADC263QA, NADC264QA, NADC265QA, NADC266QA, NADC267QA, NADC268QA, NADC269QA, NADC270QA, NADC271QA, NADC272QA, NADC274QA, NADC275QA, NADC278QA, NADC280QA, NADC282QA, NADC283QA, NADC284QA, NADC285QA, NADC286QA, NADC287QA, NADC290QA, NADC291QA, NADC292QA, NADC294QA, NADC295QA, NADC296QA, NADC299QA, NADC301QA, NADC302QA, NADC304QA, NADC308QA, NADC309QA, NADC314QA, NADC316QA, NADC317QA, NADC318QA, NADC321QA, NADC324QA, NADC325QA, NADC326QA, NADC328QA, NADC331QA, NADC332QA, NADC334QA, NADC342QA, NADC343QA, NADC345QA, NADC348QA, NADC361QA, NADC364QA, NADC366QA, NADC370QA, NADC372QA, NADC375QA, NADC378QA, NADC379QA, NADC394QA, NADC405QA, NADC412QA, NADC414QA, NADC415QA, NADC416QA, NADC418QA, NADC419QA, NADC421QA, NADC260QA2, NADC267QA2, NADC280QA2, NADC282QA2, NADC302QA2, NADC307DEV, NADC307SA, NADC319QA4, NADC342QA2, NADC342QA3, NADC371QA2, NADC378QA2, NADC405QA2, NADC405QA3, NADC415QA2, NADC415QA3, NADC415QA4, NADC415QA5, NADC415QA6, NADC415QA7, NADC422QA, NADC252QA, NADC309QA, NADC403QA, NADC391QA, NADC402QA, NADC397QA, NADC332QA


Schedule

April 9, 2024 11:00PM - April 10, 2024 1:00AM EDT


April 9, 2024 11:00PM EDT
[Update] Scheduled maintenance is starting.

April 10, 2024 1:00AM EDT
[Update] Scheduled maintenance is complete.
TMS Server MaintenancePlanned Maintenance

Description

There will be a CSR Promote to the current TMS Version, updating to version 3.37.14. For approximately 30 minutes during this period, the MercuryGate TMS application will not be available. No action should be necessary on your part. If you are unable to log into the server after 11:59pm ET, please open a Support Case in the MercuryGate Community Support Portal or call the Support Line at 877-537-6419.


Components

Production TMS


Locations

EUMT001PA, EUMT002PA


Schedule

April 9, 2024 10:00PM - April 9, 2024 11:59PM EDT


April 9, 2024 10:00PM EDT
[Update] Scheduled maintenance is starting.

April 9, 2024 11:59PM EDT
[Update] Scheduled maintenance is complete.
Investigating issues with Mercury IntegratePartial Service Disruption

Incident Status

Partial Service Disruption


Components

Shared Services


Locations

Mercury Integrate



April 9, 2024 3:07PM EDT
[Investigating] We’re currently investigating reports of a potential service interruption with Mercury Integrate. We apologize for any inconvenience and will post another update as soon as we learn more.

April 9, 2024 3:09PM EDT
[Identified] We’re currently working on resolving the issue. We apologize for any inconvenience and will post another update as soon as we learn more.

April 9, 2024 3:49PM EDT
[Monitoring] We’re currently monitoring the update that was put in place. Please notify us if you notice any further issues.

April 9, 2024 5:51PM EDT
[Resolved] Issue has been resolved. Thank you for your patience while we resolved this issue. RCA will be posted once completed.
Investigating issues with Assigning CarriersPartial Service Disruption

Incident Status

Partial Service Disruption


Components

Production TMS


Locations

NAMT005PA, NAMT017PA



April 2, 2024 8:17AM EDT
[Investigating] We’re currently investigating reports of a potential service interruption with Assigning Carriers for some customers. We apologize for any inconvenience and will post another update as soon as we learn more.

April 2, 2024 8:24AM EDT
[Identified] We’re currently working on resolving the issue. We apologize for any inconvenience and will post another update as soon as we learn more.

April 2, 2024 8:52AM EDT
[Identified] The update will require a code solution. We are working on that and will update once we are ready to roll the update out. We will provide more details as we complete the testing of the solution.

April 2, 2024 9:30AM EDT
[Identified] We are expecting to be able to update the code in the next few hours on the servers. When we are ready we will post a message for a brief outage to roll out the update.

April 2, 2024 10:53AM EDT
[Identified] We are going have to restart MT005P at Noon EST time. This will resolve the current issue.

April 2, 2024 12:17PM EDT
[Monitoring] Restart has been completed. We are now monitoring.

April 9, 2024 3:06PM EDT
[Resolved] Issue has been resolved. Thank you for your patience while we resolved this issue.