Ardent Networks - Core Router Issue – Incident details

Core Router Issue

Resolved
Major outage
Started about 23 hours agoLasted about 1 hour

Affected

Network Monitors

Major outage from 6:25 PM to 7:17 PM

Chattaroy, WA

Major outage from 6:25 PM to 7:17 PM

CHATWALM

Major outage from 6:25 PM to 7:17 PM

CHATWACVE

Major outage from 6:25 PM to 7:17 PM

Spangle, WA

Major outage from 6:25 PM to 7:17 PM

cr1 - SPNGWAOS

Major outage from 6:25 PM to 7:17 PM

Updates
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Monitoring
    UTC
    Monitoring

    We have implemented a fix and customer services have now been restored.


    Technical details:

    The root cause was traced to a memory leak in one of our core routers, a VyOS BNG. During recovery, the BNG virtual machine was rebooted, but the DHCP service failed to start correctly because the VM's interface assignments were mapped incorrectly between the underlying physical and virtual interfaces.

    Once the interface assignments were corrected and the DHCP service was restarted, customer connectivity was restored. We are continuing to monitor the platform closely to confirm stability and ensure there are no further issues.

    We appreciate your patience while we worked through the outage.

  • Identified
    UTC
    Identified

    We are currently investigating a network issue affecting customer connectivity across portions of the Ardent network.

    Our team has identified the issue within a core routing platform and is actively restoring service on a rebuilt instance. Some customers may experience intermittent connectivity or a complete loss of service while this work is completed.

    We apologize for the disruption and appreciate your patience. We’ll provide another update as restoration progresses.