3rd April 2022

NBN NBN services down - Failed router upgrade

0956hrs AEST: Final outage completed and all services should now be stable and issue resolved. We will be in contact with the vendor with the crash logs and a time to replace the equipment will be posted on this page.

0934hrs AEST: Services are now restoring, we have repatched our nbn aggregation into another router to pass through to restore services. This looks to be a hardware fault with the router and we will need to replace this but for the short term all services are back up and working, this will be scheduled in the next couple of days. There will be one small outage to resolve fault. Once completed an update will be provided here.

855hrs AEST: Attempting alternative solution to bring services back up online.

0838hrs AEST: Replacement 10Gbit card did not work and router is still failing to boot with 10Gbit card inserted and pointing to a hardware fault. Further investigation required.

826hrs AEST: Issue identified as 10Gbit card that terminates nbn services has failed and not the IOS upgrade. 10Gbit card being replaced with on site spare to resolve issue.

819hrs AEST: Issue identified and router restarting with previous IOS.

0811hrs AEST: Remote hands on site investigating router.

0748hrs AEST: We have arranged remote hands at the DC and awaiting arrival.

00652hrs AEST: Router is unresponsive via console and power cycling has not been successful.

0545hrs AEST: Our core router upgrade failed this morning and we have not been able to resolve this with our remote access as planned. We are looking to resolve this as soon as possible.