2119hrs AEDT: Services are now restoring and everything coming back online. We are severely disappointed in our upstream carrier and will be getting a post incident report which we will update here and provide on request. Many other ISPs have been affected also and we will be persistent in finding out how this could have happened and for the length of time that it did.
2115hrs AEDT: We just had an update that the carriers level 3 engineers are still working with tech onsite.
2029hrs AEDT: Engineer is onsite and ETR 20-30mins.
1851hrs AEDT: The carrier has changed the cause and said that they suspect a faulty line card in one of their core routers. They have dispatched a technician to replace the card and awaiting an ETR from the engineer.
1750hrs AEDT: We have been advised this is related to a fibre cut in a major interconnect. Engineers are still investigating the cause and no ETR and this stage. Updates to follow.
1740hrs AEDT: This was escalated to management at the carrier and they have confirmed there is a major equipment failure. There is no ETR or further information but it has been confirmed. We will receive an update within the next 30mins and we will update it here.
1730hrs AEDT: We are still awaiting a response from the upstream carrier but we are actively chasing them.
1648hrs AEDT: We have identified we have lost physical connectivity to our upstream carrier as we have no optic light input. We are calling the carrier to report the issue and have the connectivity restored.
1640hrs AEDT: We currently have a major nbn outage in progress. We are investigating what the issue is to determine what the issue is. We will post further updates here. It appears most nbn services are affected.